About
Welcome! I am a Principal Scientist at the Microsoft Mixed Reality & AI lab in Zürich. Prior to joining Microsoft, I obtained my PhD in Computer Science in the Computer Vision and Geometry Group at ETH Zürich, where I was advised by Marc Pollefeys and Jan-Michael Frahm. Before, I received my BSc from TU Munich and my MSc from UNC Chapel Hill. During my studies, I also spent time at Microsoft Research, Google, and the German Aerospace Center.
Research
My main research interests lie in image-based 3D modeling. More broadly, I am interested in computer vision, geometry, structure-from-motion, (multi-view) stereo, localization, optimization, machine learning, and image processing. You can find my publications on Google Scholar.
Open Source
As part of my research, I developed the open-source software COLMAP - an end-to-end image-based 3D reconstruction software, which achieves state-of-the-art results on reconstruction benchmarks (1, 2). Over the years, I also contributed to a number of other scientific open source projects, including scikit-image, scikit-learn, NumPy, SciPy, Ceres-Solver, etc. You can find my open source activities on GitHub.
Honors & Awards
- PAMI Mark Everingham Prize (2020) - For the COLMAP SFM and MVS software library. The Everingham Prize is awared for a selfless contribution of significant benefit to other members of the computer vision community.
- ETH Medal (2019) - Awarded yearly for outstanding doctoral theses at ETH Zurich.
- Best Paper Honorable Mention (DAGM) (2015) - Awarded for the paper "Efficient Two-View Geometry Classification".
Publications
You can find my publications on Google Scholar and ResearchGate.
2021
-
Cross-Descriptor Visual Localization and Mapping arXiv
-
Privacy Preserving Localization and Mapping from Uncalibrated Cameras Conference on Computer Vision and Pattern Recognition (CVPR)
-
Privacy-Preserving Image Features via Adversarial Affine Subspace Embeddings Conference on Computer Vision and Pattern Recognition (CVPR)
-
NeuralFusion: Online Depth Fusion in Latent Space Conference on Computer Vision and Pattern Recognition (CVPR)
2020
-
Multi-View Optimization of Local Feature Geometry European Conference on Computer Vision (ECCV)
-
Privacy Preserving Structure-from-Motion European Conference on Computer Vision (ECCV)
-
RoutedFusion: Learning Real-time Depth Map Fusion Conference on Computer Vision and Pattern Recognition (CVPR)
-
HoloLens 2 Research Mode as a Tool for Computer Vision Research arXiv
2019
-
Privacy Preserving Image Queries for Camera Localization International Conference on Computer Vision (ICCV)
-
Privacy Preserving Image-Based Localization Conference on Computer Vision and Pattern Recognition (CVPR)
-
SciPy 1.0 - Fundamental Algorithms for Scientific Computing in Python Nature Methods
2018
-
Robust Methods for Accurate and Efficient 3D Modeling from Unstructured Imagery PhD Thesis
-
Learning to Fuse Proposals from Multiple Scanline Optimizations in Semi-Global Matching European Conference on Computer Vision (ECCV)
[ Paper | Supplementary | Bibtex ]
-
Learning Priors for Semantic 3D Reconstruction European Conference on Computer Vision (ECCV)
[ Paper | Supplementary | Bibtex ]
-
VSO: Visual Semantic Odometry European Conference on Computer Vision (ECCV)
[ Paper | Supplementary | Bibtex ]
-
Semantic Visual Localization Conference on Computer Vision and Pattern Recognition (CVPR)
[ Paper | Supplementary | Bibtex ]
-
Augmenting Crowd-Sourced 3D Reconstructions using Semantic Detections Conference on Computer Vision and Pattern Recognition (CVPR)
[ Paper | Supplementary | Bibtex ]
2017
-
Comparative Evaluation of Hand-Crafted and Learned Local Features Conference on Computer Vision and Pattern Recognition (CVPR)
[ Benchmark | Paper | Supplementary | Bibtex ]
-
A Multi-View Stereo Benchmark with High-Resolution Images and Multi-Camera Videos Conference on Computer Vision and Pattern Recognition (CVPR)
[ Benchmark | Paper | Supplementary | Bibtex ]
-
Mapping on the Fly: Real-Time 3D Dense Reconstruction, Digital Surface Map and Incremental Orthomosaic Generation for Unmanned Aerial Vehicles International Conference on Field and Service Robotics (FSR)
[ Code | Paper | Supplementary | Bibtex ]
2016
-
A Vote-and-Verify Strategy for Fast Spatial Verification in Image Retrieval Asian Conference on Computer Vision (ACCV)
[ Code | Paper | Supplementary | Bibtex ]
-
Pixelwise View Selection for Unstructured Multi-View Stereo European Conference on Computer Vision (ECCV)
[ Paper | Supplementary | Bibtex | Video ]
-
Indoor-Outdoor 3D Reconstruction Alignment European Conference on Computer Vision (ECCV)
[ Paper | Supplementary | Bibtex | Video ]
-
Structure-from-Motion Revisited Conference on Computer Vision and Pattern Recognition (CVPR)
[ Website | Paper | Supplementary | Bibtex | Video ]
-
From Dusk till Dawn: Modeling in the Dark Conference on Computer Vision and Pattern Recognition (CVPR)
[ Paper | Supplementary | Bibtex | Video ]
2015
-
Efficient Two-View Geometry Classification German Conference on Pattern Recognition (GCPR) Best Paper Honorable Mention
-
PAIGE: PAirwise Image Geometry Encoding for Improved Efficiency in Structure-from-Motion Conference on Computer Vision and Pattern Recognition (CVPR)
-
From Single Image Query to Detailed 3D Reconstruction Conference on Computer Vision and Pattern Recognition (CVPR)
-
Reconstructing the World* in Six Days *(As Captured by the Yahoo 100 Million Image Dataset) Conference on Computer Vision and Pattern Recognition (CVPR)
2014
-
scikit-image: Image processing in Python PeerJ
-
Structure-from-motion for MAV image sequence analysis with photogrammetric applications Photogrammetric Computer Vision Symposium (PCV)
-
Benefit of Using Multiple Baselines and Multiple Aspects for SAR Interferometry of Urban Areas IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing (JSTARS)
-
Adaptive Covariance Matrix Estimation for Multi-Baseline InSAR Data Stacks IEEE Transactions on Geoscience and Remote Sensing (TGARS)
2013
-
Potential of Airborne Single-Pass Millimeterwave InSAR Data for Individual Tree Recognition 33. Wissenschaftlich Technische Jahrestagung der DGPF
Tutorials and Workshops
-
Image Matching: Local Features & Beyond Conference on Computer Vision and Pattern Recognition (CVPR) 2019 Conference on Computer Vision and Pattern Recognition (CVPR) 2020
[ Website ]
-
Long-Term Visual Localization Conference on Computer Vision and Pattern Recognition (CVPR) 2019 European Conference on Computer Vision (ECCV) 2020
[ Website (2019) | Website (2020) ]
-
Microsoft HoloLens 2 and Azure Kinect DK as Tools for Computer Vision Research European Conference on Computer Vision (ECCV) 2020
[ Website ]
-
Computer Vision Applications for Mixed Reality Headsets Conference on Computer Vision and Pattern Recognition (CVPR) 2019
[ Website ]
-
HoloLens as a Tool for Computer Vision Research European Conference on Computer Vision (ECCV) 2018
[ Website ]
-
COLMAP Structure-from-Motion and Multi-View Stereo Software
[ Website ]
-
Large-scale 3D Modeling Conference on Computer Vision and Pattern Recognition (CVPR) 2017
[ Website ]
-
Large-scale 3D Modeling from Crowdsourced Data International Conference on 3D Vision (3DV) 2016
[ Website ]