ResearchGate
LinkedInAbout
Welcome! I am a Senior Scientist at the Microsoft Mixed Reality and AI lab in Zürich. Prior to joining Microsoft, I obtained my PhD in Computer Science in the Computer Vision and Geometry Group at ETH Zürich, where I was advised by Marc Pollefeys and Jan-Michael Frahm. My PhD thesis was awarded with an ETH Medal. Before, I received my BSc from TU Munich and my MSc from UNC Chapel Hill. During my studies, I also spent time at Microsoft Research, Google, and the German Aerospace Center.
Research
My main research interests lie in robust image-based 3D modeling. More broadly, I am interested in computer vision, geometry, structure-from-motion, (multi-view) stereo, localization, optimization, machine learning, and image processing. You can find my publications on Google Scholar.
Open Source
As part of my research, I developed the open-source software COLMAP - an end-to-end image-based 3D reconstruction software, which achieves state-of-the-art results on recent reconstruction benchmarks (1, 2). Over the years, I also contributed to a number of other scientific open source projects, including scikit-image, scikit-learn, NumPy, SciPy, Ceres-Solver, etc. You can find my open source activities on GitHub.
Publications
You can find my publications on Google Scholar and ResearchGate.
2020
-
Privacy-Preserving Visual Feature Descriptors through Adversarial Affine Subspace Embedding arxiv
[ Paper ]
-
Multi-View Optimization of Local Feature Geometry European Conference on Computer Vision (ECCV)
[ Paper ]
-
RoutedFusion: Learning Real-time Depth Map Fusion Conference on Computer Vision and Pattern Recognition (CVPR)
2019
-
Privacy Preserving Image Queries for Camera Localization International Conference on Computer Vision (ICCV)
-
Privacy Preserving Image-Based Localization Conference on Computer Vision and Pattern Recognition (CVPR)
-
SciPy 1.0 - Fundamental Algorithms for Scientific Computing in Python Nature Methods
2018
-
Robust Methods for Accurate and Efficient 3D Modeling from Unstructured Imagery PhD Thesis
-
Learning to Fuse Proposals from Multiple Scanline Optimizations in Semi-Global Matching European Conference on Computer Vision (ECCV)
[ Paper | Supplementary | Bibtex ]
-
Learning Priors for Semantic 3D Reconstruction European Conference on Computer Vision (ECCV)
[ Paper | Supplementary | Bibtex ]
-
VSO: Visual Semantic Odometry European Conference on Computer Vision (ECCV)
[ Paper | Supplementary | Bibtex ]
-
Semantic Visual Localization Conference on Computer Vision and Pattern Recognition (CVPR)
[ Paper | Supplementary | Bibtex ]
-
Augmenting Crowd-Sourced 3D Reconstructions using Semantic Detections Conference on Computer Vision and Pattern Recognition (CVPR)
[ Paper | Supplementary | Bibtex ]
2017
-
Comparative Evaluation of Hand-Crafted and Learned Local Features Conference on Computer Vision and Pattern Recognition (CVPR)
[ Benchmark | Paper | Supplementary | Bibtex ]
-
A Multi-View Stereo Benchmark with High-Resolution Images and Multi-Camera Videos Conference on Computer Vision and Pattern Recognition (CVPR)
[ Benchmark | Paper | Supplementary | Bibtex ]
-
Mapping on the Fly: Real-Time 3D Dense Reconstruction, Digital Surface Map and Incremental Orthomosaic Generation for Unmanned Aerial Vehicles International Conference on Field and Service Robotics (FSR)
[ Code | Paper | Supplementary | Bibtex ]
2016
-
A Vote-and-Verify Strategy for Fast Spatial Verification in Image Retrieval Asian Conference on Computer Vision (ACCV)
[ Code | Paper | Supplementary | Bibtex ]
-
Pixelwise View Selection for Unstructured Multi-View Stereo European Conference on Computer Vision (ECCV)
[ Paper | Supplementary | Bibtex | Video ]
-
Indoor-Outdoor 3D Reconstruction Alignment European Conference on Computer Vision (ECCV)
[ Paper | Supplementary | Bibtex | Video ]
-
Structure-from-Motion Revisited Conference on Computer Vision and Pattern Recognition (CVPR)
[ Website | Paper | Supplementary | Bibtex | Video ]
-
From Dusk till Dawn: Modeling in the Dark Conference on Computer Vision and Pattern Recognition (CVPR)
[ Paper | Supplementary | Bibtex | Video ]
2015
-
Efficient Two-View Geometry Classification German Conference on Pattern Recognition (GCPR) Best Paper Honorable Mention
-
PAIGE: PAirwise Image Geometry Encoding for Improved Efficiency in Structure-from-Motion Conference on Computer Vision and Pattern Recognition (CVPR)
-
From Single Image Query to Detailed 3D Reconstruction Conference on Computer Vision and Pattern Recognition (CVPR)
-
Reconstructing the World* in Six Days *(As Captured by the Yahoo 100 Million Image Dataset) Conference on Computer Vision and Pattern Recognition (CVPR)
2014
-
scikit-image: Image processing in Python PeerJ
-
Structure-from-motion for MAV image sequence analysis with photogrammetric applications Photogrammetric Computer Vision Symposium (PCV)
-
Benefit of Using Multiple Baselines and Multiple Aspects for SAR Interferometry of Urban Areas IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing (JSTARS)
-
Adaptive Covariance Matrix Estimation for Multi-Baseline InSAR Data Stacks IEEE Transactions on Geoscience and Remote Sensing (TGARS)
2013
-
Potential of Airborne Single-Pass Millimeterwave InSAR Data for Individual Tree Recognition 33. Wissenschaftlich Technische Jahrestagung der DGPF
Tutorials and Workshops
-
Image Matching: Local Features & Beyond Conference on Computer Vision and Pattern Recognition (CVPR) 2019
[ Website ]
-
Long-Term Visual Localization Conference on Computer Vision and Pattern Recognition (CVPR) 2019
[ Website ]
-
Computer Vision Applications for Mixed Reality Headsets Conference on Computer Vision and Pattern Recognition (CVPR) 2019
[ Website ]
-
HoloLens as a Tool for Computer Vision Research European Conference on Computer Vision (ECCV) 2018
[ Website ]
-
COLMAP Structure-from-Motion and Multi-View Stereo Software
[ Website ]
-
Large-scale 3D Modeling Conference on Computer Vision and Pattern Recognition (CVPR) 2017
[ Website ]
-
Large-scale 3D Modeling from Crowdsourced Data International Conference on 3D Vision (3DV) 2016
[ Website ]