ResearchGate
LinkedInAbout
Welcome! I am a Principal Scientist at the Microsoft Mixed Reality & AI Lab in Zürich. Prior to joining Microsoft, I obtained my PhD in Computer Science as part of the Computer Vision and Geometry Group at ETH Zürich, where I was advised by Marc Pollefeys and Jan-Michael Frahm. Before, I received my BSc from TU Munich and my MSc from UNC Chapel Hill.
Research
My main research interests lie in image-based mapping and localization. More broadly, I am interested in computer vision, geometry, structure-from-motion, (multi-view) stereo, localization, optimization, machine learning, and image processing. You can find my publications on Google Scholar.
Open Source
As part of my research, I developed the open-source software COLMAP - an end-to-end and general-purpose image-based 3D reconstruction software (with state-of-the-art results on benchmarks: 1, 2). COLMAP is used quite widely in academia and industry for 3D modeling and camera localization (e.g., for training machine/deep learning models) and as a baseline algorithm for comparison. Over the years, I also contributed to a number of other scientific open source projects, including scikit-image, scikit-learn, NumPy, SciPy, etc. Lately, I don't have as much time as I would like to spend on open source software anymore, but you can find most of my activities on GitHub.
Honors & Awards
- PAMI Mark Everingham Prize (2020) - For the COLMAP SFM and MVS software library. The Everingham Prize is awared for a selfless contribution of significant benefit to other members of the computer vision community.
- ETH Medal (2019) - Awarded yearly for outstanding doctoral theses at ETH Zurich.
- Best Paper Honorable Mention (DAGM) (2015) - Awarded for the paper "Efficient Two-View Geometry Classification".
Publications
You can find my publications on Google Scholar and ResearchGate.
2022
-
Privacy Preserving Partial Localization Conference on Computer Vision and Pattern Recognition (CVPR)
[ Paper | Bibtex | Presentation ]
-
Panoptic Multi-TSDFs: a Flexible Representation for Online Multi-resolution Volumetric Mapping and Long-term Dynamic Scene Consistency International Conference on Robotics and Automation (ICRA)
2021
-
Reconstructing and grounding narrated instructional videos in 3D arXiv
[ Paper ]
-
Cross-Descriptor Visual Localization and Mapping International Conference on Computer Vision (ICCV)
-
Privacy Preserving Localization and Mapping from Uncalibrated Cameras Conference on Computer Vision and Pattern Recognition (CVPR)
-
Privacy-Preserving Image Features via Adversarial Affine Subspace Embeddings Conference on Computer Vision and Pattern Recognition (CVPR)
[ Paper | Supplementary | Bibtex | Project ]
-
NeuralFusion: Online Depth Fusion in Latent Space Conference on Computer Vision and Pattern Recognition (CVPR)
2020
-
Multi-View Optimization of Local Feature Geometry European Conference on Computer Vision (ECCV)
-
Privacy Preserving Structure-from-Motion European Conference on Computer Vision (ECCV)
-
RoutedFusion: Learning Real-time Depth Map Fusion Conference on Computer Vision and Pattern Recognition (CVPR)
-
HoloLens 2 Research Mode as a Tool for Computer Vision Research arXiv
2019
-
Privacy Preserving Image Queries for Camera Localization International Conference on Computer Vision (ICCV)
-
Privacy Preserving Image-Based Localization Conference on Computer Vision and Pattern Recognition (CVPR)
-
SciPy 1.0 - Fundamental Algorithms for Scientific Computing in Python Nature Methods
2018
-
Robust Methods for Accurate and Efficient 3D Modeling from Unstructured Imagery PhD Thesis
-
Learning to Fuse Proposals from Multiple Scanline Optimizations in Semi-Global Matching European Conference on Computer Vision (ECCV)
[ Paper | Supplementary | Bibtex ]
-
Learning Priors for Semantic 3D Reconstruction European Conference on Computer Vision (ECCV)
[ Paper | Supplementary | Bibtex ]
-
VSO: Visual Semantic Odometry European Conference on Computer Vision (ECCV)
[ Paper | Supplementary | Bibtex ]
-
Semantic Visual Localization Conference on Computer Vision and Pattern Recognition (CVPR)
[ Paper | Supplementary | Bibtex ]
-
Augmenting Crowd-Sourced 3D Reconstructions using Semantic Detections Conference on Computer Vision and Pattern Recognition (CVPR)
[ Paper | Supplementary | Bibtex ]
2017
-
Comparative Evaluation of Hand-Crafted and Learned Local Features Conference on Computer Vision and Pattern Recognition (CVPR)
[ Benchmark | Paper | Supplementary | Bibtex ]
-
A Multi-View Stereo Benchmark with High-Resolution Images and Multi-Camera Videos Conference on Computer Vision and Pattern Recognition (CVPR)
[ Benchmark | Paper | Supplementary | Bibtex ]
-
Mapping on the Fly: Real-Time 3D Dense Reconstruction, Digital Surface Map and Incremental Orthomosaic Generation for Unmanned Aerial Vehicles International Conference on Field and Service Robotics (FSR)
[ Code | Paper | Supplementary | Bibtex ]
2016
-
A Vote-and-Verify Strategy for Fast Spatial Verification in Image Retrieval Asian Conference on Computer Vision (ACCV)
[ Code | Paper | Supplementary | Bibtex ]
-
Pixelwise View Selection for Unstructured Multi-View Stereo European Conference on Computer Vision (ECCV)
[ Paper | Supplementary | Bibtex | Video ]
-
Indoor-Outdoor 3D Reconstruction Alignment European Conference on Computer Vision (ECCV)
[ Paper | Supplementary | Bibtex | Video ]
-
Structure-from-Motion Revisited Conference on Computer Vision and Pattern Recognition (CVPR)
[ Website | Paper | Supplementary | Bibtex | Video ]
-
From Dusk till Dawn: Modeling in the Dark Conference on Computer Vision and Pattern Recognition (CVPR)
[ Paper | Supplementary | Bibtex | Video ]
2015
-
Efficient Two-View Geometry Classification German Conference on Pattern Recognition (GCPR) Best Paper Honorable Mention
-
PAIGE: PAirwise Image Geometry Encoding for Improved Efficiency in Structure-from-Motion Conference on Computer Vision and Pattern Recognition (CVPR)
-
From Single Image Query to Detailed 3D Reconstruction Conference on Computer Vision and Pattern Recognition (CVPR)
-
Reconstructing the World* in Six Days *(As Captured by the Yahoo 100 Million Image Dataset) Conference on Computer Vision and Pattern Recognition (CVPR)
2014
-
scikit-image: Image processing in Python PeerJ
-
Structure-from-motion for MAV image sequence analysis with photogrammetric applications Photogrammetric Computer Vision Symposium (PCV)
-
Benefit of Using Multiple Baselines and Multiple Aspects for SAR Interferometry of Urban Areas IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing (JSTARS)
-
Adaptive Covariance Matrix Estimation for Multi-Baseline InSAR Data Stacks IEEE Transactions on Geoscience and Remote Sensing (TGARS)
2013
-
Potential of Airborne Single-Pass Millimeterwave InSAR Data for Individual Tree Recognition 33. Wissenschaftlich Technische Jahrestagung der DGPF
Tutorials and Workshops
-
Image Matching: Local Features & Beyond Conference on Computer Vision and Pattern Recognition (CVPR) 2019 Conference on Computer Vision and Pattern Recognition (CVPR) 2020
[ Website ]
-
Long-Term Visual Localization Conference on Computer Vision and Pattern Recognition (CVPR) 2019 European Conference on Computer Vision (ECCV) 2020
[ Website (2019) | Website (2020) ]
-
Microsoft HoloLens 2 and Azure Kinect DK as Tools for Computer Vision Research European Conference on Computer Vision (ECCV) 2020
[ Website ]
-
Computer Vision Applications for Mixed Reality Headsets Conference on Computer Vision and Pattern Recognition (CVPR) 2019
[ Website ]
-
HoloLens as a Tool for Computer Vision Research European Conference on Computer Vision (ECCV) 2018
[ Website ]
-
COLMAP Structure-from-Motion and Multi-View Stereo Software
[ Website ]
-
Large-scale 3D Modeling Conference on Computer Vision and Pattern Recognition (CVPR) 2017
[ Website ]
-
Large-scale 3D Modeling from Crowdsourced Data International Conference on 3D Vision (3DV) 2016
[ Website ]