Short Bio
Johannes is a Principal Scientist at the Microsoft Mixed Reality & AI Lab in Zürich. Prior to joining Microsoft, he obtained his PhD in Computer Science as part of the Computer Vision and Geometry Group at ETH Zürich, where he was advised by Marc Pollefeys and Jan-Michael Frahm. Before, he received his MSc from UNC Chapel Hill and his BSc from TU Munich.
His main research interests lie in image-based mapping, localization, and scene understanding. More broadly, he is interested in topics at the intersection of computer vision and geometry. A complete and up-to-date list of publications can be found on Google Scholar or further below.
As part of his research, Johannes developed the open-source software COLMAP - an end-to-end, general-purpose image-based 3D reconstruction software that is widely used in academia and industry. Over the years, he also contributed to a number of other scientific open source projects, including scikit-image, scikit-learn, NumPy, SciPy, etc. Most open-source activities can be found on his GitHub profile.
For his work on the COLMAP SFM and MVS software library, he received the PAMI Mark Everingham Prize in 2020 as well as an ETH Medal in 2019, which is awarded yearly for outstanding doctoral theses at ETH Zurich. Furthermore, he received a best paper honorable mention for the paper "Efficient Two-View Geometry Classification" at DAGM 2015.
Publications (Google Scholar)
2023
A Local Spatio-Temporal Expert for Online 3D Semantic Reconstruction arXiv [ Paper | Bibtex ] | |
Privacy Preserving Localization via Coordinate Permutations International Conference on Computer Vision (ICCV) [ Paper | Supplementary | Bibtex ] |
2022
LaMAR: Benchmarking Localization and Mapping for Augmented Reality European Conference on Computer Vision (ECCV) [ Paper | Bibtex | Website ] | |
Panoptic Multi-TSDFs: a Flexible Representation for Online Multi-resolution Volumetric Mapping and Long-term Dynamic Scene Consistency International Conference on Robotics and Automation (ICRA) [ Paper | Bibtex | Code ] |
2021
Reconstructing and grounding narrated instructional videos in 3D arXiv [ Paper | Bibtex ] | |
Cross-Descriptor Visual Localization and Mapping International Conference on Computer Vision (ICCV) [ Paper | Bibtex ] | |
Privacy Preserving Localization and Mapping from Uncalibrated Cameras Conference on Computer Vision and Pattern Recognition (CVPR) [ Paper | Bibtex ] | |
Privacy-Preserving Image Features via Adversarial Affine Subspace Embeddings Conference on Computer Vision and Pattern Recognition (CVPR) [ Paper | Supplementary | Bibtex | Project ] | |
NeuralFusion: Online Depth Fusion in Latent Space Conference on Computer Vision and Pattern Recognition (CVPR) [ Paper | Bibtex ] |
2020
Multi-View Optimization of Local Feature Geometry European Conference on Computer Vision (ECCV) [ Paper | Bibtex | Project | Code ] | |
Privacy Preserving Structure-from-Motion European Conference on Computer Vision (ECCV) [ Paper | Bibtex | Code ] | |
RoutedFusion: Learning Real-time Depth Map Fusion Conference on Computer Vision and Pattern Recognition (CVPR) [ Paper | Bibtex | Code ] | |
HoloLens 2 Research Mode as a Tool for Computer Vision Research arXiv [ Paper | Bibtex | Code ] |
2019
Privacy Preserving Image Queries for Camera Localization International Conference on Computer Vision (ICCV) [ Paper | Bibtex ] | |
Privacy Preserving Image-Based Localization Conference on Computer Vision and Pattern Recognition (CVPR) [ Paper | Bibtex ] | |
SciPy 1.0 - Fundamental Algorithms for Scientific Computing in Python Nature Methods [ Paper | Bibtex | Code ] |
2018
Robust Methods for Accurate and Efficient 3D Modeling from Unstructured Imagery PhD Thesis [ Thesis | Bibtex ] | |
Learning to Fuse Proposals from Multiple Scanline Optimizations in Semi-Global Matching European Conference on Computer Vision (ECCV) [ Paper | Supplementary | Bibtex ] | |
Learning Priors for Semantic 3D Reconstruction European Conference on Computer Vision (ECCV) [ Paper | Supplementary | Bibtex ] | |
VSO: Visual Semantic Odometry European Conference on Computer Vision (ECCV) [ Paper | Supplementary | Bibtex ] | |
Semantic Visual Localization Conference on Computer Vision and Pattern Recognition (CVPR) [ Paper | Supplementary | Bibtex ] | |
Augmenting Crowd-Sourced 3D Reconstructions using Semantic Detections Conference on Computer Vision and Pattern Recognition (CVPR) [ Paper | Supplementary | Bibtex ] |
2017
Comparative Evaluation of Hand-Crafted and Learned Local Features Conference on Computer Vision and Pattern Recognition (CVPR) [ Benchmark | Paper | Supplementary | Bibtex ] | |
A Multi-View Stereo Benchmark with High-Resolution Images and Multi-Camera Videos Conference on Computer Vision and Pattern Recognition (CVPR) [ Paper | Supplementary | Bibtex ] | |
Mapping on the Fly: Real-Time 3D Dense Reconstruction, Digital Surface Map and Incremental Orthomosaic Generation for Unmanned Aerial Vehicles International Conference on Field and Service Robotics (FSR) [ Code | Paper | Supplementary | Bibtex ] |
2016
A Vote-and-Verify Strategy for Fast Spatial Verification in Image Retrieval Asian Conference on Computer Vision (ACCV) [ Code | Paper | Supplementary | Bibtex ] | |
Pixelwise View Selection for Unstructured Multi-View Stereo European Conference on Computer Vision (ECCV) [ Paper | Supplementary | Bibtex | Video ] | |
Indoor-Outdoor 3D Reconstruction Alignment European Conference on Computer Vision (ECCV) [ Paper | Supplementary | Bibtex | Video ] | |
Structure-from-Motion Revisited Conference on Computer Vision and Pattern Recognition (CVPR) [ Website | Paper | Supplementary | Bibtex | Video ] | |
From Dusk till Dawn: Modeling in the Dark Conference on Computer Vision and Pattern Recognition (CVPR) [ Paper | Supplementary | Bibtex | Video ] |
2015
Efficient Two-View Geometry Classification German Conference on Pattern Recognition (GCPR) [ Paper | Bibtex ] | |
PAIGE: PAirwise Image Geometry Encoding for Improved Efficiency in Structure-from-Motion Conference on Computer Vision and Pattern Recognition (CVPR) [ Paper | Bibtex ] | |
From Single Image Query to Detailed 3D Reconstruction Conference on Computer Vision and Pattern Recognition (CVPR) [ Paper | Bibtex | Video ] | |
Reconstructing the World* in Six Days *(As Captured by the Yahoo 100 Million Image Dataset) Conference on Computer Vision and Pattern Recognition (CVPR) [ Website | Paper | Bibtex ] |
2014
scikit-image: Image processing in Python PeerJ [ Website | Paper | Bibtex ] | |
Structure-from-motion for MAV image sequence analysis with photogrammetric applications Photogrammetric Computer Vision Symposium (PCV) [ Code | Paper | Bibtex ] | |
Benefit of Using Multiple Baselines and Multiple Aspects for SAR Interferometry of Urban Areas IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing (JSTARS) [ Paper | Bibtex ] | |
Adaptive Covariance Matrix Estimation for Multi-Baseline InSAR Data Stacks IEEE Transactions on Geoscience and Remote Sensing (TGARS) [ Paper | Bibtex ] |
2013
Potential of Airborne Single-Pass Millimeterwave InSAR Data for Individual Tree Recognition 33. Wissenschaftlich Technische Jahrestagung der DGPF [ Paper | Bibtex ] |
Projects, Tutorials, Workshops
-
Localization and Mapping for Augmented Reality European Conference on Computer Vision (ICCV) 2022
[ Website ]
-
Image Matching: Local Features & Beyond Conference on Computer Vision and Pattern Recognition (CVPR) 2019 Conference on Computer Vision and Pattern Recognition (CVPR) 2020
[ Website ]
-
Long-Term Visual Localization Conference on Computer Vision and Pattern Recognition (CVPR) 2019 European Conference on Computer Vision (ECCV) 2020
[ Website (2019) | Website (2020) ]
-
Microsoft HoloLens 2 and Azure Kinect DK as Tools for Computer Vision Research European Conference on Computer Vision (ECCV) 2020
[ Website ]
-
Computer Vision Applications for Mixed Reality Headsets Conference on Computer Vision and Pattern Recognition (CVPR) 2019
[ Website ]
-
HoloLens as a Tool for Computer Vision Research European Conference on Computer Vision (ECCV) 2018
[ Website ]
-
COLMAP Structure-from-Motion and Multi-View Stereo Software
[ Website ]
-
Large-scale 3D Modeling Conference on Computer Vision and Pattern Recognition (CVPR) 2017
[ Website ]
-
Large-scale 3D Modeling from Crowdsourced Data International Conference on 3D Vision (3DV) 2016
[ Website ]