Computer Vision and Geometry Group

Handbook on Leveraging Lines for Two-View Relative Pose Estimation

Conference: 3DV 2024

Authors: Petr Hruby , Shaohui Liu , Rémi Pautrat , Marc Pollefeys , Daniel Barath

Paper

Q-REG: End-to-End Trainable Point Cloud Registration with Surface Curvature

Conference: 3DV 2024

Authors: Shengze Jin , Daniel Barath , Marc Pollefeys , Iro Armeni

Paper

NICER-SLAM: Neural Implicit Scene Encoding for RGB SLAM

Conference: 3DV 2024 (Oral, Best Paper Honorable Mention)

Authors: Zihan Zhu* , Songyou Peng* , Viktor Larsson , Zhaopeng Cui , Martin R. Oswald , Andreas Geiger , Marc Pollefeys

Paper

LabelMaker: Automatic Semantic Label Generation from RGB-D

Conference: 3DV 2024

Authors: Silvan Weder , Hermann Blum , Francis Engelmann , Marc Pollefeys

Project

Paper

Code

OpenMask3D: Open-Vocabulary 3D Instance Segmentation

Conference: NeurIPS 2023

Authors: Ayca Takmaz , Elisabetta Fedele , Robert Sumner , Marc Pollefeys , Federico Tombari , Francis Engelmann

Project

Paper

Code

3D Segmentation of Humans in Point Clouds with Synthetic Data

Conference: ICCV 2023

Authors: Ayça Takmaz , Jonas Schult , Irem Kaftan , Mertcan Akçay , Bastian Leibe , Robert Sumner , Francis Engelmann , Siyu Tang

Project

Paper

Code

Connecting the Dots: Floorplan Reconstruction Using Two-Level Queries

Conference: CVPR 2023

Authors: Yuanwen Yue , Theodora Kontogianni , Konrad Schindler , Francis Engelmann

Project

Paper

Code

Mask3D: Mask Transformer for 3D Semantic Instance Segmentation

Conference: ICRA 2023

Authors: Jonas Schult , Francis Engelmann , Alexander Hermans , Or Litany , Siyu Tang , Bastian Leibe

Project

Paper

Code

Privacy Preserving Localization via Coordinate Permutations

Conference: ICCV 2023

Authors: Linfei Pan , Johannes L. Schönberger , Viktor Larsson , Marc Pollefeys

Project

Paper

OpenScene: 3D Scene Understanding with Open Vocabularies

Conference: CVPR 2023

Authors: Songyou Peng , Kyle Genova , Chiyu ''Max'' Jiang , Andrea Tagliasacchi , Marc Pollefeys , Thomas Funkhouser

Project

Paper

Code

GlueStick: Robust Image Matching by Sticking Points and Lines Together

Conference: ICCV 2023

Authors: Rémi Pautrat , Iago Suárez , Yifan Yu , Marc Pollefeys , Viktor Larsson

Project

Paper

Code

Vanishing Point Estimation in Uncalibrated Images with Prior Gravity Direction

Conference: ICCV 2023

Authors: Rémi Pautrat , Shaohui Liu , Petr Hruby , Marc Pollefeys , Daniel Barath

Project

Paper

Code

3D Line Mapping Revisited

Conference: CVPR 2023 (Highlight)

Authors: Shaohui Liu , Yifan Yu , Rémi Pautrat , Marc Pollefeys , Viktor Larsson

Project

Paper

Code

DeepLSD: Line Segment Detection and Refinement with Deep Image Gradients

Conference: CVPR 2023

Authors: Rémi Pautrat , Dániel Béla Baráth , Viktor Larsson , Martin R. Oswald , Marc Pollefeys

Project

Paper

Code

Four-view Geometry with Unknown Radial Distortion

Conference: CVPR 2023

Authors: Petr Hruby , Viktor Korotynskiy , Timothy Duff , Marc Pollefeys , Tomas Pajdla , Viktor Larsson

Paper

Code

VolRecon: Volume Rendering of Signed Ray Distance Functions for Generalizable Multi-View Reconstruction

Conference: CVPR 2023

Authors: Yufan Ren , Fangjinhua Wang , Tong Zhang , Marc Pollefeys , Sabine Süsstrunk

Project

Paper

Code

SGAligner: 3D Scene Alignment with Scene Graphs

Conference: ICCV 2023

Authors: S. D. Sarkar , O. Miksik , M. Pollefeys , D. Barath , I. Armeni

Project

Paper

Code

Guiding Local Feature Matching with Surface Curvature

Conference: ICCV 2023

Authors: S. D. Sarkar , O. Miksik , M. Pollefeys , D. Barath , I. Armeni

Paper

Code

Adaptive Reordering Sampler with Neurally Guided MAGSAC

Conference: ICCV 2023

Authors: T. Wei , J. Matas , D. Barath

Paper

Code

Fast Globally Optimal Surface Normal Estimation from an Affine Correspondence

Conference: ICCV 2023

Authors:

Project

Paper

Generalized Differentiable RANSAC

Conference: ICCV 2023

Authors: L. Hajder , L. Lóczi , D. Barath

Paper

Code

P1AC: Revisiting absolute pose from a single affine correspondence

Conference: ICCV 2023 (oral)

Authors: J. Ventura , Z. Kukelova , T. Sattler , D. Barath

Paper

Code

Box2Mask: Weakly Supervised 3D Semantic Instance Segmentation Using Bounding Boxes

Conference: ECCV 2022 (Oral)

Authors: Julian Chibane , Francis Engelmann , Tuan Anh Tran , Gerard Pons-Moll

Project

Paper

Code

Camera Pose Estimation using Implicit Distortion Models

Conference: CVPR 2022

Authors: Linfei Pan , Marc Pollefeys , Viktor Larsson

Project

Paper

Code

NICE-SLAM: Neural Implicit Scalable Encoding for SLAM

Conference: CVPR 2022

Authors: Zihan Zhu* , Songyou Peng* , Viktor Larsson , Weiwei Xu , Hujun Bao , Zhaopeng Cui , Martin R. Oswald , Marc Pollefeys

Project

Paper

Code

Learning to Solve Hard Minimal Problems

Conference: CVPR 2022 (Best Paper Award)

Authors: Petr Hruby , Timothy Duff , Anton Leykin , Tomas Pajdla

Paper

Code

IterMVS: Iterative Probability Estimation for Efficient Multi-View Stereo

Conference: CVPR 2022

Authors: Fangjinhua Wang , Silvano Galliani , Christoph Vogel , Marc Pollefeys

Paper

Code

Mix3D: Out-of-Context Data Augmentation for 3D Scenes

Conference: 3DV 2021

Authors: Alexey Nekrasov , Jonas Schult , Or Litany , Bastian Leibe , Francis Engelmann

Paper

Code

Shape As Points: A Differentiable Poisson Solver

Conference: NeurIPS 2021 (Oral, top 0.6%)

Authors: Songyou Peng , Chiyu 'Max' Jiang , Yiyi Liao , Michael Niemeyer , Marc Pollefeys , Andreas Geiger

Project

Paper

Code

SOLD²: Self-supervised Occlusion-aware Line Description and Detection

Conference: CVPR 2021

Authors: Rémi Pautrat , Juan-Ting Lin , Viktor Larsson , Martin R. Oswald , Marc Pollefeys

Project

Paper

Code

PatchmatchNet: Learned Multi-View Patchmatch Stereo

Conference: 2021 (Oral)

Authors: Fangjinhua Wang , Silvano Galliani , Christoph Vogel , Pablo Speciale , Marc Pollefeys

Paper

Code

Compression and Completion of Animated Point Clouds using Topological Properties of the Manifold

Conference: 3DV 2020

Authors: Linfei Pan , Ľubor Ladický , Marc Pollefeys

Project

Paper

Convolutional Occupancy Networks

Conference: ECCV 2020 (Spotlight, top 5%)

Authors: Songyou Peng , Michael Niemeyer , Lars Mescheder , Marc Pollefeys , Andreas Geiger

Project

Paper

Code

Online Invariance Selection for Local Feature Descriptors

Conference: ECCV 2020

Authors: Rémi Pautrat , Viktor Larsson , Martin R. Oswald , Marc Pollefeys

Project

Paper

Code

Crowd-Guided Ensembles: How Can We Choreograph Crowd Workers for Video Segmentation?

Conference: ACM CHI 2018

Authors: Alexandre Kaspar , Genevieve Patterson , Changil Kim , Yagiz Aksoy , Wojciech Matusik , Mohamed Elgharib

Paper

Designing Effective Inter-Pixel Information Flow for Natural Image Matting

Conference: CVPR 2017

Authors: Yagiz Aksoy , Aydin Tunc Ozan , Marc Pollefeys

Project

Paper

Code

Semantic Multi-view Stereo: Jointly Estimating Objects and Voxels

Conference: CVPR 2017

Authors: Ali Osman Ulusoy , Michael Black , Andreas Geiger

Project

Paper

Code

Bounding Boxes, Segmentations and Object Coordinates: How Important is Recognition for 3D Scene Flow Estimation in Autonomous Driving Scenarios?

Conference: ICCV 2017

Authors: Aseem Behl , Omid Hosseini Jafari , Siva Karthik Mustikovela , Hassan Abu Alhaija , Carsten Rother , Andreas Geiger

Project

Paper

Code

An Exploration of 2D and 3D Deep Learning Techniques for Cardiac MR Image Segmentation

Conference: International Workshop on Statistical Atlases and Computational Modelling of the Heart 2017

Authors: Christian F. Baumgartner , Lisa M. Koch , Marc Pollefeys , Ender Konukoglu

Project

Paper

Code

Toroidal Constraints for Two Point Localization Under High Outlier Ratios

Conference: CVPR 2017

Authors: Federico Camposeco , Torsten Sattler , Andrea Cohen , Andreas Geiger , Marc Pollefeys

Project

Paper

Code

OctNet: Learning Deep 3D Representations at High Resolutions

Conference: CVPR 2017

Authors: Gernot Riegler , Ali Osman Ulusoy , Andreas Geiger

Project

Paper

Code

OctNetFusion: Learning Depth Fusion from Data

Conference: 3DV 2017

Authors: Gernot Riegler , Ali Osman Ulusoy , Horst Bischof , Andreas Geiger

Project

Paper

Code

Augmented Reality Meets Deep Learning for Car Instance Segmentation in Urban Scenes

Conference: BMVC 2017

Authors: Hassan Abu Alhaija , Siva Karthik Mustikovela , Lars Mescheder , Andreas Geiger , Carsten Rother

Project

Paper

Code

Mapping on the Fly: Real-time 3D Dense Reconstruction, Digital Surface Map and Incremental Orthomosaic Generation for Unmanned Aerial Vehicles

Conference: International Conference Field and Service Robotics 2017

Authors: Timo Hinzmann , Johannes Lutz Schonberger , Marc Pollefeys , Roland Siegwart

Project

Paper

Code

Slow Flow: Exploiting High-Speed Cameras for Accurate and Diverse Optical Flow Reference Data

Conference: CVPR 2017

Authors: Joel Janai , Fatma Güney , Jonas Wulff , Michael Black , Andreas Geiger

Project

Paper

Code

Sparsity Invariant CNNs

Conference: 3DV 2017

Authors: Jonas Uhrig , Nick Schneider , Lukas Schneider , Uwe Franke , Thomas Brox , Andreas Geiger

Project

Paper

Code

Adversarial Variational Bayes: Unifying Variational Autoencoders and Generative Adversarial Networks

Conference: ICML 2017

Authors: Lars Mescheder , Sebastian Nowozin , Andreas Geiger

Project

Paper

Code

The Numerics of GANs

Conference: NIPS 2017

Authors: Lars Mescheder , Sebastian Nowozin , Andreas Geiger

Project

Paper

Code

Semantically Informed Multiview Surface Refinement

Conference: ICCV 2017

Authors: M. Blaha , M. Rothermel , M. R. Oswald , T. Sattler , A. Richard , J. D. Wegner , M. Pollefeys , K. Schindler

Project

Paper

Code

AR Museum: A Mobile Augmented Reality Application for Interactive Painting Recoloring

Conference: International Conference on Game and Entertainment Technologies 2017

Authors: Mattia Ryffel , Fabio Zund , Yagiz Aksoy , Alessia Marra , Maurizio Nitti , Tunc Ozan Aydin , Bob Sumner

Project

Paper

Code

Quad-Networks: Unsupervised Learning to Rank for Interest Point Detection

Conference: CVPR 2017

Authors: N. Savinov , A. Seki , L. Ladicky , T. Sattler , Marc Pollefeys

Project

Paper

Code

Consensus Maximization with Linear Matrix Inequality Constraints

Conference: CVPR 2017

Authors: Pablo Speciale , Danda P. Paudel , Martin R. Oswald , Till Kroeger , Luc V. Gool , Marc Pollefeys

Project

Paper

Code

Direct Visual Odometry for a Fisheye-Stereo Camera

Conference: IROS 2017

Authors: Peidong Liu , Lionel Heng , Torsten Sattler , Andreas Geiger , Marc Pollefeys

Project

Paper

Code

Comparative Evaluation of Hand-Crafted and Learned Local Features

Conference: CVPR 2017

Authors: Johannes Lutz Schonberger , Hans Hardmeier , Torsten Sattler , Marc Pollefeys

Project

Paper

Code

Publication

2024

Handbook on Leveraging Lines for Two-View Relative Pose Estimation

Q-REG: End-to-End Trainable Point Cloud Registration with Surface Curvature

NICER-SLAM: Neural Implicit Scene Encoding for RGB SLAM

LabelMaker: Automatic Semantic Label Generation from RGB-D

2023

OpenMask3D: Open-Vocabulary 3D Instance Segmentation

3D Segmentation of Humans in Point Clouds with Synthetic Data

Connecting the Dots: Floorplan Reconstruction Using Two-Level Queries

Mask3D: Mask Transformer for 3D Semantic Instance Segmentation

Privacy Preserving Localization via Coordinate Permutations

OpenScene: 3D Scene Understanding with Open Vocabularies

GlueStick: Robust Image Matching by Sticking Points and Lines Together

Vanishing Point Estimation in Uncalibrated Images with Prior Gravity Direction

3D Line Mapping Revisited

DeepLSD: Line Segment Detection and Refinement with Deep Image Gradients

Four-view Geometry with Unknown Radial Distortion

VolRecon: Volume Rendering of Signed Ray Distance Functions for Generalizable Multi-View Reconstruction

SGAligner: 3D Scene Alignment with Scene Graphs

Guiding Local Feature Matching with Surface Curvature

Adaptive Reordering Sampler with Neurally Guided MAGSAC

Fast Globally Optimal Surface Normal Estimation from an Affine Correspondence

Generalized Differentiable RANSAC

P1AC: Revisiting absolute pose from a single affine correspondence

2022

Box2Mask: Weakly Supervised 3D Semantic Instance Segmentation Using Bounding Boxes

Camera Pose Estimation using Implicit Distortion Models

NICE-SLAM: Neural Implicit Scalable Encoding for SLAM

Learning to Solve Hard Minimal Problems

IterMVS: Iterative Probability Estimation for Efficient Multi-View Stereo

2021

Mix3D: Out-of-Context Data Augmentation for 3D Scenes

Shape As Points: A Differentiable Poisson Solver

SOLD²: Self-supervised Occlusion-aware Line Description and Detection

PatchmatchNet: Learned Multi-View Patchmatch Stereo

2020

Compression and Completion of Animated Point Clouds using Topological Properties of the Manifold

Convolutional Occupancy Networks

Online Invariance Selection for Local Feature Descriptors

2018

Crowd-Guided Ensembles: How Can We Choreograph Crowd Workers for Video Segmentation?

2017

Designing Effective Inter-Pixel Information Flow for Natural Image Matting

Semantic Multi-view Stereo: Jointly Estimating Objects and Voxels

Bounding Boxes, Segmentations and Object Coordinates: How Important is Recognition for 3D Scene Flow Estimation in Autonomous Driving Scenarios?

An Exploration of 2D and 3D Deep Learning Techniques for Cardiac MR Image Segmentation

Toroidal Constraints for Two Point Localization Under High Outlier Ratios

OctNet: Learning Deep 3D Representations at High Resolutions

OctNetFusion: Learning Depth Fusion from Data

Augmented Reality Meets Deep Learning for Car Instance Segmentation in Urban Scenes

Mapping on the Fly: Real-time 3D Dense Reconstruction, Digital Surface Map and Incremental Orthomosaic Generation for Unmanned Aerial Vehicles

Slow Flow: Exploiting High-Speed Cameras for Accurate and Diverse Optical Flow Reference Data

Sparsity Invariant CNNs

Adversarial Variational Bayes: Unifying Variational Autoencoders and Generative Adversarial Networks

The Numerics of GANs

Semantically Informed Multiview Surface Refinement

AR Museum: A Mobile Augmented Reality Application for Interactive Painting Recoloring

Quad-Networks: Unsupervised Learning to Rank for Interest Point Detection

Consensus Maximization with Linear Matrix Inequality Constraints

Direct Visual Odometry for a Fisheye-Stereo Camera

Comparative Evaluation of Hand-Crafted and Learned Local Features