English
Related papers

Related papers: VolumeFusion: Deep Depth Fusion for 3D Scene Recon…

200 papers

Existing deep methods produce highly accurate 3D reconstructions in stereo and multiview stereo settings, i.e., when cameras are both internally and externally calibrated. Nevertheless, the challenge of simultaneous recovery of camera poses…

Computer Vision and Pattern Recognition · Computer Science 2021-10-26 Dror Moran , Hodaya Koslowsky , Yoni Kasten , Haggai Maron , Meirav Galun , Ronen Basri

In this work, we enhance a professional end-to-end volumetric video production pipeline to achieve high-fidelity human body reconstruction using only passive cameras. While current volumetric video approaches estimate depth maps using…

Computer Vision and Pattern Recognition · Computer Science 2022-03-01 Decai Chen , Markus Worchel , Ingo Feldmann , Oliver Schreer , Peter Eisert

Volumetric neural rendering methods like NeRF generate high-quality view synthesis results but are optimized per-scene leading to prohibitive reconstruction time. On the other hand, deep multi-view stereo methods can quickly reconstruct…

Computer Vision and Pattern Recognition · Computer Science 2023-03-17 Qiangeng Xu , Zexiang Xu , Julien Philip , Sai Bi , Zhixin Shu , Kalyan Sunkavalli , Ulrich Neumann

Accurate recovery of 3D geometrical surfaces from calibrated 2D multi-view images is a fundamental yet active research area in computer vision. Despite the steady progress in multi-view stereo reconstruction, most existing methods are still…

Computer Vision and Pattern Recognition · Computer Science 2016-01-20 Zhaoxin Li , Kuanquan Wang , Wangmeng Zuo , Deyu Meng , Lei Zhang

Depth estimation plays a pivotal role in advancing human-robot interactions, especially in indoor environments where accurate 3D scene reconstruction is essential for tasks like navigation and object handling. Monocular depth estimation,…

Computer Vision and Pattern Recognition · Computer Science 2025-02-18 Siddiqui Muhammad Yasir , Hyunsik Ahn

Recently, neural implicit surfaces learning by volume rendering has become popular for multi-view reconstruction. However, one key challenge remains: existing approaches lack explicit multi-view geometry constraints, hence usually fail to…

Computer Vision and Pattern Recognition · Computer Science 2022-06-01 Qiancheng Fu , Qingshan Xu , Yew-Soon Ong , Wenbing Tao

The success of the Neural Radiance Fields (NeRF) in novel view synthesis has inspired researchers to propose neural implicit scene reconstruction. However, most existing neural implicit reconstruction methods optimize per-scene parameters…

Computer Vision and Pattern Recognition · Computer Science 2023-04-04 Yufan Ren , Fangjinhua Wang , Tong Zhang , Marc Pollefeys , Sabine Süsstrunk

Key part of robotics, augmented reality, and digital inspection is dense 3D reconstruction from depth observations. Traditional volumetric fusion techniques, including truncated signed distance functions (TSDF), enable efficient and…

Computer Vision and Pattern Recognition · Computer Science 2026-02-24 Soumya Mazumdar , Vineet Kumar Rakesh , Tapas Samanta

We propose a data-driven method for recovering miss-ing parts of 3D shapes. Our method is based on a new deep learning architecture consisting of two sub-networks: a global structure inference network and a local geometry refinement…

Computer Vision and Pattern Recognition · Computer Science 2017-09-26 Xiaoguang Han , Zhen Li , Haibin Huang , Evangelos Kalogerakis , Yizhou Yu

Many hand-held or mixed reality devices are used with a single sensor for 3D reconstruction, although they often comprise multiple sensors. Multi-sensor depth fusion is able to substantially improve the robustness and accuracy of 3D…

Computer Vision and Pattern Recognition · Computer Science 2022-09-22 Erik Sandström , Martin R. Oswald , Suryansh Kumar , Silvan Weder , Fisher Yu , Cristian Sminchisescu , Luc Van Gool

Efficient and accurate 3D reconstruction is crucial for various applications, including augmented and virtual reality, medical imaging, and cinematic special effects. While traditional Multi-View Stereo (MVS) systems have been fundamental…

Computer Vision and Pattern Recognition · Computer Science 2024-07-19 Umair Haroon , Ahmad AlMughrabi , Ricardo Marques , Petia Radeva

We introduce TransformerFusion, a transformer-based 3D scene reconstruction approach. From an input monocular RGB video, the video frames are processed by a transformer network that fuses the observations into a volumetric feature grid…

Computer Vision and Pattern Recognition · Computer Science 2021-07-07 Aljaž Božič , Pablo Palafox , Justus Thies , Angela Dai , Matthias Nießner

Deep Neural Networks (DNNs) have the potential to improve the quality of image-based 3D reconstructions. However, the use of DNNs in the context of 3D reconstruction from large and high-resolution image datasets is still an open challenge,…

Computer Vision and Pattern Recognition · Computer Science 2020-08-14 Andreas Kuhn , Christian Sormann , Mattia Rossi , Oliver Erdler , Friedrich Fraundorfer

We present a novel neural surface reconstruction method, called NeuS, for reconstructing objects and scenes with high fidelity from 2D image inputs. Existing neural surface reconstruction approaches, such as DVR and IDR, require foreground…

Computer Vision and Pattern Recognition · Computer Science 2023-02-02 Peng Wang , Lingjie Liu , Yuan Liu , Christian Theobalt , Taku Komura , Wenping Wang

We present a novel 3D mapping method leveraging the recent progress in neural implicit representation for 3D reconstruction. Most existing state-of-the-art neural implicit representation methods are limited to object-level reconstructions…

Computer Vision and Pattern Recognition · Computer Science 2023-08-08 Stefan Lionar , Lukas Schmid , Cesar Cadena , Roland Siegwart , Andrei Cramariuc

Stereo-LiDAR fusion is a promising task in that we can utilize two different types of 3D perceptions for practical usage -- dense 3D information (stereo cameras) and highly-accurate sparse point clouds (LiDAR). However, due to their…

Computer Vision and Pattern Recognition · Computer Science 2021-03-25 Jaesung Choe , Kyungdon Joo , Tooba Imtiaz , In So Kweon

3D point clouds are rich in geometric structure information, while 2D images contain important and continuous texture information. Combining 2D information to achieve better 3D semantic segmentation has become mainstream in 3D scene…

Computer Vision and Pattern Recognition · Computer Science 2022-12-14 Chaolong Yang , Yuyao Yan , Weiguang Zhao , Jianan Ye , Xi Yang , Amir Hussain , Kaizhu Huang

Scene and object reconstruction is an important problem in robotics, in particular in planning collision-free trajectories or in object manipulation. This paper compares two strategies for the reconstruction of nonvisible parts of the…

Robotics · Computer Science 2025-01-28 Rafał Staszak , Piotr Michałek , Jakub Chudziński , Marek Kopicki , Dominik Belter

Detailed 3D reconstruction is an important challenge with application to robotics, augmented and virtual reality, which has seen impressive progress throughout the past years. Advancements were driven by the availability of depth cameras…

Computer Vision and Pattern Recognition · Computer Science 2019-08-13 Andrea Nicastro , Ronald Clark , Stefan Leutenegger

Deep learning-based multi-view stereo has emerged as a powerful paradigm for reconstructing the complete geometrically-detailed objects from multi-views. Most of the existing approaches only estimate the pixel-wise depth value by minimizing…

Computer Vision and Pattern Recognition · Computer Science 2023-04-28 Yisu Zhang , Jianke Zhu , Lixiang Lin