English
Related papers

Related papers: MonoSDF: Exploring Monocular Geometric Cues for Ne…

200 papers

Monocular 3D face reconstruction is a wide-spread topic, and existing approaches tackle the problem either through fast neural network inference or offline iterative reconstruction of face geometry. In either case carefully-designed energy…

Computer Vision and Pattern Recognition · Computer Science 2023-10-31 Christopher Otto , Prashanth Chandran , Gaspard Zoss , Markus Gross , Paulo Gotardo , Derek Bradley

Modeling scene geometry using implicit neural representation has revealed its advantages in accuracy, flexibility, and low memory usage. Previous approaches have demonstrated impressive results using color or depth images but still have…

Robotics · Computer Science 2023-03-01 Dongyu Yan , Xiaoyang Lyu , Jieqi Shi , Yi Lin

3D Gaussian Splatting has achieved impressive performance in novel view synthesis with real-time rendering capabilities. However, reconstructing high-quality surfaces with fine details using 3D Gaussians remains a challenging task. In this…

Computer Vision and Pattern Recognition · Computer Science 2024-12-03 Jiepeng Wang , Yuan Liu , Peng Wang , Cheng Lin , Junhui Hou , Xin Li , Taku Komura , Wenping Wang

3D surface reconstruction from multi-view images is essential for scene understanding and interaction. However, complex indoor scenes pose challenges such as ambiguity due to limited observations. Recent implicit surface representations,…

Computer Vision and Pattern Recognition · Computer Science 2024-07-18 Xulong Wang , Siyan Dong , Youyi Zheng , Yanchao Yang

We propose Neural-DynamicReconstruction (NDR), a template-free method to recover high-fidelity geometry and motions of a dynamic scene from a monocular RGB-D camera. In NDR, we adopt the neural implicit function for surface representation…

Computer Vision and Pattern Recognition · Computer Science 2022-10-17 Hongrui Cai , Wanquan Feng , Xuetao Feng , Yan Wang , Juyong Zhang

Reconstructing hand-held objects from monocular RGB images is an appealing yet challenging task. In this task, contacts between hands and objects provide important cues for recovering the 3D geometry of the hand-held objects. Though recent…

Computer Vision and Pattern Recognition · Computer Science 2024-01-17 Junxing Hu , Hongwen Zhang , Zerui Chen , Mengcheng Li , Yunlong Wang , Yebin Liu , Zhenan Sun

Surface reconstruction from sparse views aims to reconstruct a 3D shape or scene from few RGB images. The latest methods are either generalization-based or overfitting-based. However, the generalization-based methods do not generalize well…

Computer Vision and Pattern Recognition · Computer Science 2025-08-04 Liang Han , Xu Zhang , Haichuan Song , Kanle Shi , Yu-Shen Liu , Zhizhong Han

Monocular depth estimation (MDE) aims to transform an RGB image of a scene into a pixelwise depth map from the same camera view. It is fundamentally ill-posed due to missing information: any single image can have been taken from many…

Computer Vision and Pattern Recognition · Computer Science 2022-05-13 Dylan Auty , Krystian Mikolajczyk

Joint camera pose and dense geometry estimation from a set of images or a monocular video remains a challenging problem due to its computational complexity and inherent visual ambiguities. Most dense incremental reconstruction systems…

Computer Vision and Pattern Recognition · Computer Science 2024-04-18 Kirill Mazur , Gwangbin Bae , Andrew J. Davison

We present a novel neural surface reconstruction method, called NeuS, for reconstructing objects and scenes with high fidelity from 2D image inputs. Existing neural surface reconstruction approaches, such as DVR and IDR, require foreground…

Computer Vision and Pattern Recognition · Computer Science 2023-02-02 Peng Wang , Lingjie Liu , Yuan Liu , Christian Theobalt , Taku Komura , Wenping Wang

Neural implicit surface representations are currently receiving a lot of interest as a means to achieve high-fidelity surface reconstruction at a low memory cost, compared to traditional explicit representations.However, state-of-the-art…

Robotics · Computer Science 2024-09-20 Shuo Sun , Malcolm Mielle , Achim J. Lilienthal , Martin Magnusson

\textit{Implicit neural representations} (INRs) have emerged as a promising framework for representing signals in low-dimensional spaces. This survey reviews the existing literature on the specialized INR problem of approximating…

Computer Vision and Pattern Recognition · Computer Science 2025-11-11 Luiz Schirmer , Tiago Novello , Vinícius da Silva , Guilherme Schardong , Daniel Perazzo , Hélio Lopes , Nuno Gonçalves , Luiz Velho

Implicit neural representation has paved the way for new approaches to dynamic scene reconstruction and rendering. Nonetheless, cutting-edge dynamic neural rendering methods rely heavily on these implicit representations, which frequently…

Computer Vision and Pattern Recognition · Computer Science 2023-11-22 Ziyi Yang , Xinyu Gao , Wen Zhou , Shaohui Jiao , Yuqing Zhang , Xiaogang Jin

Learning-based 3D reconstruction methods have shown impressive results. However, most methods require 3D supervision which is often hard to obtain for real-world datasets. Recently, several works have proposed differentiable rendering…

Computer Vision and Pattern Recognition · Computer Science 2020-03-24 Michael Niemeyer , Lars Mescheder , Michael Oechsle , Andreas Geiger

Neural networks have shown great success in extracting geometric information from color images. Especially, monocular depth estimation networks are increasingly reliable in real-world scenes. In this work we investigate the applicability of…

Computer Vision and Pattern Recognition · Computer Science 2023-02-21 Dominik Engel , Sebastian Hartwig , Timo Ropinski

The neural implicit representation has shown its effectiveness in novel view synthesis and high-quality 3D reconstruction from multi-view images. However, most approaches focus on holistic scene representation yet ignore individual objects…

Computer Vision and Pattern Recognition · Computer Science 2022-08-02 Qianyi Wu , Xian Liu , Yuedong Chen , Kejie Li , Chuanxia Zheng , Jianfei Cai , Jianmin Zheng

3D object detection is an important capability needed in various practical applications such as driver assistance systems. Monocular 3D detection, as a representative general setting among image-based approaches, provides a more economical…

Computer Vision and Pattern Recognition · Computer Science 2021-11-29 Tai Wang , Xinge Zhu , Jiangmiao Pang , Dahua Lin

In the realm of robot-assisted minimally invasive surgery, dynamic scene reconstruction can significantly enhance downstream tasks and improve surgical outcomes. Neural Radiance Fields (NeRF)-based methods have recently risen to prominence…

Computer Vision and Pattern Recognition · Computer Science 2024-04-03 Yiming Huang , Beilei Cui , Long Bai , Ziqi Guo , Mengya Xu , Mobarakol Islam , Hongliang Ren

We introduce SparseNeuS, a novel neural rendering based method for the task of surface reconstruction from multi-view images. This task becomes more difficult when only sparse images are provided as input, a scenario where existing neural…

Computer Vision and Pattern Recognition · Computer Science 2022-08-03 Xiaoxiao Long , Cheng Lin , Peng Wang , Taku Komura , Wenping Wang

Monocular 3D object detection is challenging due to the lack of accurate depth. However, existing depth-assisted solutions still exhibit inferior performance, whose reason is universally acknowledged as the unsatisfactory accuracy of…

Computer Vision and Pattern Recognition · Computer Science 2025-03-25 Qiude Zhang , Chunyu Lin , Zhijie Shen , Nie Lang , Yao Zhao