English
Related papers

Related papers: Hybrid Mesh-neural Representation for 3D Transpare…

200 papers

Implicit representations of 3D objects have recently achieved impressive results on learning-based 3D reconstruction tasks. While existing works use simple texture models to represent object appearance, photo-realistic image synthesis…

Computer Vision and Pattern Recognition · Computer Science 2020-03-30 Michael Oechsle , Michael Niemeyer , Lars Mescheder , Thilo Strauss , Andreas Geiger

Reconstructing detailed 3D scenes from single-view images remains a challenging task due to limitations in existing approaches, which primarily focus on geometric shape recovery, overlooking object appearances and fine shape details. To…

Computer Vision and Pattern Recognition · Computer Science 2023-11-02 Yixin Chen , Junfeng Ni , Nan Jiang , Yaowei Zhang , Yixin Zhu , Siyuan Huang

Incremental scene reconstruction is essential to the navigation in robotics. Most of the conventional methods typically make use of either TSDF (truncated signed distance functions) volume or neural networks to implicitly represent the…

Robotics · Computer Science 2024-04-30 Shaofan Liu , Junbo Chen , Jianke Zhu

This paper presents a simple yet powerful method for 3D human mesh reconstruction from a single RGB image. Most recently, the non-local interactions of the whole mesh vertices have been effectively estimated in the transformer while the…

Computer Vision and Pattern Recognition · Computer Science 2023-04-20 Jeonghwan Kim , Mi-Gyeong Gwon , Hyunwoo Park , Hyukmin Kwon , Gi-Mun Um , Wonjun Kim

We present a new approach to 3D object representation where a neural network encodes the geometry of an object directly into the weights and biases of a second 'mapping' network. This mapping network can be used to reconstruct an object by…

Machine Learning · Computer Science 2020-04-07 Eric Mitchell , Selim Engin , Volkan Isler , Daniel D Lee

Robust scene representation is essential for autonomous systems to safely operate in challenging low-visibility environments. Radar has a clear advantage over cameras and lidars in these conditions due to its resilience to environmental…

Robotics · Computer Science 2026-03-27 Judith Treffler , Vladimír Kubelka , Henrik Andreasson , Martin Magnusson

Neural implicit surface reconstruction using volume rendering techniques has recently achieved significant advancements in creating high-fidelity surfaces from multiple 2D images. However, current methods primarily target scenes with…

Computer Vision and Pattern Recognition · Computer Science 2025-05-13 Lintao Xiang , Hongpei Zheng , Bailin Deng , Hujun Yin

Reconstruction and intrinsic decomposition of scenes from captured imagery would enable many applications such as relighting and virtual object insertion. Recent NeRF based methods achieve impressive fidelity of 3D reconstruction, but bake…

Computer Vision and Pattern Recognition · Computer Science 2023-04-07 Zian Wang , Tianchang Shen , Jun Gao , Shengyu Huang , Jacob Munkberg , Jon Hasselgren , Zan Gojcic , Wenzheng Chen , Sanja Fidler

Obtaining high-quality 3D reconstructions of room-scale scenes is of paramount importance for upcoming applications in AR or VR. These range from mixed reality applications for teleconferencing, virtual measuring, virtual room planing, to…

Computer Vision and Pattern Recognition · Computer Science 2022-03-16 Dejan Azinović , Ricardo Martin-Brualla , Dan B Goldman , Matthias Nießner , Justus Thies

We present a novel method, called NeTO, for capturing 3D geometry of solid transparent objects from 2D images via volume rendering. Reconstructing transparent objects is a very challenging task, which is ill-suited for general-purpose…

Computer Vision and Pattern Recognition · Computer Science 2023-09-11 Zongcheng Li , Xiaoxiao Long , Yusen Wang , Tuo Cao , Wenping Wang , Fei Luo , Chunxia Xiao

In this paper, we define a new problem of recovering the 3D geometry of an object confined in a transparent enclosure. We also propose a novel method for solving this challenging problem. Transparent enclosures pose challenges of multiple…

Computer Vision and Pattern Recognition · Computer Science 2023-03-27 Jinguang Tong , Sundaram Muthu , Fahira Afzal Maken , Chuong Nguyen , Hongdong Li

Efficiently reconstructing complex and intricate surfaces at scale is a long-standing goal in machine perception. To address this problem we introduce Deep Local Shapes (DeepLS), a deep shape representation that enables encoding and…

Computer Vision and Pattern Recognition · Computer Science 2020-08-25 Rohan Chabra , Jan Eric Lenssen , Eddy Ilg , Tanner Schmidt , Julian Straub , Steven Lovegrove , Richard Newcombe

We introduce a novel learning-based method for encoding and manipulating 3D surface meshes. Our method is specifically designed to create an interpretable embedding space for deformable shape collections. Unlike previous 3D mesh…

Computer Vision and Pattern Recognition · Computer Science 2023-10-30 Sara Hahner , Souhaib Attaiki , Jochen Garcke , Maks Ovsjanikov

We present a novel method for temporal coherent reconstruction and tracking of clothed humans. Given a monocular RGB-D sequence, we learn a person-specific body model which is based on a dynamic surface function network. To this end, we…

Computer Vision and Pattern Recognition · Computer Science 2021-08-16 Andrei Burov , Matthias Nießner , Justus Thies

3D reconstruction from images has wide applications in Virtual Reality and Automatic Driving, where the precision requirement is very high. Ground-breaking research in the neural radiance field (NeRF) by utilizing Multi-Layer Perceptions…

Computer Vision and Pattern Recognition · Computer Science 2022-09-28 Jiaming Shen , Bolin Song , Zirui Wu , Yi Xu

In this work, we present a new method for 3D face reconstruction from sparse-view RGB images. Unlike previous methods which are built upon 3D morphable models (3DMMs) with limited details, we leverage an implicit representation to encode…

Computer Vision and Pattern Recognition · Computer Science 2022-10-04 Moran Li , Haibin Huang , Yi Zheng , Mengtian Li , Nong Sang , Chongyang Ma

Mobile robots operating indoors must be prepared to navigate challenging scenes that contain transparent surfaces. This paper proposes a novel method for the fusion of acoustic and visual sensing modalities through implicit neural…

Computer Vision and Pattern Recognition · Computer Science 2024-11-08 Advaith V. Sethuraman , Onur Bagoren , Harikrishnan Seetharaman , Dalton Richardson , Joseph Taylor , Katherine A. Skinner

3D reconstruction from single view images is an ill-posed problem. Inferring the hidden regions from self-occluded images is both challenging and ambiguous. We propose a two-pronged approach to address these issues. To better incorporate…

Computer Vision and Pattern Recognition · Computer Science 2019-03-27 Priyanka Mandikal , K L Navaneet , Mayank Agarwal , R. Venkatesh Babu

Neural implicit representations have emerged as a powerful paradigm for 3D reconstruction. However, despite their success, existing methods fail to capture fine geometric details and thin structures, especially in scenarios where only…

Computer Vision and Pattern Recognition · Computer Science 2025-04-23 Aarya Patel , Hamid Laga , Ojaswa Sharma

3D reconstruction from 2D images is a central problem in computer vision. Recent works have been focusing on reconstruction directly from a single image. It is well known however that only one image cannot provide enough information for…

Computer Vision and Pattern Recognition · Computer Science 2019-01-25 Jhony K. Pontes , Chen Kong , Anders Eriksson , Clinton Fookes , Sridha Sridharan , Simon Lucey