English
Related papers

Related papers: MatDecompSDF: High-Fidelity 3D Shape and PBR Mater…

200 papers

Neural 3D scene representations have shown great potential for 3D reconstruction from 2D images. However, reconstructing real-world captures of complex scenes still remains a challenge. Existing generic 3D reconstruction methods often…

Computer Vision and Pattern Recognition · Computer Science 2024-12-11 Fangjinhua Wang , Marie-Julie Rakotosaona , Michael Niemeyer , Richard Szeliski , Marc Pollefeys , Federico Tombari

Presenting a 3D scene from multiview images remains a core and long-standing challenge in computer vision and computer graphics. Two main requirements lie in rendering and reconstruction. Notably, SOTA rendering quality is usually achieved…

Computer Vision and Pattern Recognition · Computer Science 2024-10-15 Mulin Yu , Tao Lu , Linning Xu , Lihan Jiang , Yuanbo Xiangli , Bo Dai

Reconstructing 3D vehicles from noisy and sparse partial point clouds is of great significance to autonomous driving. Most existing 3D reconstruction methods cannot be directly applied to this problem because they are elaborately designed…

Computer Vision and Pattern Recognition · Computer Science 2023-10-02 Yibo Liu , Kelly Zhu , Guile Wu , Yuan Ren , Bingbing Liu , Yang Liu , Jinjun Shan

We develop a method that recovers the surface, materials, and illumination of a scene from its posed multi-view images. In contrast to prior work, it does not require any additional data and can handle glossy objects or bright lighting. It…

Computer Vision and Pattern Recognition · Computer Science 2025-04-08 Yue Fan , Ningjing Fan , Ivan Skorokhodov , Oleg Voynov , Savva Ignatyev , Evgeny Burnaev , Peter Wonka , Yiqun Wang

Neural rendering can be used to reconstruct implicit representations of shapes without 3D supervision. However, current neural surface reconstruction methods have difficulty learning high-frequency geometry details, so the reconstructed…

Computer Vision and Pattern Recognition · Computer Science 2022-09-23 Yiqun Wang , Ivan Skorokhodov , Peter Wonka

Multi-view shape reconstruction has achieved impressive progresses thanks to the latest advances in neural implicit surface rendering. However, existing methods based on signed distance function (SDF) are limited to closed surfaces, failing…

Computer Vision and Pattern Recognition · Computer Science 2023-04-21 Yu-Tao Liu , Li Wang , Jie yang , Weikai Chen , Xiaoxu Meng , Bo Yang , Lin Gao

Fine-detailed reconstructions are in high demand in many applications. However, most of the existing RGB-D reconstruction methods rely on pre-calculated accurate camera poses to recover the detailed surface geometry, where the…

Computer Vision and Pattern Recognition · Computer Science 2022-10-25 Lu Sang , Bjoern Haefner , Xingxing Zuo , Daniel Cremers

Due to the unique characteristics of underwater environments, accurate 3D reconstruction of underwater objects poses a challenging problem in tasks such as underwater exploration and mapping. Traditional methods that rely on multiple sensor…

Computer Vision and Pattern Recognition · Computer Science 2024-10-11 Zeyu Chen , Jingyi Tang , Gu Wang , Shengquan Li , Xinghui Li , Xiangyang Ji , Xiu Li

Surface reconstruction from multi-view images is a core challenge in 3D vision. Recent studies have explored signed distance fields (SDF) within Neural Radiance Fields (NeRF) to achieve high-fidelity surface reconstructions. However, these…

Computer Vision and Pattern Recognition · Computer Science 2024-12-23 Baixin Xu , Jiangbei Hu , Jiaze Li , Ying He

Recent 3D Gaussian Splatting (3DGS) representations have demonstrated remarkable performance in novel view synthesis; further, material-lighting disentanglement on 3DGS warrants relighting capabilities and its adaptability to broader…

Computer Vision and Pattern Recognition · Computer Science 2025-07-14 Kai Ye , Chong Gao , Guanbin Li , Wenzheng Chen , Baoquan Chen

Differentiable rendering is an essential operation in modern vision, allowing inverse graphics approaches to 3D understanding to be utilized in modern machine learning frameworks. Explicit shape representations (voxels, point clouds, or…

Computer Vision and Pattern Recognition · Computer Science 2021-12-13 Tristan Aumentado-Armstrong , Stavros Tsogkas , Sven Dickinson , Allan Jepson

In this paper, we study the problem of 3D scene geometry decomposition and manipulation from 2D views. By leveraging the recent implicit neural representation techniques, particularly the appealing neural radiance fields, we introduce an…

Computer Vision and Pattern Recognition · Computer Science 2023-03-13 Bing Wang , Lu Chen , Bo Yang

Various SDF-based neural implicit surface reconstruction methods have been proposed recently, and have demonstrated remarkable modeling capabilities. However, due to the global nature and limited representation ability of a single network,…

Computer Vision and Pattern Recognition · Computer Science 2025-01-17 Leyuan Yang , Bailin Deng , Juyong Zhang

The neural implicit representation has shown its effectiveness in novel view synthesis and high-quality 3D reconstruction from multi-view images. However, most approaches focus on holistic scene representation yet ignore individual objects…

Computer Vision and Pattern Recognition · Computer Science 2022-08-02 Qianyi Wu , Xian Liu , Yuedong Chen , Kejie Li , Chuanxia Zheng , Jianfei Cai , Jianmin Zheng

Scene and object reconstruction is an important problem in robotics, in particular in planning collision-free trajectories or in object manipulation. This paper compares two strategies for the reconstruction of nonvisible parts of the…

Robotics · Computer Science 2025-01-28 Rafał Staszak , Piotr Michałek , Jakub Chudziński , Marek Kopicki , Dominik Belter

Neural signed distance functions (SDFs) have been a vital representation to represent 3D shapes or scenes with neural networks. An SDF is an implicit function that can query signed distances at specific coordinates for recovering a 3D…

Computer Vision and Pattern Recognition · Computer Science 2025-11-19 Qiang Bai , Bojian Wu , Xi Yang , Zhizhong Han

Recent works on 3D reconstruction from posed images have demonstrated that direct inference of scene-level 3D geometry without test-time optimization is feasible using deep neural networks, showing remarkable promise and high efficiency.…

Computer Vision and Pattern Recognition · Computer Science 2023-08-22 Noah Stier , Anurag Ranjan , Alex Colburn , Yajie Yan , Liang Yang , Fangchang Ma , Baptiste Angles

Recovering the shape and appearance of real-world objects from natural 2D images is a long-standing and challenging inverse rendering problem. In this paper, we introduce a novel hybrid differentiable rendering method to efficiently…

Computer Vision and Pattern Recognition · Computer Science 2023-08-22 Xiangyang Zhu , Yiling Pan , Bailin Deng , Bin Wang

3D decomposition/segmentation still remains a challenge as large-scale 3D annotated data is not readily available. Contemporary approaches typically leverage 2D machine-generated segments, integrating them for 3D consistency. While the…

Computer Vision and Pattern Recognition · Computer Science 2024-03-22 Tianhao Wu , Chuanxia Zheng , Tat-Jen Cham , Qianyi Wu

Neural 3D implicit representations learn priors that are useful for diverse applications, such as single- or multiple-view 3D reconstruction. A major downside of existing approaches while rendering an image is that they require evaluating…

Computer Vision and Pattern Recognition · Computer Science 2023-12-20 Tarun Yenamandra , Ayush Tewari , Nan Yang , Florian Bernard , Christian Theobalt , Daniel Cremers