English
Related papers

Related papers: NeRSP: Neural 3D Reconstruction for Reflective Obj…

200 papers

Neural Radiance Fields (NeRF) has achieved unprecedented view synthesis quality using coordinate-based neural scene representations. However, NeRF's view dependency can only handle simple reflections like highlights but cannot deal with…

Computer Vision and Pattern Recognition · Computer Science 2022-04-07 Yuan-Chen Guo , Di Kang , Linchao Bao , Yu He , Song-Hai Zhang

Neural approaches have shown a significant progress on camera-based reconstruction. But they require either a fairly dense sampling of the viewing sphere, or pre-training on an existing dataset, thereby limiting their generalizability. In…

Computer Vision and Pattern Recognition · Computer Science 2024-04-02 Mohammed Brahimi , Bjoern Haefner , Zhenzhang Ye , Bastian Goldluecke , Daniel Cremers

In recent years, reconstructing indoor scene geometry from multi-view images has achieved encouraging accomplishments. Current methods incorporate monocular priors into neural implicit surface models to achieve high-quality reconstructions.…

Computer Vision and Pattern Recognition · Computer Science 2025-01-03 Yulun Wu , Han Huang , Wenyuan Zhang , Chao Deng , Ge Gao , Ming Gu , Yu-Shen Liu

This paper introduces a versatile paradigm for integrating multi-view reflectance (optional) and normal maps acquired through photometric stereo. Our approach employs a pixel-wise joint re-parameterization of reflectance and normal,…

Computer Vision and Pattern Recognition · Computer Science 2024-04-01 Baptiste Brument , Robin Bruneau , Yvain Quéau , Jean Mélou , François Bernard Lauze , Jean-Denis , Jean-Denis Durou , Lilian Calvet

Three-dimensional ultrasound imaging is a critical technology widely used in medical diagnostics. However, traditional 3D ultrasound imaging methods have limitations such as fixed resolution, low storage efficiency, and insufficient…

Artificial Intelligence · Computer Science 2024-09-16 Ziwen Guo , Zi Fang , Zhuang Fu

Neural 3D scene representations have shown great potential for 3D reconstruction from 2D images. However, reconstructing real-world captures of complex scenes still remains a challenge. Existing generic 3D reconstruction methods often…

Computer Vision and Pattern Recognition · Computer Science 2024-12-11 Fangjinhua Wang , Marie-Julie Rakotosaona , Michael Niemeyer , Richard Szeliski , Marc Pollefeys , Federico Tombari

The challenge of image-based 3D reconstruction for glossy objects lies in separating diffuse and specular components on glossy surfaces from captured images, a task complicated by the ambiguity in discerning lighting conditions and material…

Computer Vision and Pattern Recognition · Computer Science 2025-04-10 Bojian Wu , Yifan Peng , Ruizhen Hu , Xiaowei Zhou

Learning surfaces from neural radiance field (NeRF) became a rising topic in Multi-View Stereo (MVS). Recent Signed Distance Function (SDF)-based methods demonstrated their ability to reconstruct accurate 3D shapes of Lambertian scenes.…

Computer Vision and Pattern Recognition · Computer Science 2024-03-19 LI Yang , WU Ruizheng , LI Jiyong , CHEN Ying-cong

Three-dimensional (3D) object reconstruction based on differentiable rendering (DR) is an active research topic in computer vision. DR-based methods minimize the difference between the rendered and target images by optimizing both the shape…

Computer Vision and Pattern Recognition · Computer Science 2022-11-23 Chunyu Li , Taisuke Hashimoto , Eiichi Matsumoto , Hiroharu Kato

This paper tackles the task of uncalibrated photometric stereo for 3D object reconstruction, where both the object shape, object reflectance, and lighting directions are unknown. This is an extremely difficult task, and the challenge is…

Computer Vision and Pattern Recognition · Computer Science 2022-07-19 Junxuan Li , Hongdong Li

Inverse rendering aims at recovering both geometry and materials of objects. It provides a more compatible reconstruction for conventional rendering engines, compared with the neural radiance fields (NeRFs). On the other hand, existing…

Computer Vision and Pattern Recognition · Computer Science 2024-03-26 Haoyuan Wang , Wenbo Hu , Lei Zhu , Rynson W. H. Lau

Digital surface model generation using traditional multi-view stereo matching (MVS) performs poorly over non-Lambertian surfaces, with asynchronous acquisitions, or at discontinuities. Neural radiance fields (NeRF) offer a new paradigm for…

Computer Vision and Pattern Recognition · Computer Science 2023-09-04 Lulin Zhang , Ewelina Rupnik

We present a novel approach for recovering 3D shape and view dependent appearance from a few colored images, enabling efficient 3D reconstruction and novel view synthesis. Our method learns an implicit neural representation in the form of a…

Computer Vision and Pattern Recognition · Computer Science 2024-07-22 Mae Younes , Amine Ouasfi , Adnane Boukhayma

We present a novel convolutional neural network architecture for photometric stereo (Woodham, 1980), a problem of recovering 3D object surface normals from multiple images observed under varying illuminations. Despite its long history in…

Computer Vision and Pattern Recognition · Computer Science 2018-05-30 Tatsunori Taniai , Takanori Maehara

Neural implicit surface reconstruction has achieved remarkable progress recently. Despite resorting to complex radiance modeling, state-of-the-art methods still struggle with textureless and specular surfaces. Different from RGB images,…

Computer Vision and Pattern Recognition · Computer Science 2024-09-24 Guangcheng Chen , Yicheng He , Li He , Hong Zhang

Neural Radiance Fields (NeRF) have demonstrated exceptional capabilities in reconstructing complex scenes with high fidelity. However, NeRF's view dependency can only handle low-frequency reflections. It falls short when handling complex…

Computer Vision and Pattern Recognition · Computer Science 2024-11-08 Chen Gao , Yipeng Wang , Changil Kim , Jia-Bin Huang , Johannes Kopf

Reconstructing objects from posed images is a crucial and complex task in computer graphics and computer vision. While NeRF-based neural reconstruction methods have exhibited impressive reconstruction ability, they tend to be…

Computer Vision and Pattern Recognition · Computer Science 2024-10-18 Shuichang Lai , Letian Huang , Jie Guo , Kai Cheng , Bowen Pan , Xiaoxiao Long , Jiangjing Lyu , Chengfei Lv , Yanwen Guo

Efficient shape reconstruction for surfaces with complex reflectance properties is crucial for real-time virtual reality. While 3D Gaussian Splatting (3DGS)-based methods offer fast novel view rendering by leveraging their explicit surface…

Computer Vision and Pattern Recognition · Computer Science 2025-09-25 Yufei Han , Bowen Tie , Heng Guo , Youwei Lyu , Si Li , Boxin Shi , Yunpeng Jia , Zhanyu Ma

The recent neural surface reconstruction by volume rendering approaches have made much progress by achieving impressive surface reconstruction quality, but are still limited to dense and highly accurate posed views. To overcome such…

Computer Vision and Pattern Recognition · Computer Science 2023-07-13 Shi-Sheng Huang , Zi-Xin Zou , Yi-Chi Zhang , Hua Huang

Neural surface reconstruction (NSR) has recently shown strong potential for urban 3D reconstruction from multi-view aerial imagery. However, existing NSR methods often suffer from geometric ambiguity and instability, particularly under…

Computer Vision and Pattern Recognition · Computer Science 2026-01-30 Da Li , Chen Yao , Tong Mao , Jiacheng Bao , Houjun Sun