English
Related papers

Related papers: SPIDR: SDF-based Neural Point Fields for Illuminat…

200 papers

This paper presents a method, namely NeuS-PIR, for recovering relightable neural surfaces using pre-integrated rendering from multi-view images or video. Unlike methods based on NeRF and discrete meshes, our method utilizes implicit neural…

Computer Vision and Pattern Recognition · Computer Science 2024-03-27 Shi Mao , Chenming Wu , Zhelun Shen , Yifan Wang , Dayan Wu , Liangjun Zhang

Neural Radiance Fields (NeRFs) provide a high fidelity, continuous scene representation that can realistically represent complex behaviour of light. Despite works like Ref-NeRF improving geometry through physics-inspired models, the ability…

Computer Vision and Pattern Recognition · Computer Science 2025-07-22 Jack Naylor , Viorela Ila , Donald G. Dansereau

While neural radiance fields (NeRF) led to a breakthrough in photorealistic novel view synthesis, handling mirroring surfaces still denotes a particular challenge as they introduce severe inconsistencies in the scene representation.…

Computer Vision and Pattern Recognition · Computer Science 2025-01-09 Leif Van Holland , Michael Weinmann , Jan U. Müller , Patrick Stotko , Reinhard Klein

This paper presents a unified surface reconstruction and rendering framework for LiDAR-visual systems, integrating Neural Radiance Fields (NeRF) and Neural Distance Fields (NDF) to recover both appearance and structural information from…

Robotics · Computer Science 2024-09-10 Jianheng Liu , Chunran Zheng , Yunfei Wan , Bowen Wang , Yixi Cai , Fu Zhang

Reconstructing the shape and spatially varying surface appearances of a physical-world object as well as its surrounding illumination based on 2D images (e.g., photographs) of the object has been a long-standing problem in computer vision…

Computer Vision and Pattern Recognition · Computer Science 2024-02-02 Cheng Sun , Guangyan Cai , Zhengqin Li , Kai Yan , Cheng Zhang , Carl Marshall , Jia-Bin Huang , Shuang Zhao , Zhao Dong

In this work, we present a new method for 3D face reconstruction from sparse-view RGB images. Unlike previous methods which are built upon 3D morphable models (3DMMs) with limited details, we leverage an implicit representation to encode…

Computer Vision and Pattern Recognition · Computer Science 2022-10-04 Moran Li , Haibin Huang , Yi Zheng , Mengtian Li , Nong Sang , Chongyang Ma

Contemporary registration devices for 3D visual information, such as LIDARs and various depth cameras, capture data as 3D point clouds. In turn, such clouds are challenging to be processed due to their size and complexity. Existing methods…

Computer Vision and Pattern Recognition · Computer Science 2024-06-13 Dominik Zimny , Joanna Waczyńska , Tomasz Trzciński , Przemysław Spurek

Photorealistic simulation plays a crucial role in applications such as autonomous driving, where advances in neural radiance fields (NeRFs) may allow better scalability through the automatic creation of digital 3D assets. However,…

Computer Vision and Pattern Recognition · Computer Science 2024-05-07 Shanlin Sun , Bingbing Zhuang , Ziyu Jiang , Buyu Liu , Xiaohui Xie , Manmohan Chandraker

Various SDF-based neural implicit surface reconstruction methods have been proposed recently, and have demonstrated remarkable modeling capabilities. However, due to the global nature and limited representation ability of a single network,…

Computer Vision and Pattern Recognition · Computer Science 2025-01-17 Leyuan Yang , Bailin Deng , Juyong Zhang

We present Surf-NeRF, a modified implementation of the recently introduced Shadow Neural Radiance Field (S-NeRF) model. This method is able to synthesize novel views from a sparse set of satellite images of a scene, while accounting for the…

Computer Vision and Pattern Recognition · Computer Science 2023-04-19 Federico Semeraro , Yi Zhang , Wenying Wu , Patrick Carroll

Recently, it has shown that priors are vital for neural implicit functions to reconstruct high-quality surfaces from multi-view RGB images. However, current priors require large-scale pre-training, and merely provide geometric clues without…

Computer Vision and Pattern Recognition · Computer Science 2025-04-01 Wenyuan Zhang , Emily Yue-ting Jia , Junsheng Zhou , Baorui Ma , Kanle Shi , Yu-Shen Liu , Zhizhong Han

Comprehensive 3D scene understanding, both geometrically and semantically, is important for real-world applications such as robot perception. Most of the existing work has focused on developing data-driven discriminative models for scene…

Computer Vision and Pattern Recognition · Computer Science 2022-06-10 Mingtong Zhang , Shuhong Zheng , Zhipeng Bao , Martial Hebert , Yu-Xiong Wang

The insertion of objects into a scene and relighting are commonly utilized applications in augmented reality (AR). Previous methods focused on inserting virtual objects using CAD models or real objects from single-view images, resulting in…

Computer Vision and Pattern Recognition · Computer Science 2024-06-24 Xuening Zhu , Renjiao Yi , Xin Wen , Chenyang Zhu , Kai Xu

Neural implicit surface reconstruction using volume rendering techniques has recently achieved significant advancements in creating high-fidelity surfaces from multiple 2D images. However, current methods primarily target scenes with…

Computer Vision and Pattern Recognition · Computer Science 2025-05-13 Lintao Xiang , Hongpei Zheng , Bailin Deng , Hujun Yin

Neural implicit 3D representations have emerged as a powerful paradigm for reconstructing surfaces from multi-view images and synthesizing novel views. Unfortunately, existing methods such as DVR or IDR require accurate per-pixel object…

Computer Vision and Pattern Recognition · Computer Science 2021-10-11 Michael Oechsle , Songyou Peng , Andreas Geiger

Neural radiance fields (NeRFs) have become a ubiquitous tool for modeling scene appearance and geometry from multiview imagery. Recent work has also begun to explore how to use additional supervision from lidar or depth sensor measurements…

Computer Vision and Pattern Recognition · Computer Science 2024-04-09 Anagh Malik , Parsa Mirdehghan , Sotiris Nousias , Kiriakos N. Kutulakos , David B. Lindell

Several variants of Neural Radiance Fields (NeRFs) have significantly improved the accuracy of synthesized images and surface reconstruction of 3D scenes/objects. In all of these methods, a key characteristic is that none can train the…

Computer Vision and Pattern Recognition · Computer Science 2025-06-11 Gonçalo Dias Pais , Valter Piedade , Moitreya Chatterjee , Marcus Greiff , Pedro Miraldo

Neural implicit surface representations have emerged as a promising paradigm to capture 3D shapes in a continuous and resolution-independent manner. However, adapting them to articulated shapes is non-trivial. Existing approaches learn a…

Computer Vision and Pattern Recognition · Computer Science 2021-11-30 Xu Chen , Yufeng Zheng , Michael J. Black , Otmar Hilliges , Andreas Geiger

Neural Radiance Field (NeRF) is a promising approach for synthesizing novel views, given a set of images and the corresponding camera poses of a scene. However, images photographed from a low-light scene can hardly be used to train a NeRF…

Computer Vision and Pattern Recognition · Computer Science 2023-07-21 Haoyuan Wang , Xiaogang Xu , Ke Xu , Rynson WH. Lau

Neural Radiance Fields (NeRF) have shown remarkable performance in neural rendering-based novel view synthesis. However, NeRF suffers from severe visual quality degradation when the input images have been captured under imperfect…

Computer Vision and Pattern Recognition · Computer Science 2024-01-02 Byeonghyeon Lee , Howoong Lee , Usman Ali , Eunbyung Park