English
Related papers

Related papers: Depth Priors in Removal Neural Radiance Fields

200 papers

Unlike opaque object, novel view synthesis of transparent object is a challenging task, because transparent object refracts light of background causing visual distortions on the transparent object surface along the viewpoint change.…

Computer Vision and Pattern Recognition · Computer Science 2023-12-14 Heechan Yoon , Seungkyu Lee

Thin, reflective objects such as forks and whisks are common in our daily lives, but they are particularly challenging for robot perception because it is hard to reconstruct them using commodity RGB-D cameras or multi-view stereo…

Robotics · Computer Science 2022-04-28 Lin Yen-Chen , Pete Florence , Jonathan T. Barron , Tsung-Yi Lin , Alberto Rodriguez , Phillip Isola

Neural radiance fields (NeRF) have revolutionized the field of image-based view synthesis. However, NeRF uses straight rays and fails to deal with complicated light path changes caused by refraction and reflection. This prevents NeRF from…

Computer Vision and Pattern Recognition · Computer Science 2023-09-25 Xiaoxue Chen , Junchen Liu , Hao Zhao , Guyue Zhou , Ya-Qin Zhang

In surgical oncology, screening colonoscopy plays a pivotal role in providing diagnostic assistance, such as biopsy, and facilitating surgical navigation, particularly in polyp detection. Computer-assisted endoscopic surgery has recently…

Computer Vision and Pattern Recognition · Computer Science 2024-10-31 Baoru Huang , Yida Wang , Anh Nguyen , Daniel Elson , Francisco Vasconcelos , Danail Stoyanov

Recently, Neural Radiance Fields (NeRF) have emerged as a potent method for synthesizing novel views from a dense set of images. Despite its impressive performance, NeRF is plagued by its necessity for numerous calibrated views and its…

Computer Vision and Pattern Recognition · Computer Science 2023-03-13 Jiayang Bai , Letian Huang , Wen Gong , Jie Guo , Yanwen Guo

Neural radiance fields (NeRFs) have exhibited potential in synthesizing high-fidelity views of 3D scenes but the standard training paradigm of NeRF presupposes an equal importance for each image in the training set. This assumption poses a…

Computer Vision and Pattern Recognition · Computer Science 2024-01-30 Rongkai Ma , Leo Lebrat , Rodrigo Santa Cruz , Gil Avraham , Yan Zuo , Clinton Fookes , Olivier Salvado

Three-dimensional (3D) reconstruction of trees has always been a key task in precision forestry management and research. Due to the complex branch morphological structure of trees themselves and the occlusions from tree stems, branches and…

Computer Vision and Pattern Recognition · Computer Science 2023-12-07 Hongyu Huang , Guoji Tian , Chongcheng Chen

Simultaneously odometry and mapping using LiDAR data is an important task for mobile systems to achieve full autonomy in large-scale environments. However, most existing LiDAR-based methods prioritize tracking quality over reconstruction…

Computer Vision and Pattern Recognition · Computer Science 2023-03-21 Junyuan Deng , Xieyuanli Chen , Songpengcheng Xia , Zhen Sun , Guoqing Liu , Wenxian Yu , Ling Pei

Accelerating neural radiance fields training is of substantial practical value, as the ray sampling strategy profoundly impacts network convergence. More efficient ray sampling can thus directly enhance existing NeRF models' training…

Computer Vision and Pattern Recognition · Computer Science 2023-08-31 Shilei Sun , Ming Liu , Zhongyi Fan , Yuxue Liu , Chengwei Lv , Liquan Dong , Lingqin Kong

Neural Radiance Fields (NeRF) use multi-view images for 3D scene representation, demonstrating remarkable performance. As one of the primary sources of multi-view images, multi-camera systems encounter challenges such as varying intrinsic…

Computer Vision and Pattern Recognition · Computer Science 2024-12-09 Yu Gao , Lutong Su , Hao Liang , Yufeng Yue , Yi Yang , Mengyin Fu

Neural Radiance Fields (NeRF) is a novel implicit 3D reconstruction method that shows immense potential and has been gaining increasing attention. It enables the reconstruction of 3D scenes solely from a set of photographs. However, its…

Computer Vision and Pattern Recognition · Computer Science 2023-10-23 Jiaming Gu , Minchao Jiang , Hongsheng Li , Xiaoyuan Lu , Guangming Zhu , Syed Afaq Ali Shah , Liang Zhang , Mohammed Bennamoun

Monocular 3D object detection is challenging due to the lack of accurate depth. However, existing depth-assisted solutions still exhibit inferior performance, whose reason is universally acknowledged as the unsatisfactory accuracy of…

Computer Vision and Pattern Recognition · Computer Science 2025-03-25 Qiude Zhang , Chunyu Lin , Zhijie Shen , Nie Lang , Yao Zhao

NeRF synthesizes novel views of a scene with unprecedented quality by fitting a neural radiance field to RGB images. However, NeRF requires querying a deep Multi-Layer Perceptron (MLP) millions of times, leading to slow rendering times,…

Computer Vision and Pattern Recognition · Computer Science 2021-08-03 Christian Reiser , Songyou Peng , Yiyi Liao , Andreas Geiger

Although sparse-view computed tomography (CT) has significantly reduced radiation dose, it also introduces severe artifacts which degrade the image quality. In recent years, deep learning-based methods for inverse problems have made…

Image and Video Processing · Electrical Eng. & Systems 2024-01-02 Shuo Xu , Yucheng Zhang , Gang Chen , Xincheng Xiang , Peng Cong , Yuewen Sun

In this paper, we address the challenge of decomposing Neural Radiance Fields (NeRF) into objects from an open vocabulary, a critical task for object manipulation in 3D reconstruction and view synthesis. Current techniques for NeRF…

Computer Vision and Pattern Recognition · Computer Science 2023-10-26 Hao Zhang , Fang Li , Narendra Ahuja

Neural Radiance Fields (NeRF) show impressive performance in photo-realistic free-view rendering of scenes. Recent improvements on the NeRF such as TensoRF and ZipNeRF employ explicit models for faster optimization and rendering, as…

Computer Vision and Pattern Recognition · Computer Science 2026-03-17 Nagabhushan Somraj , Sai Harsha Mupparaju , Adithyan Karanayil , Rajiv Soundararajan

Hyperspectral Imagery (HSI) has been used in many applications to non-destructively determine the material and/or chemical compositions of samples. There is growing interest in creating 3D hyperspectral reconstructions, which could provide…

Computer Vision and Pattern Recognition · Computer Science 2024-03-25 Gerry Chen , Sunil Kumar Narayanan , Thomas Gautier Ottou , Benjamin Missaoui , Harsh Muriki , Cédric Pradalier , Yongsheng Chen

Radiance field methods such as Neural Radiance Fields (NeRFs) or 3D Gaussian Splatting (3DGS), have revolutionized graphics and novel view synthesis. Their ability to synthesize new viewpoints with photo-realistic quality, as well as…

Robotics · Computer Science 2025-05-19 Maximum Wilder-Smith , Vaishakh Patil , Marco Hutter

Recent advances in neural radiance fields (NeRFs) achieve state-of-the-art novel view synthesis and facilitate dense estimation of scene properties. However, NeRFs often fail for large, unbounded scenes that are captured under very sparse…

Computer Vision and Pattern Recognition · Computer Science 2023-04-05 Alexandra Carlson , Manikandasriram Srinivasan Ramanagopal , Nathan Tseng , Matthew Johnson-Roberson , Ram Vasudevan , Katherine A. Skinner

Existing Neural Radiance Fields (NeRF) methods suffer from the existence of reflective objects, often resulting in blurry or distorted rendering. Instead of calculating a single radiance field, we propose a multi-space neural radiance field…

Computer Vision and Pattern Recognition · Computer Science 2025-03-26 Ze-Xin Yin , Peng-Yi Jiao , Jiaxiong Qiu , Ming-Ming Cheng , Bo Ren