English
Related papers

Related papers: View-consistent Object Removal in Radiance Fields

200 papers

Neural Radiance Fields (NeRF) have emerged as a potent paradigm for representing scenes and synthesizing photo-realistic images. A main limitation of conventional NeRFs is that they often fail to produce high-quality renderings under novel…

Computer Vision and Pattern Recognition · Computer Science 2022-05-13 Jian Zhang , Yuanqing Zhang , Huan Fu , Xiaowei Zhou , Bowen Cai , Jinchi Huang , Rongfei Jia , Binqiang Zhao , Xing Tang

Neural radiance fields (NeRFs) have become a ubiquitous tool for modeling scene appearance and geometry from multiview imagery. Recent work has also begun to explore how to use additional supervision from lidar or depth sensor measurements…

Computer Vision and Pattern Recognition · Computer Science 2024-04-09 Anagh Malik , Parsa Mirdehghan , Sotiris Nousias , Kiriakos N. Kutulakos , David B. Lindell

The goal of this work is to perform 3D reconstruction and novel view synthesis from data captured by scanning platforms commonly deployed for world mapping in urban outdoor environments (e.g., Street View). Given a sequence of posed RGB…

Computer Vision and Pattern Recognition · Computer Science 2021-11-30 Konstantinos Rematas , Andrew Liu , Pratul P. Srinivasan , Jonathan T. Barron , Andrea Tagliasacchi , Thomas Funkhouser , Vittorio Ferrari

Radiance Fields (RF) are popular to represent casually-captured scenes for new view synthesis and several applications beyond it. Mixed reality on personal spaces needs understanding and manipulating scenes represented as RFs, with semantic…

Computer Vision and Pattern Recognition · Computer Science 2023-03-28 Rahul Goel , Dhawal Sirikonda , Saurabh Saini , PJ Narayanan

In this study, we present a method for synthesizing novel views from a single 360-degree RGB-D image based on the neural radiance field (NeRF) . Prior studies relied on the neighborhood interpolation capability of multi-layer perceptrons to…

Computer Vision and Pattern Recognition · Computer Science 2023-09-08 Takayuki Hara , Tatsuya Harada

Neural Radiance Fields (NeRF) achieves unprecedented performance in synthesizing novel view synthesis, utilizing multi-view consistency. When capturing multiple inputs, image signal processing (ISP) in modern cameras will independently…

Computer Vision and Pattern Recognition · Computer Science 2024-08-08 Yuehao Wang , Chaoyi Wang , Bingchen Gong , Tianfan Xue

Neural Radiance Fields (NeRFs) have become increasingly popular because of their impressive ability for novel view synthesis. However, their effectiveness is hindered by the Rolling Shutter (RS) effects commonly found in most camera…

Computer Vision and Pattern Recognition · Computer Science 2024-07-16 Muyao Niu , Tong Chen , Yifan Zhan , Zhuoxiao Li , Xiang Ji , Yinqiang Zheng

The emergence of Neural Radiance Fields (NeRF) has promoted the development of synthesized high-fidelity views of the intricate real world. However, it is still a very demanding task to repaint the content in NeRF. In this paper, we propose…

Computer Vision and Pattern Recognition · Computer Science 2023-12-11 Xingchen Zhou , Ying He , F. Richard Yu , Jianqiang Li , You Li

Neural Radiance Fields (NeRF) achieve photo-realistic view synthesis with densely captured input images. However, the geometry of NeRF is extremely under-constrained given sparse views, resulting in significant degradation of novel view…

Computer Vision and Pattern Recognition · Computer Science 2022-09-13 Zheng Chen , Chen Wang , Yuan-Chen Guo , Song-Hai Zhang

Scene view synthesis, which generates novel views from limited perspectives, is increasingly vital for applications like virtual reality, augmented reality, and robotics. Unlike object-based tasks, such as generating 360{\deg} views of a…

Computer Vision and Pattern Recognition · Computer Science 2025-04-29 Xiaofeng Jin , Yan Fang , Matteo Frosi , Jianfei Ge , Jiangjian Xiao , Matteo Matteucci

Neural Radiance Fields (NeRF) have shown impressive capabilities for photorealistic novel view synthesis when trained on dense inputs. However, when trained on sparse inputs, NeRF typically encounters issues of incorrect density or color…

Computer Vision and Pattern Recognition · Computer Science 2024-03-26 Yingji Zhong , Lanqing Hong , Zhenguo Li , Dan Xu

Text-driven 3D scene editing has recently attracted increasing attention. Most existing methods follow a render-edit-optimize pipeline, where multi-view images are rendered from a 3D scene, edited with 2D image editors, and then used to…

Computer Vision and Pattern Recognition · Computer Science 2026-04-27 Pufan Li , Bi'an Du , Shenghe Zheng , Junyi Yao , Wei Hu

Editing a local region or a specific object in a 3D scene represented by a NeRF or consistently blending a new realistic object into the scene is challenging, mainly due to the implicit nature of the scene representation. We present…

Computer Vision and Pattern Recognition · Computer Science 2024-07-17 Ori Gordon , Omri Avrahami , Dani Lischinski

Unlike opaque object, novel view synthesis of transparent object is a challenging task, because transparent object refracts light of background causing visual distortions on the transparent object surface along the viewpoint change.…

Computer Vision and Pattern Recognition · Computer Science 2023-12-14 Heechan Yoon , Seungkyu Lee

Radiance Field methods have recently revolutionized novel-view synthesis of scenes captured with multiple photos or videos. However, achieving high visual quality still requires neural networks that are costly to train and render, while…

Graphics · Computer Science 2023-08-09 Bernhard Kerbl , Georgios Kopanas , Thomas Leimkühler , George Drettakis

Implicit neural representations have shown powerful capacity in modeling real-world 3D scenes, offering superior performance in novel view synthesis. In this paper, we target a more challenging scenario, i.e., joint scene novel view…

Computer Vision and Pattern Recognition · Computer Science 2023-08-08 Yuxin Wang , Wayne Wu , Dan Xu

In this paper, we study the problem of continuous 3D shape representations. The majority of existing successful methods are coordinate-based implicit neural representations. However, they are inefficient to render novel views or recover…

Computer Vision and Pattern Recognition · Computer Science 2023-12-19 Zhuoman Liu , Bo Yang , Yan Luximon , Ajay Kumar , Jinxi Li

Recent methods for synthesizing 3D-aware face images have achieved rapid development thanks to neural radiance fields, allowing for high quality and fast inference speed. However, existing solutions for editing facial geometry and…

Graphics · Computer Science 2022-11-16 Kaiwen Jiang , Shu-Yu Chen , Feng-Lin Liu , Hongbo Fu , Lin Gao

Radiance field methods represent the state of the art in reconstructing complex scenes from multi-view photos. However, these reconstructions often suffer from one or both of the following limitations: First, they typically represent scenes…

Computer Vision and Pattern Recognition · Computer Science 2024-11-25 Chao Wang , Krzysztof Wolski , Bernhard Kerbl , Ana Serrano , Mojtaba Bemana , Hans-Peter Seidel , Karol Myszkowski , Thomas Leimkühler

3D object inpainting is commonly achieved via multi-view 2D image completion, yet independently inpainted views often suffer from cross-view inconsistencies, leading to blurred textures, geometric discontinuities, and visual artifacts in…

Computer Vision and Pattern Recognition · Computer Science 2026-05-28 Haitang Feng , Xinkai Chen , Jie Liu , Jie Tang , Gangshan Wu , Beiqi Chen , Jianhuang Lai , Guangcong Wang