English
Related papers

Related papers: RePaint-NeRF: NeRF Editting via Semantic Masks and…

200 papers

Implicit neural rendering, especially Neural Radiance Field (NeRF), has shown great potential in novel view synthesis of a scene. However, current NeRF-based methods cannot enable users to perform user-controlled shape deformation in the…

Graphics · Computer Science 2022-05-11 Yu-Jie Yuan , Yang-Tian Sun , Yu-Kun Lai , Yuewen Ma , Rongfei Jia , Lin Gao

We propose a method for editing NeRF scenes with text-instructions. Given a NeRF of a scene and the collection of images used to reconstruct it, our method uses an image-conditioned diffusion model (InstructPix2Pix) to iteratively edit the…

Computer Vision and Pattern Recognition · Computer Science 2023-06-02 Ayaan Haque , Matthew Tancik , Alexei A. Efros , Aleksander Holynski , Angjoo Kanazawa

A neural radiance field (NeRF) is a scene model supporting high-quality view synthesis, optimized per scene. In this paper, we explore enabling user editing of a category-level NeRF - also known as a conditional radiance field - trained on…

Computer Vision and Pattern Recognition · Computer Science 2021-06-07 Steven Liu , Xiuming Zhang , Zhoutong Zhang , Richard Zhang , Jun-Yan Zhu , Bryan Russell

In NeRF-aided editing tasks, object movement presents difficulties in supervision generation due to the introduction of variability in object positions. Moreover, the removal operations of certain scene objects often lead to empty regions,…

Computer Vision and Pattern Recognition · Computer Science 2024-05-24 Zhenyang Li , Zilong Chen , Feifan Qu , Mingqing Wang , Yizhou Zhao , Kai Zhang , Yifan Peng

Neural Radiance Fields (NeRF) revolutionized novel view synthesis in recent years by offering a new volumetric representation, which is compact and provides high-quality image rendering. However, the methods to edit those radiance fields…

Computer Vision and Pattern Recognition · Computer Science 2024-12-24 Arthur Hubert , Gamal Elghazaly , Raphael Frank

With the introduction of Neural Radiance Fields (NeRFs), novel view synthesis has recently made a big leap forward. At the core, NeRF proposes that each 3D point can emit radiance, allowing to conduct view synthesis using differentiable…

Computer Vision and Pattern Recognition · Computer Science 2023-03-17 Marie-Julie Rakotosaona , Fabian Manhardt , Diego Martin Arroyo , Michael Niemeyer , Abhijit Kundu , Federico Tombari

Neural Radiance Fields (NeRF) have constituted a remarkable breakthrough in image-based 3D reconstruction. However, their implicit volumetric representations differ significantly from the widely-adopted polygonal meshes and lack support…

Computer Vision and Pattern Recognition · Computer Science 2023-08-22 Jiaxiang Tang , Hang Zhou , Xiaokang Chen , Tianshu Hu , Errui Ding , Jingdong Wang , Gang Zeng

Image translation and manipulation have gain increasing attention along with the rapid development of deep generative models. Although existing approaches have brought impressive results, they mainly operated in 2D space. In light of recent…

Computer Vision and Pattern Recognition · Computer Science 2023-04-04 Yuedong Chen , Qianyi Wu , Chuanxia Zheng , Tat-Jen Cham , Jianfei Cai

Recent methods for synthesizing 3D-aware face images have achieved rapid development thanks to neural radiance fields, allowing for high quality and fast inference speed. However, existing solutions for editing facial geometry and…

Graphics · Computer Science 2022-11-16 Kaiwen Jiang , Shu-Yu Chen , Feng-Lin Liu , Hongbo Fu , Lin Gao

We propose ExtraNeRF, a novel method for extrapolating the range of views handled by a Neural Radiance Field (NeRF). Our main idea is to leverage NeRFs to model scene-specific, fine-grained details, while capitalizing on diffusion models to…

Computer Vision and Pattern Recognition · Computer Science 2024-06-11 Meng-Li Shih , Wei-Chiu Ma , Lorenzo Boyice , Aleksander Holynski , Forrester Cole , Brian L. Curless , Janne Kontkanen

Neural radiance fields (NeRF) bring a new wave for 3D interactive experiences. However, as an important part of the immersive experiences, the defocus effects have not been fully explored within NeRF. Some recent NeRF-based methods generate…

Computer Vision and Pattern Recognition · Computer Science 2022-08-11 Yinhuai Wang , Shuzhou Yang , Yujie Hu , Jian Zhang

Neural radiance field is an emerging rendering method that generates high-quality multi-view consistent images from a neural scene representation and volume rendering. Although neural radiance field-based techniques are robust for scene…

Computer Vision and Pattern Recognition · Computer Science 2024-04-02 Ka Chun Shum , Jaeyeon Kim , Binh-Son Hua , Duc Thanh Nguyen , Sai-Kit Yeung

Neural Radiance Fields (NeRFs) have recently emerged as a popular option for photo-realistic object capture due to their ability to faithfully capture high-fidelity volumetric content even from handheld video input. Although much research…

Computer Vision and Pattern Recognition · Computer Science 2024-04-24 Binglun Wang , Niladri Shekhar Dutt , Niloy J. Mitra

Neural radiance fields (NeRF) have revolutionized the field of image-based view synthesis. However, NeRF uses straight rays and fails to deal with complicated light path changes caused by refraction and reflection. This prevents NeRF from…

Computer Vision and Pattern Recognition · Computer Science 2023-09-25 Xiaoxue Chen , Junchen Liu , Hao Zhao , Guyue Zhou , Ya-Qin Zhang

Under good conditions, Neural Radiance Fields (NeRFs) have shown impressive results on novel view synthesis tasks. NeRFs learn a scene's color and density fields by minimizing the photometric discrepancy between training views and…

Computer Vision and Pattern Recognition · Computer Science 2023-11-09 Jamie Wynn , Daniyar Turmukhambetov

With the success of Neural Radiance Field (NeRF) in 3D-aware portrait editing, a variety of works have achieved promising results regarding both quality and 3D consistency. However, these methods heavily rely on per-prompt optimization when…

Computer Vision and Pattern Recognition · Computer Science 2024-02-05 Jianhui Li , Shilong Liu , Zidong Liu , Yikai Wang , Kaiwen Zheng , Jinghui Xu , Jianmin Li , Jun Zhu

The widespread adoption of implicit neural representations, especially Neural Radiance Fields (NeRF), highlights a growing need for editing capabilities in implicit 3D models, essential for tasks like scene post-processing and 3D content…

Computer Vision and Pattern Recognition · Computer Science 2024-02-22 Zhentao Huang , Yukun Shi , Neil Bruce , Minglun Gong

Neural Radiance Fields (NeRF) have emerged as a powerful tool for creating highly detailed and photorealistic scenes. Existing methods for NeRF-based 3D style transfer need extensive per-scene optimization for single or multiple styles,…

Computer Vision and Pattern Recognition · Computer Science 2024-08-27 Adil Meric , Umut Kocasari , Matthias Nießner , Barbara Roessle

Dynamic Neural Radiance Field (NeRF) is a powerful algorithm capable of rendering photo-realistic novel view images from a monocular RGB video of a dynamic scene. Although it warps moving points across frames from the observation spaces to…

Computer Vision and Pattern Recognition · Computer Science 2023-03-28 Zhiwen Yan , Chen Li , Gim Hee Lee

3D reconstruction methods such as Neural Radiance Fields (NeRFs) excel at rendering photorealistic novel views of complex scenes. However, recovering a high-quality NeRF typically requires tens to hundreds of input images, resulting in a…

Computer Vision and Pattern Recognition · Computer Science 2023-12-06 Rundi Wu , Ben Mildenhall , Philipp Henzler , Keunhong Park , Ruiqi Gao , Daniel Watson , Pratul P. Srinivasan , Dor Verbin , Jonathan T. Barron , Ben Poole , Aleksander Holynski