English
Related papers

Related papers: Blending-NeRF: Text-Driven Localized Editing in Ne…

200 papers

As recent advances in Neural Radiance Fields (NeRF) have enabled high-fidelity 3D face reconstruction and novel view synthesis, its manipulation also became an essential task in 3D vision. However, existing manipulation methods require…

Computer Vision and Pattern Recognition · Computer Science 2023-08-21 Sungwon Hwang , Junha Hyung , Daejin Kim , Min-Jung Kim , Jaegul Choo

Recently, the editing of neural radiance fields (NeRFs) has gained considerable attention, but most prior works focus on static scenes while research on the appearance editing of dynamic scenes is relatively lacking. In this paper, we…

Computer Vision and Pattern Recognition · Computer Science 2025-04-15 Shangzan Zhang , Sida Peng , Yinji ShenTu , Qing Shuai , Tianrun Chen , Kaicheng Yu , Hujun Bao , Xiaowei Zhou

In recent years, there has been increasing interest in applying stylization on 3D scenes from a reference style image, in particular onto neural radiance fields (NeRF). While performing stylization directly on NeRF guarantees appearance…

Computer Vision and Pattern Recognition · Computer Science 2023-09-20 Hong-Wing Pang , Binh-Son Hua , Sai-Kit Yeung

Recent advancements in diffusion models have shown remarkable proficiency in editing 2D images based on text prompts. However, extending these techniques to edit scenes in Neural Radiance Fields (NeRF) is complex, as editing individual 2D…

Computer Vision and Pattern Recognition · Computer Science 2024-08-02 Sara Rojas , Julien Philip , Kai Zhang , Sai Bi , Fujun Luan , Bernard Ghanem , Kalyan Sunkavall

We introduce InseRF, a novel method for generative object insertion in the NeRF reconstructions of 3D scenes. Based on a user-provided textual description and a 2D bounding box in a reference viewpoint, InseRF generates new objects in 3D…

Computer Vision and Pattern Recognition · Computer Science 2024-01-11 Mohamad Shahbazi , Liesbeth Claessens , Michael Niemeyer , Edo Collins , Alessio Tonioni , Luc Van Gool , Federico Tombari

With the popularity of implicit neural representations, or neural radiance fields (NeRF), there is a pressing need for editing methods to interact with the implicit 3D models for tasks like post-processing reconstructed scenes and 3D…

Computer Vision and Pattern Recognition · Computer Science 2023-08-29 Xiangyu Wang , Jingsen Zhu , Qi Ye , Yuchi Huo , Yunlong Ran , Zhihua Zhong , Jiming Chen

This paper targets interactive object-level editing (e.g., deletion, recoloring, transformation, composition) in dynamic scenes. Recently, some methods aiming for flexible editing static scenes represented by neural radiance field (NeRF)…

Computer Vision and Pattern Recognition · Computer Science 2023-11-08 Dadong Jiang , Zhihui Ke , Xiaobo Zhou , Xidong Shi

We propose a method for editing NeRF scenes with text-instructions. Given a NeRF of a scene and the collection of images used to reconstruct it, our method uses an image-conditioned diffusion model (InstructPix2Pix) to iteratively edit the…

Computer Vision and Pattern Recognition · Computer Science 2023-06-02 Ayaan Haque , Matthew Tancik , Alexei A. Efros , Aleksander Holynski , Angjoo Kanazawa

3D face generation has achieved high visual quality and 3D consistency thanks to the development of neural radiance fields (NeRF). Recently, to generate and edit 3D faces with NeRF representation, some methods are proposed and achieve good…

Computer Vision and Pattern Recognition · Computer Science 2023-02-21 Wenyang Zhou , Lu Yuan , Shuyu Chen , Lin Gao , Shimin Hu

Recently, there has been a significant advancement in text-to-image diffusion models, leading to groundbreaking performance in 2D image generation. These advancements have been extended to 3D models, enabling the generation of novel 3D…

Computer Vision and Pattern Recognition · Computer Science 2024-03-22 Jangho Park , Gihyun Kwon , Jong Chul Ye

TL;DR Perform 3D object editing selectively by disentangling it from the background scene. Instruct-NeRF2NeRF (in2n) is a promising method that enables editing of 3D scenes composed of Neural Radiance Field (NeRF) using text prompts.…

Computer Vision and Pattern Recognition · Computer Science 2024-08-27 Jiseung Hong , Changmin Lee , Gyusang Yu

Text-to-3D form plays a crucial role in creating editable 3D scenes for AR/VR. Recent advances have shown promise in merging neural radiance fields (NeRFs) with pre-trained diffusion models for text-to-3D object generation. However, one…

Computer Vision and Pattern Recognition · Computer Science 2024-09-25 Haotian Bai , Yuanhuiyi Lyu , Lutao Jiang , Sijia Li , Haonan Lu , Xiaodong Lin , Lin Wang

Neural Radiance Fields (NeRFs) have become a widely-applied scene representation technique in recent years, showing advantages for robot navigation and manipulation tasks. To further advance the utility of NeRFs for robotics, we propose a…

Computer Vision and Pattern Recognition · Computer Science 2023-07-18 Jiankai Sun , Yan Xu , Mingyu Ding , Hongwei Yi , Chen Wang , Jingdong Wang , Liangjun Zhang , Mac Schwager

A neural radiance field (NeRF) is a scene model supporting high-quality view synthesis, optimized per scene. In this paper, we explore enabling user editing of a category-level NeRF - also known as a conditional radiance field - trained on…

Computer Vision and Pattern Recognition · Computer Science 2021-06-07 Steven Liu , Xiuming Zhang , Zhoutong Zhang , Richard Zhang , Jun-Yan Zhu , Bryan Russell

Image blending aims to combine multiple images seamlessly. It remains challenging for existing 2D-based methods, especially when input images are misaligned due to differences in 3D camera poses and object shapes. To tackle these issues, we…

Computer Vision and Pattern Recognition · Computer Science 2023-08-17 Hyunsu Kim , Gayoung Lee , Yunjey Choi , Jin-Hwa Kim , Jun-Yan Zhu

Neural Radiance Fields (NeRFs) have recently emerged as a popular option for photo-realistic object capture due to their ability to faithfully capture high-fidelity volumetric content even from handheld video input. Although much research…

Computer Vision and Pattern Recognition · Computer Science 2024-04-24 Binglun Wang , Niladri Shekhar Dutt , Niloy J. Mitra

In this work, we develop intuitive controls for editing the style of 3D objects. Our framework, Text2Mesh, stylizes a 3D mesh by predicting color and local geometric details which conform to a target text prompt. We consider a disentangled…

Computer Vision and Pattern Recognition · Computer Science 2021-12-07 Oscar Michel , Roi Bar-On , Richard Liu , Sagie Benaim , Rana Hanocka

In NeRF-aided editing tasks, object movement presents difficulties in supervision generation due to the introduction of variability in object positions. Moreover, the removal operations of certain scene objects often lead to empty regions,…

Computer Vision and Pattern Recognition · Computer Science 2024-05-24 Zhenyang Li , Zilong Chen , Feifan Qu , Mingqing Wang , Yizhou Zhao , Kai Zhang , Yifan Peng

Neural rendering techniques combining machine learning with geometric reasoning have arisen as one of the most promising approaches for synthesizing novel views of a scene from a sparse set of images. Among these, stands out the Neural…

Computer Vision and Pattern Recognition · Computer Science 2020-12-01 Albert Pumarola , Enric Corona , Gerard Pons-Moll , Francesc Moreno-Noguer

Neural Radiance Fields (NeRFs) are emerging as a ubiquitous scene representation that allows for novel view synthesis. Increasingly, NeRFs will be shareable with other people. Before sharing a NeRF, though, it might be desirable to remove…

Computer Vision and Pattern Recognition · Computer Science 2022-12-23 Silvan Weder , Guillermo Garcia-Hernando , Aron Monszpart , Marc Pollefeys , Gabriel Brostow , Michael Firman , Sara Vicente