English
Related papers

Related papers: Perturb-and-Revise: Flexible 3D Editing with Gener…

200 papers

The emergence of Neural Radiance Fields (NeRF) has promoted the development of synthesized high-fidelity views of the intricate real world. However, it is still a very demanding task to repaint the content in NeRF. In this paper, we propose…

Computer Vision and Pattern Recognition · Computer Science 2023-12-11 Xingchen Zhou , Ying He , F. Richard Yu , Jianqiang Li , You Li

Recent research has demonstrated that the combination of pretrained diffusion models with neural radiance fields (NeRFs) has emerged as a promising approach for text-to-3D generation. Simply coupling NeRF with diffusion models will result…

Computer Vision and Pattern Recognition · Computer Science 2023-06-19 Lu Yu , Wei Xiang , Kang Han

The advancement of text-driven 3D content editing has been blessed by the progress from 2D generative diffusion models. However, a major obstacle hindering the widespread adoption of 3D content editing is its time-intensive processing. This…

Computer Vision and Pattern Recognition · Computer Science 2023-12-29 Liangchen Song , Liangliang Cao , Jiatao Gu , Yifan Jiang , Junsong Yuan , Hao Tang

Text-guided diffusion models have shown superior performance in image/video generation and editing. While few explorations have been performed in 3D scenarios. In this paper, we discuss three fundamental and interesting problems on this…

Computer Vision and Pattern Recognition · Computer Science 2023-10-13 Gang Li , Heliang Zheng , Chaoyue Wang , Chang Li , Changwen Zheng , Dacheng Tao

Numerous diffusion models have recently been applied to image synthesis and editing. However, editing 3D scenes is still in its early stages. It poses various challenges, such as the requirement to design specific methods for different…

Computer Vision and Pattern Recognition · Computer Science 2023-12-01 Shuangkang Fang , Yufeng Wang , Yi Yang , Yi-Hsuan Tsai , Wenrui Ding , Shuchang Zhou , Ming-Hsuan Yang

Text-driven localized editing of 3D objects is particularly difficult as locally mixing the original 3D object with the intended new object and style effects without distorting the object's form is not a straightforward process. To address…

Computer Vision and Pattern Recognition · Computer Science 2023-09-12 Hyeonseop Song , Seokhun Choi , Hoseok Do , Chul Lee , Taehyeong Kim

Neural Radiance Field (NeRF) is a representation for 3D reconstruction from multi-view images. Despite some recent work showing preliminary success in editing a reconstructed NeRF with diffusion prior, they remain struggling to synthesize…

Computer Vision and Pattern Recognition · Computer Science 2024-11-14 Chieh Hubert Lin , Changil Kim , Jia-Bin Huang , Qinbo Li , Chih-Yao Ma , Johannes Kopf , Ming-Hsuan Yang , Hung-Yu Tseng

Recently, there has been a significant advancement in text-to-image diffusion models, leading to groundbreaking performance in 2D image generation. These advancements have been extended to 3D models, enabling the generation of novel 3D…

Computer Vision and Pattern Recognition · Computer Science 2024-03-22 Jangho Park , Gihyun Kwon , Jong Chul Ye

NeRF's high-quality scene synthesis capability was quickly accepted by scholars in the years after it was proposed, and significant progress has been made in 3D scene representation and synthesis. However, the high computational cost limits…

Computer Vision and Pattern Recognition · Computer Science 2024-01-24 Shun Fang , Ming Cui , Xing Feng , Yanan Zhang

Impressive progress in generative models and implicit representations gave rise to methods that can generate 3D shapes of high quality. However, being able to locally control and edit shapes is another essential property that can unlock…

Computer Vision and Pattern Recognition · Computer Science 2023-03-22 Konstantinos Tertikas , Despoina Paschalidou , Boxiao Pan , Jeong Joon Park , Mikaela Angelina Uy , Ioannis Emiris , Yannis Avrithis , Leonidas Guibas

Text driven diffusion models have shown remarkable capabilities in editing images. However, when editing 3D scenes, existing works mostly rely on training a NeRF for 3D editing. Recent NeRF editing methods leverages edit operations by…

Computer Vision and Pattern Recognition · Computer Science 2024-12-18 Vivek Madhavaram , Shivangana Rawat , Chaitanya Devaguptapu , Charu Sharma , Manohar Kaul

We introduce InseRF, a novel method for generative object insertion in the NeRF reconstructions of 3D scenes. Based on a user-provided textual description and a 2D bounding box in a reference viewpoint, InseRF generates new objects in 3D…

Computer Vision and Pattern Recognition · Computer Science 2024-01-11 Mohamad Shahbazi , Liesbeth Claessens , Michael Niemeyer , Edo Collins , Alessio Tonioni , Luc Van Gool , Federico Tombari

As a powerful representation of 3D scenes, the neural radiance field (NeRF) enables high-quality novel view synthesis from multi-view images. Stylizing NeRF, however, remains challenging, especially on simulating a text-guided style with…

Computer Vision and Pattern Recognition · Computer Science 2022-12-16 Can Wang , Ruixiang Jiang , Menglei Chai , Mingming He , Dongdong Chen , Jing Liao

We propose a method for editing NeRF scenes with text-instructions. Given a NeRF of a scene and the collection of images used to reconstruct it, our method uses an image-conditioned diffusion model (InstructPix2Pix) to iteratively edit the…

Computer Vision and Pattern Recognition · Computer Science 2023-06-02 Ayaan Haque , Matthew Tancik , Alexei A. Efros , Aleksander Holynski , Angjoo Kanazawa

We propose NeRF-Insert, a NeRF editing framework that allows users to make high-quality local edits with a flexible level of control. Unlike previous work that relied on image-to-image models, we cast scene editing as an in-painting…

Computer Vision and Pattern Recognition · Computer Science 2024-05-01 Benet Oriol Sabat , Alessandro Achille , Matthew Trager , Stefano Soatto

Text-driven 3D scene generation is widely applicable to video gaming, film industry, and metaverse applications that have a large demand for 3D scenes. However, existing text-to-3D generation methods are limited to producing 3D objects with…

Computer Vision and Pattern Recognition · Computer Science 2024-02-01 Jingbo Zhang , Xiaoyu Li , Ziyu Wan , Can Wang , Jing Liao

Current Neural Radiance Fields (NeRF) can generate photorealistic novel views. For editing 3D scenes represented by NeRF, with the advent of generative models, this paper proposes Inpaint4DNeRF to capitalize on state-of-the-art stable…

Computer Vision and Pattern Recognition · Computer Science 2024-01-02 Han Jiang , Haosen Sun , Ruoxuan Li , Chi-Keung Tang , Yu-Wing Tai

Recent advancements in diffusion models have shown remarkable proficiency in editing 2D images based on text prompts. However, extending these techniques to edit scenes in Neural Radiance Fields (NeRF) is complex, as editing individual 2D…

Computer Vision and Pattern Recognition · Computer Science 2024-08-02 Sara Rojas , Julien Philip , Kai Zhang , Sai Bi , Fujun Luan , Bernard Ghanem , Kalyan Sunkavall

We present NeRFEditor, an efficient learning framework for 3D scene editing, which takes a video captured over 360{\deg} as input and outputs a high-quality, identity-preserving stylized 3D scene. Our method supports diverse types of…

Computer Vision and Pattern Recognition · Computer Science 2022-12-09 Chunyi Sun , Yanbin Liu , Junlin Han , Stephen Gould

Text-to-3D form plays a crucial role in creating editable 3D scenes for AR/VR. Recent advances have shown promise in merging neural radiance fields (NeRFs) with pre-trained diffusion models for text-to-3D object generation. However, one…

Computer Vision and Pattern Recognition · Computer Science 2024-09-25 Haotian Bai , Yuanhuiyi Lyu , Lutao Jiang , Sijia Li , Haonan Lu , Xiaodong Lin , Lin Wang
‹ Prev 1 2 3 10 Next ›