中文
相关论文

相关论文: Reference-guided Controllable Inpainting of Neural…

200 篇论文

We propose InNeRF360, an automatic system that accurately removes text-specified objects from 360-degree Neural Radiance Fields (NeRF). The challenge is to effectively remove objects while inpainting perceptually consistent content for the…

计算机视觉与模式识别 · 计算机科学 2024-03-27 Dongqing Wang , Tong Zhang , Alaa Abboud , Sabine Süsstrunk

Neural Radiance Field (NeRF) is a representation for 3D reconstruction from multi-view images. Despite some recent work showing preliminary success in editing a reconstructed NeRF with diffusion prior, they remain struggling to synthesize…

计算机视觉与模式识别 · 计算机科学 2024-11-14 Chieh Hubert Lin , Changil Kim , Jia-Bin Huang , Qinbo Li , Chih-Yao Ma , Johannes Kopf , Ming-Hsuan Yang , Hung-Yu Tseng

Despite the great success in 2D editing using user-friendly tools, such as Photoshop, semantic strokes, or even text prompts, similar capabilities in 3D areas are still limited, either relying on 3D modeling skills or allowing editing…

计算机视觉与模式识别 · 计算机科学 2023-03-28 Chong Bao , Yinda Zhang , Bangbang Yang , Tianxing Fan , Zesong Yang , Hujun Bao , Guofeng Zhang , Zhaopeng Cui

The emergence of Neural Radiance Fields (NeRF) has promoted the development of synthesized high-fidelity views of the intricate real world. However, it is still a very demanding task to repaint the content in NeRF. In this paper, we propose…

计算机视觉与模式识别 · 计算机科学 2023-12-11 Xingchen Zhou , Ying He , F. Richard Yu , Jianqiang Li , You Li

Recently, Neural Radiance Fields (NeRF) have emerged as a potent method for synthesizing novel views from a dense set of images. Despite its impressive performance, NeRF is plagued by its necessity for numerous calibrated views and its…

计算机视觉与模式识别 · 计算机科学 2023-03-13 Jiayang Bai , Letian Huang , Wen Gong , Jie Guo , Yanwen Guo

Current Neural Radiance Fields (NeRF) can generate photorealistic novel views. For editing 3D scenes represented by NeRF, with the advent of generative models, this paper proposes Inpaint4DNeRF to capitalize on state-of-the-art stable…

计算机视觉与模式识别 · 计算机科学 2024-01-02 Han Jiang , Haosen Sun , Ruoxuan Li , Chi-Keung Tang , Yu-Wing Tai

TL;DR Perform 3D object editing selectively by disentangling it from the background scene. Instruct-NeRF2NeRF (in2n) is a promising method that enables editing of 3D scenes composed of Neural Radiance Field (NeRF) using text prompts.…

计算机视觉与模式识别 · 计算机科学 2024-08-27 Jiseung Hong , Changmin Lee , Gyusang Yu

Neural Radiance Fields (NeRF) have demonstrated exceptional capabilities in reconstructing complex scenes with high fidelity. However, NeRF's view dependency can only handle low-frequency reflections. It falls short when handling complex…

计算机视觉与模式识别 · 计算机科学 2024-11-08 Chen Gao , Yipeng Wang , Changil Kim , Jia-Bin Huang , Johannes Kopf

Neural Radiance Fields (NeRF) has achieved unprecedented view synthesis quality using coordinate-based neural scene representations. However, NeRF's view dependency can only handle simple reflections like highlights but cannot deal with…

计算机视觉与模式识别 · 计算机科学 2022-04-07 Yuan-Chen Guo , Di Kang , Linchao Bao , Yu He , Song-Hai Zhang

In NeRF-aided editing tasks, object movement presents difficulties in supervision generation due to the introduction of variability in object positions. Moreover, the removal operations of certain scene objects often lead to empty regions,…

计算机视觉与模式识别 · 计算机科学 2024-05-24 Zhenyang Li , Zilong Chen , Feifan Qu , Mingqing Wang , Yizhou Zhao , Kai Zhang , Yifan Peng

We propose ExtraNeRF, a novel method for extrapolating the range of views handled by a Neural Radiance Field (NeRF). Our main idea is to leverage NeRFs to model scene-specific, fine-grained details, while capitalizing on diffusion models to…

计算机视觉与模式识别 · 计算机科学 2024-06-11 Meng-Li Shih , Wei-Chiu Ma , Lorenzo Boyice , Aleksander Holynski , Forrester Cole , Brian L. Curless , Janne Kontkanen

Existing inverse rendering combined with neural rendering methods can only perform editable novel view synthesis on object-specific scenes, while we present intrinsic neural radiance fields, dubbed IntrinsicNeRF, which introduce intrinsic…

计算机视觉与模式识别 · 计算机科学 2023-08-30 Weicai Ye , Shuo Chen , Chong Bao , Hujun Bao , Marc Pollefeys , Zhaopeng Cui , Guofeng Zhang

Neural rendering has received tremendous attention since the advent of Neural Radiance Fields (NeRF), and has pushed the state-of-the-art on novel-view synthesis considerably. The recent focus has been on models that overfit to a single…

计算机视觉与模式识别 · 计算机科学 2022-07-29 Mohammed Suhail , Carlos Esteves , Leonid Sigal , Ameesh Makadia

Neural reconstruction approaches are rapidly emerging as the preferred representation for 3D scenes, but their limited editability is still posing a challenge. In this work, we propose an approach for 3D scene inpainting -- the task of…

计算机视觉与模式识别 · 计算机科学 2024-04-17 Ashkan Mirzaei , Riccardo De Lutio , Seung Wook Kim , David Acuna , Jonathan Kelly , Sanja Fidler , Igor Gilitschenski , Zan Gojcic

3D reconstruction from a single 2D image was extensively covered in the literature but relies on depth supervision at training time, which limits its applicability. To relax the dependence to depth we propose SceneRF, a self-supervised…

计算机视觉与模式识别 · 计算机科学 2023-08-28 Anh-Quan Cao , Raoul de Charette

Recent work on 3D-aware image synthesis has achieved compelling results using advances in neural rendering. However, 3D-aware synthesis of face dynamics hasn't received much attention. Here, we study how to explicitly control generative…

计算机视觉与模式识别 · 计算机科学 2022-10-13 Peiye Zhuang , Liqian Ma , Oluwasanmi Koyejo , Alexander G. Schwing

Recently, Neural Radiance Fields (NeRF) has exhibited significant success in novel view synthesis, surface reconstruction, etc. However, since no physical reflection is considered in its rendering pipeline, NeRF mistakes the reflection in…

计算机视觉与模式识别 · 计算机科学 2023-08-08 Junyi Zeng , Chong Bao , Rui Chen , Zilong Dong , Guofeng Zhang , Hujun Bao , Zhaopeng Cui

Several variants of Neural Radiance Fields (NeRFs) have significantly improved the accuracy of synthesized images and surface reconstruction of 3D scenes/objects. In all of these methods, a key characteristic is that none can train the…

计算机视觉与模式识别 · 计算机科学 2025-06-11 Gonçalo Dias Pais , Valter Piedade , Moitreya Chatterjee , Marcus Greiff , Pedro Miraldo

This paper presents a stylized novel view synthesis method. Applying state-of-the-art stylization methods to novel views frame by frame often causes jittering artifacts due to the lack of cross-view consistency. Therefore, this paper…

计算机视觉与模式识别 · 计算机科学 2022-07-07 Thu Nguyen-Phuoc , Feng Liu , Lei Xiao

Although neural radiance fields (NeRF) have shown impressive advances for novel view synthesis, most methods typically require multiple input images of the same scene with accurate camera poses. In this work, we seek to substantially reduce…

计算机视觉与模式识别 · 计算机科学 2022-10-17 Kai-En Lin , Lin Yen-Chen , Wei-Sheng Lai , Tsung-Yi Lin , Yi-Chang Shih , Ravi Ramamoorthi