English
Related papers

Related papers: NeuralEditor: Editing Neural Radiance Fields via M…

200 papers

We present CLIP-NeRF, a multi-modal 3D object manipulation method for neural radiance fields (NeRF). By leveraging the joint language-image embedding space of the recent Contrastive Language-Image Pre-Training (CLIP) model, we propose a…

Computer Vision and Pattern Recognition · Computer Science 2022-03-03 Can Wang , Menglei Chai , Mingming He , Dongdong Chen , Jing Liao

While deep learning reshaped the classical motion capture pipeline with feed-forward networks, generative models are required to recover fine alignment via iterative refinement. Unfortunately, the existing models are usually hand-crafted or…

Computer Vision and Pattern Recognition · Computer Science 2021-11-01 Shih-Yang Su , Frank Yu , Michael Zollhoefer , Helge Rhodin

Considering the problem of novel view synthesis (NVS) from only a set of 2D images, we simplify the training process of Neural Radiance Field (NeRF) on forward-facing scenes by removing the requirement of known or pre-computed camera…

Computer Vision and Pattern Recognition · Computer Science 2022-04-07 Zirui Wang , Shangzhe Wu , Weidi Xie , Min Chen , Victor Adrian Prisacariu

A variety of Neural Radiance Fields (NeRF) methods have recently achieved remarkable success in high render speed. However, current accelerating methods are specialized and incompatible with various implicit methods, preventing real-time…

Computer Vision and Pattern Recognition · Computer Science 2024-01-05 Xinyu Gao , Ziyi Yang , Yunlu Zhao , Yuxiang Sun , Xiaogang Jin , Changqing Zou

3D reconstruction from images has wide applications in Virtual Reality and Automatic Driving, where the precision requirement is very high. Ground-breaking research in the neural radiance field (NeRF) by utilizing Multi-Layer Perceptions…

Computer Vision and Pattern Recognition · Computer Science 2022-09-28 Jiaming Shen , Bolin Song , Zirui Wu , Yi Xu

While neural fields have made significant strides in view synthesis and scene reconstruction, editing them poses a formidable challenge due to their implicit encoding of geometry and texture information from multi-view inputs. In this…

Computer Vision and Pattern Recognition · Computer Science 2024-07-16 Umar Khalid , Hasan Iqbal , Nazmul Karim , Jing Hua , Chen Chen

Texture synthesis is a fundamental problem in computer graphics that would benefit various applications. Existing methods are effective in handling 2D image textures. In contrast, many real-world textures contain meso-structure in the 3D…

Computer Vision and Pattern Recognition · Computer Science 2024-12-16 Yi-Hua Huang , Yan-Pei Cao , Yu-Kun Lai , Ying Shan , Lin Gao

Neural Radiance Field (NeRF) has emerged as a compelling method to represent 3D objects and scenes for photo-realistic rendering. However, its implicit representation causes difficulty in manipulating the models like the explicit mesh…

Computer Vision and Pattern Recognition · Computer Science 2022-10-14 Jiaxiang Tang , Xiaokang Chen , Jingbo Wang , Gang Zeng

Neural Radiance Fields (NeRF) have emerged as a powerful representation for the task of novel view synthesis due to their simplicity and state-of-the-art performance. Though NeRF can produce photorealistic renderings of unseen viewpoints…

Computer Vision and Pattern Recognition · Computer Science 2021-12-02 Michael Niemeyer , Jonathan T. Barron , Ben Mildenhall , Mehdi S. M. Sajjadi , Andreas Geiger , Noha Radwan

This paper introduces a novel paradigm for the generalizable neural radiance field (NeRF). Previous generic NeRF methods combine multiview stereo techniques with image-based neural rendering for generalization, yielding impressive results,…

Computer Vision and Pattern Recognition · Computer Science 2024-01-26 Jiaxu Wang , Ziyi Zhang , Renjing Xu

We present NeRFVS, a novel neural radiance fields (NeRF) based method to enable free navigation in a room. NeRF achieves impressive performance in rendering images for novel views similar to the input views while suffering for novel views…

Computer Vision and Pattern Recognition · Computer Science 2023-05-24 Chen Yang , Peihao Li , Zanwei Zhou , Shanxin Yuan , Bingbing Liu , Xiaokang Yang , Weichao Qiu , Wei Shen

Diffusion models have revolutionized text-driven video editing. However, applying these methods to real-world editing encounters two significant challenges: (1) the rapid increase in GPU memory demand as the number of frames grows, and (2)…

Computer Vision and Pattern Recognition · Computer Science 2024-03-12 Shuzhou Yang , Chong Mou , Jiwen Yu , Yuhan Wang , Xiandong Meng , Jian Zhang

We propose a method for editing NeRF scenes with text-instructions. Given a NeRF of a scene and the collection of images used to reconstruct it, our method uses an image-conditioned diffusion model (InstructPix2Pix) to iteratively edit the…

Computer Vision and Pattern Recognition · Computer Science 2023-06-02 Ayaan Haque , Matthew Tancik , Alexei A. Efros , Aleksander Holynski , Angjoo Kanazawa

We introduce ViCA-NeRF, the first view-consistency-aware method for 3D editing with text instructions. In addition to the implicit neural radiance field (NeRF) modeling, our key insight is to exploit two sources of regularization that…

Computer Vision and Pattern Recognition · Computer Science 2024-02-02 Jiahua Dong , Yu-Xiong Wang

We address the task of view synthesis, generating novel views of a scene given a set of images as input. In many recent works such as NeRF (Mildenhall et al., 2020), the scene geometry is parameterized using neural implicit representations…

Computer Vision and Pattern Recognition · Computer Science 2023-03-08 Yiming Zuo , Jia Deng

Neural Radiance Fields (NeRF) have received considerable attention recently, due to its impressive capability in photo-realistic 3D reconstruction and novel view synthesis, given a set of posed camera images. Earlier work usually assumes…

Computer Vision and Pattern Recognition · Computer Science 2023-06-27 Peng Wang , Lingzhe Zhao , Ruijie Ma , Peidong Liu

We propose InNeRF360, an automatic system that accurately removes text-specified objects from 360-degree Neural Radiance Fields (NeRF). The challenge is to effectively remove objects while inpainting perceptually consistent content for the…

Computer Vision and Pattern Recognition · Computer Science 2024-03-27 Dongqing Wang , Tong Zhang , Alaa Abboud , Sabine Süsstrunk

Neural Radiance Fields (NeRFs) have proven to be powerful 3D representations, capable of high quality novel view synthesis of complex scenes. While NeRFs have been applied to graphics, vision, and robotics, problems with slow rendering…

Computer Vision and Pattern Recognition · Computer Science 2023-10-30 Tristan Aumentado-Armstrong , Ashkan Mirzaei , Marcus A. Brubaker , Jonathan Kelly , Alex Levinshtein , Konstantinos G. Derpanis , Igor Gilitschenski

3D modeling holds significant importance in the realms of AR/VR and gaming, allowing for both artistic creativity and practical applications. However, the process is often time-consuming and demands a high level of skill. In this paper, we…

Computer Vision and Pattern Recognition · Computer Science 2024-02-28 Eddy Chu , Yiyang Chen , Chedy Raissi , Anand Bhojan

The emergence of Neural Radiance Fields (NeRF) has greatly impacted 3D scene modeling and novel-view synthesis. As a kind of visual media for 3D scene representation, compression with high rate-distortion performance is an eternal target.…

Computer Vision and Pattern Recognition · Computer Science 2024-04-04 Sicheng Li , Hao Li , Yiyi Liao , Lu Yu