English
Related papers

Related papers: Reference-guided Controllable Inpainting of Neural…

200 papers

This paper proposes NeuralEditor that enables neural radiance fields (NeRFs) natively editable for general shape editing tasks. Despite their impressive results on novel-view synthesis, it remains a fundamental challenge for NeRFs to edit…

Computer Vision and Pattern Recognition · Computer Science 2023-05-05 Jun-Kun Chen , Jipeng Lyu , Yu-Xiong Wang

With dense inputs, Neural Radiance Fields (NeRF) is able to render photo-realistic novel views under static conditions. Although the synthesis quality is excellent, existing NeRF-based methods fail to obtain moderate three-dimensional (3D)…

Computer Vision and Pattern Recognition · Computer Science 2024-02-21 Shu Chen , Junyao Li , Yang Zhang , Beiji Zou

Neural volumetric representations such as Neural Radiance Fields (NeRF) have emerged as a compelling technique for learning to represent 3D scenes from images with the goal of rendering photorealistic images of the scene from unobserved…

Computer Vision and Pattern Recognition · Computer Science 2021-03-29 Peter Hedman , Pratul P. Srinivasan , Ben Mildenhall , Jonathan T. Barron , Paul Debevec

Recent methods for synthesizing 3D-aware face images have achieved rapid development thanks to neural radiance fields, allowing for high quality and fast inference speed. However, existing solutions for editing facial geometry and…

Graphics · Computer Science 2022-11-16 Kaiwen Jiang , Shu-Yu Chen , Feng-Lin Liu , Hongbo Fu , Lin Gao

Recent advances in Neural Radiance Fields (NeRFs) have made it possible to reconstruct and reanimate dynamic portrait scenes with control over head-pose, facial expressions and viewing direction. However, training such models assumes…

Computer Vision and Pattern Recognition · Computer Science 2023-09-22 ShahRukh Athar , Zhixin Shu , Zexiang Xu , Fujun Luan , Sai Bi , Kalyan Sunkavalli , Dimitris Samaras

Novel view synthesis of satellite images holds a wide range of practical applications. While recent advances in the Neural Radiance Field have predominantly targeted pin-hole cameras, and models for satellite cameras often demand sufficient…

Computer Vision and Pattern Recognition · Computer Science 2023-10-12 Tongtong Zhang , Yuanxiang Li

Novel view synthesis is a long-standing problem. In this work, we consider a variant of the problem where we are given only a few context views sparsely covering a scene or an object. The goal is to predict novel viewpoints in the scene,…

Computer Vision and Pattern Recognition · Computer Science 2022-07-22 Jonáš Kulhánek , Erik Derner , Torsten Sattler , Robert Babuška

We present a method for estimating neural scenes representations of objects given only a single image. The core of our method is the estimation of a geometric scaffold for the object and its use as a guide for the reconstruction of the…

Computer Vision and Pattern Recognition · Computer Science 2021-06-24 Konstantinos Rematas , Ricardo Martin-Brualla , Vittorio Ferrari

3D facial avatar reconstruction has been a significant research topic in computer graphics and computer vision, where photo-realistic rendering and flexible controls over poses and expressions are necessary for many related applications.…

Computer Vision and Pattern Recognition · Computer Science 2023-07-10 Wangbo Yu , Yanbo Fan , Yong Zhang , Xuan Wang , Fei Yin , Yunpeng Bai , Yan-Pei Cao , Ying Shan , Yang Wu , Zhongqian Sun , Baoyuan Wu

This paper presents one of the first learning-based NeRF 3D instance segmentation pipelines, dubbed as Instance Neural Radiance Field, or Instance NeRF. Taking a NeRF pretrained from multi-view RGB images as input, Instance NeRF can learn…

Computer Vision and Pattern Recognition · Computer Science 2023-09-06 Yichen Liu , Benran Hu , Junkai Huang , Yu-Wing Tai , Chi-Keung Tang

We propose a novel Neural Radiance Field (NeRF) representation for non-opaque scenes that enables fast inference by utilizing textured polygons. Despite the high-quality novel view rendering that NeRF provides, a critical limitation is that…

Graphics · Computer Science 2024-07-11 Gopal Sharma , Daniel Rebain , Kwang Moo Yi , Andrea Tagliasacchi

Radiance fields have gradually become a main representation of media. Although its appearance editing has been studied, how to achieve view-consistent recoloring in an efficient manner is still under explored. We present RecolorNeRF, a…

Computer Vision and Pattern Recognition · Computer Science 2023-09-19 Bingchen Gong , Yuehao Wang , Xiaoguang Han , Qi Dou

Neural radiance field (NeRF) enables the synthesis of cutting-edge realistic novel view images of a 3D scene. It includes density and color fields to model the shape and radiance of a scene, respectively. Supervised by the photometric loss…

Computer Vision and Pattern Recognition · Computer Science 2023-12-21 Qihang Fang , Yafei Song , Keqiang Li , Liefeng Bo

Since the advent of Neural Radiance Fields, novel view synthesis has received tremendous attention. The existing approach for the generalization of radiance field reconstruction primarily constructs an encoding volume from nearby source…

Computer Vision and Pattern Recognition · Computer Science 2023-08-09 Jingliang Li , Qiang Zhou , Chaohui Yu , Zhengda Lu , Jun Xiao , Zhibin Wang , Fan Wang

NeRF is a popular model that efficiently represents 3D objects from 2D images. However, vanilla NeRF has some important limitations. NeRF must be trained on each object separately. The training time is long since we encode the object's…

Computer Vision and Pattern Recognition · Computer Science 2025-03-20 Dominik Zimny , Artur Kasymov , Adam Kania , Jacek Tabor , Maciej Zięba , Marcin Mazur , Przemysław Spurek

This paper presents a novel approach to inpainting 3D regions of a scene, given masked multi-view images, by distilling a 2D diffusion model into a learned 3D scene representation (e.g. a NeRF). Unlike 3D generative methods that explicitly…

Computer Vision and Pattern Recognition · Computer Science 2023-12-08 Kira Prabhu , Jane Wu , Lynn Tsai , Peter Hedman , Dan B Goldman , Ben Poole , Michael Broxton

A commonly observed failure mode of Neural Radiance Field (NeRF) is fitting incorrect geometries when given an insufficient number of input views. One potential reason is that standard volumetric rendering does not enforce the constraint…

Computer Vision and Pattern Recognition · Computer Science 2024-10-18 Kangle Deng , Andrew Liu , Jun-Yan Zhu , Deva Ramanan

Recently, a surge of 3D style transfer methods has been proposed that leverage the scene reconstruction power of a pre-trained neural radiance field (NeRF). To successfully stylize a scene this way, one must first reconstruct a…

Computer Vision and Pattern Recognition · Computer Science 2025-07-15 Y. Wang , A. Gao , Y. Gong , Y. Zeng

We present Non-Rigid Neural Radiance Fields (NR-NeRF), a reconstruction and novel view synthesis approach for general non-rigid dynamic scenes. Our approach takes RGB images of a dynamic scene as input (e.g., from a monocular video…

Computer Vision and Pattern Recognition · Computer Science 2021-08-24 Edgar Tretschk , Ayush Tewari , Vladislav Golyanik , Michael Zollhöfer , Christoph Lassner , Christian Theobalt

Simulating camera sensors is a crucial task in autonomous driving. Although neural radiance fields are exceptional at synthesizing photorealistic views in driving simulations, they still fail to generate extrapolated views. This paper…

Computer Vision and Pattern Recognition · Computer Science 2023-08-08 Chenming Wu , Jiadai Sun , Zhelun Shen , Liangjun Zhang