English
Related papers

Related papers: Inpaint4DNeRF: Promptable Spatio-Temporal NeRF Inp…

200 papers

Image inpainting is the task of filling in missing or masked region of an image with semantically meaningful contents. Recent methods have shown significant improvement in dealing with large-scale missing regions. However, these methods…

Computer Vision and Pattern Recognition · Computer Science 2023-04-25 Wanglong Lu , Xianta Jiang , Xiaogang Jin , Yong-Liang Yang , Minglun Gong , Tao Wang , Kaijie Shi , Hanli Zhao

Neural radiance field (NeRF) is an emerging view synthesis method that samples points in a three-dimensional (3D) space and estimates their existence and color probabilities. The disadvantage of NeRF is that it requires a long training time…

Computer Vision and Pattern Recognition · Computer Science 2024-03-19 Hye Bin Yoo , Hyun Min Han , Sung Soo Hwang , Il Yong Chun

The ability to generate highly realistic 2D images from mere text prompts has recently made huge progress in terms of speed and quality, thanks to the advent of image diffusion models. Naturally, the question arises if this can be also…

Computer Vision and Pattern Recognition · Computer Science 2023-04-26 Christina Tsalicoglou , Fabian Manhardt , Alessio Tonioni , Michael Niemeyer , Federico Tombari

We present a method, Neural Radiance Flow (NeRFlow),to learn a 4D spatial-temporal representation of a dynamic scene from a set of RGB images. Key to our approach is the use of a neural implicit representation that learns to capture the 3D…

Computer Vision and Pattern Recognition · Computer Science 2021-09-07 Yilun Du , Yinan Zhang , Hong-Xing Yu , Joshua B. Tenenbaum , Jiajun Wu

Neural Radiance Fields (NeRF) has gained significant attention for its prominent implicit 3D representation and realistic novel view synthesis capabilities. Available works unexceptionally employ straight-line volume rendering, which…

Graphics · Computer Science 2025-08-20 Nan Luo , Chenglin Ye , Jiaxu Li , Gang Liu , Bo Wan , Di Wang , Lupeng Liu , Jun Xiao

Recent advances in diffusion models such as ControlNet have enabled geometrically controllable, high-fidelity text-to-image generation. However, none of them addresses the question of adding such controllability to text-to-3D generation. In…

Computer Vision and Pattern Recognition · Computer Science 2023-09-08 Sungwon Hwang , Junha Hyung , Jaegul Choo

Recent advances in generative visual models and neural radiance fields have greatly boosted 3D-aware image synthesis and stylization tasks. However, previous NeRF-based work is limited to single scene stylization, training a model to…

Computer Vision and Pattern Recognition · Computer Science 2024-04-29 Zichen Tang , Hongyu Yang

NeRF (Neural Radiance Fields) has demonstrated tremendous potential in novel view synthesis and 3D reconstruction, but its performance is sensitive to input image quality, which struggles to achieve high-fidelity rendering when provided…

Computer Vision and Pattern Recognition · Computer Science 2024-04-09 Zhongkai Wu , Ziyu Wan , Jing Zhang , Jing Liao , Dong Xu

Probabilistic diffusion models have achieved state-of-the-art results for image synthesis, inpainting, and text-to-image tasks. However, they are still in the early stages of generating complex 3D shapes. This work proposes Diffusion-SDF, a…

Computer Vision and Pattern Recognition · Computer Science 2023-03-17 Gene Chou , Yuval Bahat , Felix Heide

Recent advances in Neural Radiance Fields (NeRFs) have made it possible to reconstruct and reanimate dynamic portrait scenes with control over head-pose, facial expressions and viewing direction. However, training such models assumes…

Computer Vision and Pattern Recognition · Computer Science 2023-09-22 ShahRukh Athar , Zhixin Shu , Zexiang Xu , Fujun Luan , Sai Bi , Kalyan Sunkavalli , Dimitris Samaras

Neural radiance fields (NeRFs) are able to synthesize realistic novel views from multi-view images captured from distinct positions and perspectives. In NeRF's rendering pipeline, neural networks are used to represent a scene independently…

Computer Vision and Pattern Recognition · Computer Science 2023-06-01 Kang Han , Wei Xiang , Lu Yu

Editing a local region or a specific object in a 3D scene represented by a NeRF or consistently blending a new realistic object into the scene is challenging, mainly due to the implicit nature of the scene representation. We present…

Computer Vision and Pattern Recognition · Computer Science 2024-07-17 Ori Gordon , Omri Avrahami , Dani Lischinski

A neural radiance field (NeRF) is a scene model supporting high-quality view synthesis, optimized per scene. In this paper, we explore enabling user editing of a category-level NeRF - also known as a conditional radiance field - trained on…

Computer Vision and Pattern Recognition · Computer Science 2021-06-07 Steven Liu , Xiuming Zhang , Zhoutong Zhang , Richard Zhang , Jun-Yan Zhu , Bryan Russell

3D reconstruction methods such as Neural Radiance Fields (NeRFs) excel at rendering photorealistic novel views of complex scenes. However, recovering a high-quality NeRF typically requires tens to hundreds of input images, resulting in a…

Computer Vision and Pattern Recognition · Computer Science 2023-12-06 Rundi Wu , Ben Mildenhall , Philipp Henzler , Keunhong Park , Ruiqi Gao , Daniel Watson , Pratul P. Srinivasan , Dor Verbin , Jonathan T. Barron , Ben Poole , Aleksander Holynski

This paper introduces innovative solutions to enhance spatial controllability in diffusion models reliant on text queries. We first introduce vision guidance as a foundational spatial cue within the perturbed distribution. This…

Computer Vision and Pattern Recognition · Computer Science 2024-12-02 Zipeng Qi , Guoxi Huang , Chenyang Liu , Fei Ye

Neural Radiance Field (NeRF) has shown remarkable performance in novel view synthesis but requires numerous multi-view images, limiting its practicality in few-shot scenarios. Ray augmentation has been proposed to alleviate overfitting…

Computer Vision and Pattern Recognition · Computer Science 2025-08-07 Ingyun Lee , Jae Won Jang , Seunghyeon Seo , Nojun Kwak

Impressive progress in generative models and implicit representations gave rise to methods that can generate 3D shapes of high quality. However, being able to locally control and edit shapes is another essential property that can unlock…

Computer Vision and Pattern Recognition · Computer Science 2023-03-22 Konstantinos Tertikas , Despoina Paschalidou , Boxiao Pan , Jeong Joon Park , Mikaela Angelina Uy , Ioannis Emiris , Yannis Avrithis , Leonidas Guibas

Image inpainting aims to restore the missing regions of corrupted images and make the recovery result identical to the originally complete image, which is different from the common generative task emphasizing the naturalness or realism of…

Computer Vision and Pattern Recognition · Computer Science 2021-10-19 Qing Guo , Xiaoguang Li , Felix Juefei-Xu , Hongkai Yu , Yang Liu , Song wang

Neural radiance fields (NeRF) have revolutionized photorealistic rendering of novel views for 3D scenes. Despite their growing popularity and efficiency as 3D resources, NeRFs face scalability challenges due to the need for separate models…

Computer Vision and Pattern Recognition · Computer Science 2025-08-27 Prajwal Singh , Ashish Tiwari , Gautam Vashishtha , Shanmuganathan Raman

Neural Radiance Fields (NeRFs) have shown remarkable success in synthesizing photorealistic views from multi-view images of static scenes, but face challenges in dynamic, real-world environments with distractors like moving objects,…

Computer Vision and Pattern Recognition · Computer Science 2024-06-04 Weining Ren , Zihan Zhu , Boyang Sun , Jiaqi Chen , Marc Pollefeys , Songyou Peng