English
Related papers

Related papers: RoGUENeRF: A Robust Geometry-Consistent Universal …

200 papers

Neural radiance fields (NeRF) is a promising approach for generating photorealistic images and representing complex scenes. However, when processing data sequentially, it can suffer from catastrophic forgetting, where previous data is…

Computer Vision and Pattern Recognition · Computer Science 2023-12-12 Letian Zhang , Ming Li , Chen Chen , Jie Xu

Photo-realistic neural reconstruction and rendering of the human portrait are critical for numerous VR/AR applications. Still, existing solutions inherently rely on multi-view capture settings, and the one-shot solution to get rid of the…

Computer Vision and Pattern Recognition · Computer Science 2021-05-17 Ziyu Wang , Liao Wang , Fuqiang Zhao , Minye Wu , Lan Xu , Jingyi Yu

Under good conditions, Neural Radiance Fields (NeRFs) have shown impressive results on novel view synthesis tasks. NeRFs learn a scene's color and density fields by minimizing the photometric discrepancy between training views and…

Computer Vision and Pattern Recognition · Computer Science 2023-11-09 Jamie Wynn , Daniyar Turmukhambetov

The rendering procedure used by neural radiance fields (NeRF) samples a scene with a single ray per pixel and may therefore produce renderings that are excessively blurred or aliased when training or testing images observe scene content at…

Computer Vision and Pattern Recognition · Computer Science 2021-08-17 Jonathan T. Barron , Ben Mildenhall , Matthew Tancik , Peter Hedman , Ricardo Martin-Brualla , Pratul P. Srinivasan

Neural scene representations, such as Neural Radiance Fields (NeRF), are based on training a multilayer perceptron (MLP) using a set of color images with known poses. An increasing number of devices now produce RGB-D(color + depth)…

Computer Vision and Pattern Recognition · Computer Science 2022-11-08 Arnab Dey , Yassine Ahmine , Andrew I. Comport

Recent advancements in implicit neural representations have contributed to high-fidelity surface reconstruction and photorealistic novel view synthesis. However, the computational complexity inherent in these methodologies presents a…

Computer Vision and Pattern Recognition · Computer Science 2023-10-24 Yiying Yang , Wen Liu , Fukun Yin , Xin Chen , Gang Yu , Jiayuan Fan , Tao Chen

The widespread adoption of implicit neural representations, especially Neural Radiance Fields (NeRF), highlights a growing need for editing capabilities in implicit 3D models, essential for tasks like scene post-processing and 3D content…

Computer Vision and Pattern Recognition · Computer Science 2024-02-22 Zhentao Huang , Yukun Shi , Neil Bruce , Minglun Gong

This paper presents a novel approach for sparse 3D reconstruction by leveraging the expressive power of Neural Radiance Fields (NeRFs) and fast transfer of their features to learn accurate occupancy fields. Existing 3D reconstruction…

Computer Vision and Pattern Recognition · Computer Science 2024-10-01 Shubhendu Jena , Franck Multon , Adnane Boukhayma

Neural radiance fields (NeRF) shows powerful performance in novel view synthesis and 3D geometry reconstruction, but it suffers from critical performance degradation when the number of known viewpoints is drastically reduced. Existing works…

Computer Vision and Pattern Recognition · Computer Science 2023-09-26 Jiuhn Song , Seonghoon Park , Honggyu An , Seokju Cho , Min-Seop Kwak , Sungjin Cho , Seungryong Kim

4D reconstruction and rendering of human activities is critical for immersive VR/AR experience.Recent advances still fail to recover fine geometry and texture results with the level of detail present in the input images from sparse…

Computer Vision and Pattern Recognition · Computer Science 2021-03-16 Xin Suo , Yuheng Jiang , Pei Lin , Yingliang Zhang , Kaiwen Guo , Minye Wu , Lan Xu

Neural Radiance Field (NeRF) is a popular method in data-driven 3D reconstruction. Given its simplicity and high quality rendering, many NeRF applications are being developed. However, NeRF's big limitation is its slow speed. Many attempts…

Computer Vision and Pattern Recognition · Computer Science 2021-11-29 Naruya Kondo , Yuya Ikeda , Andrea Tagliasacchi , Yutaka Matsuo , Yoichi Ochiai , Shixiang Shane Gu

Neural Radiance Fields (NeRF) have been proposed for photorealistic novel view rendering. However, it requires many different views of one scene for training. Moreover, it has poor generalizations to new scenes and requires retraining or…

Computer Vision and Pattern Recognition · Computer Science 2023-05-12 Yurui Chen , Chun Gu , Feihu Zhang , Li Zhang

Neural radiance fields (NeRFs) have emerged as an effective method for novel-view synthesis and 3D scene reconstruction. However, conventional training methods require access to all training views during scene optimization. This assumption…

Computer Vision and Pattern Recognition · Computer Science 2023-09-07 Ryan Po , Zhengyang Dong , Alexander W. Bergman , Gordon Wetzstein

Obtaining high-quality 3D reconstructions of room-scale scenes is of paramount importance for upcoming applications in AR or VR. These range from mixed reality applications for teleconferencing, virtual measuring, virtual room planing, to…

Computer Vision and Pattern Recognition · Computer Science 2022-03-16 Dejan Azinović , Ricardo Martin-Brualla , Dan B Goldman , Matthias Nießner , Justus Thies

Existing methods for relightable view synthesis -- using a set of images of an object under unknown lighting to recover a 3D representation that can be rendered from novel viewpoints under a target illumination -- are based on inverse…

Computer Vision and Pattern Recognition · Computer Science 2024-11-05 Xiaoming Zhao , Pratul P. Srinivasan , Dor Verbin , Keunhong Park , Ricardo Martin Brualla , Philipp Henzler

This paper addresses the limitations of neural rendering-based multi-view surface reconstruction methods, which require an additional mesh extraction step that is inconvenient and would produce poor-quality surfaces with mesh aliasing,…

Computer Vision and Pattern Recognition · Computer Science 2025-08-26 Qitong Zhang , Jieqing Feng

In recent years, the development of Neural Radiance Fields has enabled a previously unseen level of photo-realistic 3D reconstruction of scenes and objects from multi-view camera data. However, previous methods use an oversimplified pinhole…

Computer Vision and Pattern Recognition · Computer Science 2024-06-18 Yi Hua , Christoph Lassner , Carsten Stoll , Iain Matthews

Many real-world 3D reconstruction applications demand photorealism and metric accuracy across unbounded, complex scenes with challenging lighting and imperfect captures that current Neural Radiance Field (NeRF) pipelines only partly…

Computer Vision and Pattern Recognition · Computer Science 2026-05-28 Vladislav Polianskii , Elijs Dima , Isabel Salmerón Marazuela , Gergő László Nagy , Sigurdur Sverrisson , Volodya Grancharov

Novel view synthesis aims to generate new view images of a given view image collection. Recent attempts address this problem relying on 3D geometry priors (e.g., shapes, sizes, and positions) learned from multi-view images. However, such…

Computer Vision and Pattern Recognition · Computer Science 2024-04-12 Zixiong Huang , Qi Chen , Libo Sun , Yifan Yang , Naizhou Wang , Mingkui Tan , Qi Wu

Texture synthesis is a fundamental problem in computer graphics that would benefit various applications. Existing methods are effective in handling 2D image textures. In contrast, many real-world textures contain meso-structure in the 3D…

Computer Vision and Pattern Recognition · Computer Science 2024-12-16 Yi-Hua Huang , Yan-Pei Cao , Yu-Kun Lai , Ying Shan , Lin Gao