English
Related papers

Related papers: 3D Reconstruction with Generalizable Neural Fields…

200 papers

We present MVSNeRF, a novel neural rendering approach that can efficiently reconstruct neural radiance fields for view synthesis. Unlike prior works on neural radiance fields that consider per-scene optimization on densely captured images,…

Computer Vision and Pattern Recognition · Computer Science 2021-08-25 Anpei Chen , Zexiang Xu , Fuqiang Zhao , Xiaoshuai Zhang , Fanbo Xiang , Jingyi Yu , Hao Su

The field of self-supervised 3D representation learning has emerged as a promising solution to alleviate the challenge presented by the scarcity of extensive, well-annotated datasets. However, it continues to be hindered by the lack of…

Computer Vision and Pattern Recognition · Computer Science 2024-06-18 Yunsong Wang , Na Zhao , Gim Hee Lee

Novel view synthesis is a long-standing problem. In this work, we consider a variant of the problem where we are given only a few context views sparsely covering a scene or an object. The goal is to predict novel viewpoints in the scene,…

Computer Vision and Pattern Recognition · Computer Science 2022-07-22 Jonáš Kulhánek , Erik Derner , Torsten Sattler , Robert Babuška

This paper addresses the challenge of reconstructing 3D indoor scenes from multi-view images. Many previous works have shown impressive reconstruction results on textured objects, but they still have difficulty in handling low-textured…

Computer Vision and Pattern Recognition · Computer Science 2022-05-19 Haoyu Guo , Sida Peng , Haotong Lin , Qianqian Wang , Guofeng Zhang , Hujun Bao , Xiaowei Zhou

Applying NeRF to downstream perception tasks for scene understanding and representation is becoming increasingly popular. Most existing methods treat semantic prediction as an additional rendering task, \textit{i.e.}, the "label rendering"…

Computer Vision and Pattern Recognition · Computer Science 2024-04-09 Hao Li , Dingwen Zhang , Yalun Dai , Nian Liu , Lechao Cheng , Jingfeng Li , Jingdong Wang , Junwei Han

Neural radiance fields (NeRF) have achieved impressive performances in view synthesis by encoding neural representations of a scene. However, NeRFs require hundreds of images per scene to synthesize photo-realistic novel views. Training…

Computer Vision and Pattern Recognition · Computer Science 2023-09-15 Nagabhushan Somraj , Rajiv Soundararajan

Many learning-based approaches have difficulty scaling to unseen data, as the generality of its learned prior is limited to the scale and variations of the training samples. This holds particularly true with 3D learning tasks, given the…

Computer Vision and Pattern Recognition · Computer Science 2020-12-15 Mingyue Yang , Yuxin Wen , Weikai Chen , Yongwei Chen , Kui Jia

Neural radiance fields (NeRFs) have emerged as a prominent pre-training paradigm for vision-centric autonomous driving, which enhances 3D geometry and appearance understanding in a fully self-supervised manner. To apply NeRF-based…

Computer Vision and Pattern Recognition · Computer Science 2026-03-31 Hyeonjun Jeong , Juyeb Shin , Dongsuk Kum

Photo-realistic free-viewpoint rendering of real-world scenes using classical computer graphics techniques is challenging, because it requires the difficult step of capturing detailed appearance and geometry models. Recent studies have…

Computer Vision and Pattern Recognition · Computer Science 2021-01-08 Lingjie Liu , Jiatao Gu , Kyaw Zaw Lin , Tat-Seng Chua , Christian Theobalt

3D scene stylization aims at generating stylized images of the scene from arbitrary novel views following a given set of style examples, while ensuring consistency when rendered from different views. Directly applying methods for image or…

Graphics · Computer Science 2022-05-26 Yi-Hua Huang , Yue He , Yu-Jie Yuan , Yu-Kun Lai , Lin Gao

Reconstructing large-scale 3D scenes is essential for autonomous vehicles, especially when partial sensor data is lost. Although the recently developed neural radiance fields (NeRF) have shown compelling results in implicit representations,…

Computer Vision and Pattern Recognition · Computer Science 2023-10-03 Xiuzhong Hu , Guangming Xiong , Zheng Zang , Peng Jia , Yuxuan Han , Junyi Ma

While NeRF has shown great success for neural reconstruction and rendering, its limited MLP capacity and long per-scene optimization times make it challenging to model large-scale indoor scenes. In contrast, classical 3D reconstruction…

Computer Vision and Pattern Recognition · Computer Science 2022-03-23 Xiaoshuai Zhang , Sai Bi , Kalyan Sunkavalli , Hao Su , Zexiang Xu

Knowing the 3D motions in a dynamic scene is essential to many vision applications. Recent progress is mainly focused on estimating the activity of some specific elements like humans. In this paper, we leverage a neural motion field for…

Computer Vision and Pattern Recognition · Computer Science 2023-04-07 Liangchen Song , Xuan Gong , Benjamin Planche , Meng Zheng , David Doermann , Junsong Yuan , Terrence Chen , Ziyan Wu

Neural Radiance Fields (NeRFs) are a very recent and very popular approach for the problems of novel view synthesis and 3D reconstruction. A popular scene representation used by NeRFs is to combine a uniform, voxel-based subdivision of the…

Computer Vision and Pattern Recognition · Computer Science 2023-08-22 Jonas Kulhanek , Torsten Sattler

Neural Radiance Fields (NeRF) have emerged as a powerful approach for photorealistic 3D reconstruction from multi-view images. However, deploying NeRF for satellite imagery remains challenging. Each scene requires individual training, and…

Computer Vision and Pattern Recognition · Computer Science 2026-03-20 Devjyoti Chakraborty , Zaki Sukma , Rakandhiya D. Rachmanto , Kriti Ghosh , In Kee Kim , Suchendra M. Bhandarkar , Lakshmish Ramaswamy , Nancy K. O'Hare , Deepak Mishra

In recent years, the neural implicit surface has emerged as a powerful representation for multi-view surface reconstruction due to its simplicity and state-of-the-art performance. However, reconstructing smooth and detailed surfaces in…

Computer Vision and Pattern Recognition · Computer Science 2024-07-12 Yuting Xiao , Jingwei Xu , Zehao Yu , Shenghua Gao

Neural implicit 3D representations have emerged as a powerful paradigm for reconstructing surfaces from multi-view images and synthesizing novel views. Unfortunately, existing methods such as DVR or IDR require accurate per-pixel object…

Computer Vision and Pattern Recognition · Computer Science 2021-10-11 Michael Oechsle , Songyou Peng , Andreas Geiger

We study the problem of inferring an object-centric scene representation from a single image, aiming to derive a representation that explains the image formation process, captures the scene's 3D nature, and is learned without supervision.…

Computer Vision and Pattern Recognition · Computer Science 2022-03-17 Hong-Xing Yu , Leonidas J. Guibas , Jiajun Wu

Neural Radiance Fields (NeRF) face significant challenges in extreme few-shot scenarios, primarily due to overfitting and long training times. Existing methods, such as FreeNeRF and SparseNeRF, use frequency regularization or pre-trained…

Computer Vision and Pattern Recognition · Computer Science 2025-06-16 Chin-Yang Lin , Chung-Ho Wu , Chang-Han Yeh , Shih-Han Yen , Cheng Sun , Yu-Lun Liu

Neural Radiance Fields (NeRF) coupled with GANs represent a promising direction in the area of 3D reconstruction from a single view, owing to their ability to efficiently model arbitrary topologies. Recent work in this area, however, has…

Computer Vision and Pattern Recognition · Computer Science 2023-03-21 Dario Pavllo , David Joseph Tan , Marie-Julie Rakotosaona , Federico Tombari