中文
相关论文

相关论文: NeuLF: Efficient Novel View Synthesis with Neural …

200 篇论文

We present an efficient neural 3D scene representation for novel-view synthesis (NVS) in large-scale, dynamic urban areas. Existing works are not well suited for applications like mixed-reality or closed-loop simulation due to their limited…

计算机视觉与模式识别 · 计算机科学 2024-11-26 Tobias Fischer , Jonas Kulhanek , Samuel Rota Bulò , Lorenzo Porzi , Marc Pollefeys , Peter Kontschieder

Talking head generation based on the neural radiation fields model has shown promising visual effects. However, the slow rendering speed of NeRF seriously limits its application, due to the burdensome calculation process over hundreds of…

计算机视觉与模式识别 · 计算机科学 2024-06-18 Niu Guanchen

Taking an image of an object is at its core a lossy process. The rich information about the three-dimensional structure of the world is flattened to an image plane and decisions such as viewpoint and camera parameters are final and not…

计算机视觉与模式识别 · 计算机科学 2016-08-16 Konstantinos Rematas , Chuong Nguyen , Tobias Ritschel , Mario Fritz , Tinne Tuytelaars

In this paper, we address the challenge of generating novel views of real-world objects with limited multi-view images through our proposed approach, FewShotNeRF. Our method utilizes meta-learning to acquire optimal initialization,…

计算机视觉与模式识别 · 计算机科学 2024-08-12 Piraveen Sivakumar , Paul Janson , Jathushan Rajasegaran , Thanuja Ambegoda

We introduce a scalable framework for novel view synthesis from RGB-D images with largely incomplete scene coverage. While generative neural approaches have demonstrated spectacular results on 2D images, they have not yet achieved similar…

计算机视觉与模式识别 · 计算机科学 2022-07-26 Zuoyue Li , Tianxing Fan , Zhenqiang Li , Zhaopeng Cui , Yoichi Sato , Marc Pollefeys , Martin R. Oswald

We propose DistillNeRF, a self-supervised learning framework addressing the challenge of understanding 3D environments from limited 2D observations in outdoor autonomous driving scenes. Our method is a generalizable feedforward model that…

计算机视觉与模式识别 · 计算机科学 2024-11-01 Letian Wang , Seung Wook Kim , Jiawei Yang , Cunjun Yu , Boris Ivanovic , Steven L. Waslander , Yue Wang , Sanja Fidler , Marco Pavone , Peter Karkus

Neural Radiance Fields (NeRF) have transformed novel view synthesis by modeling scene-specific volumetric representations directly from images. While generalizable NeRF models can generate novel views across unknown scenes by learning…

计算机视觉与模式识别 · 计算机科学 2025-05-27 You Wang , Li Fang , Hao Zhu , Fei Hu , Long Ye , Zhan Ma

We present a novel Relightable Neural Renderer (RNR) for simultaneous view synthesis and relighting using multi-view image inputs. Existing neural rendering (NR) does not explicitly model the physical rendering process and hence has limited…

计算机视觉与模式识别 · 计算机科学 2020-06-16 Zhang Chen , Anpei Chen , Guli Zhang , Chengyuan Wang , Yu Ji , Kiriakos N. Kutulakos , Jingyi Yu

With the introduction of Neural Radiance Fields (NeRFs), novel view synthesis has recently made a big leap forward. At the core, NeRF proposes that each 3D point can emit radiance, allowing to conduct view synthesis using differentiable…

计算机视觉与模式识别 · 计算机科学 2023-03-17 Marie-Julie Rakotosaona , Fabian Manhardt , Diego Martin Arroyo , Michael Niemeyer , Abhijit Kundu , Federico Tombari

Simultaneously achieving 3D reconstruction and new view synthesis for indoor environments has widespread applications but is technically very challenging. State-of-the-art methods based on implicit neural functions can achieve excellent 3D…

计算机视觉与模式识别 · 计算机科学 2024-07-22 Zhenyu Bao , Guibiao Liao , Zhongyuan Zhao , Kanglin Liu , Qing Li , Guoping Qiu

Multi-View Stereo (MVS) is a core task in 3D computer vision. With the surge of novel deep learning methods, learned MVS has surpassed the accuracy of classical approaches, but still relies on building a memory intensive dense cost volume.…

计算机视觉与模式识别 · 计算机科学 2022-06-16 Radu Alexandru Rosu , Sven Behnke

Neural radiance fields (NeRFs) have emerged as an effective method for novel-view synthesis and 3D scene reconstruction. However, conventional training methods require access to all training views during scene optimization. This assumption…

计算机视觉与模式识别 · 计算机科学 2023-09-07 Ryan Po , Zhengyang Dong , Alexander W. Bergman , Gordon Wetzstein

Neural Radiance Fields (NeRF) are able to reconstruct scenes with unprecedented fidelity, and various recent works have extended NeRF to handle dynamic scenes. A common approach to reconstruct such non-rigid scenes is through the use of a…

计算机视觉与模式识别 · 计算机科学 2021-09-13 Keunhong Park , Utkarsh Sinha , Peter Hedman , Jonathan T. Barron , Sofien Bouaziz , Dan B Goldman , Ricardo Martin-Brualla , Steven M. Seitz

Neural radiance fields (NeRF) show great success in novel view synthesis. However, in real-world scenes, recovering high-quality details from the source images is still challenging for the existing NeRF-based approaches, due to the…

计算机视觉与模式识别 · 计算机科学 2023-03-23 Kun Zhou , Wenbo Li , Yi Wang , Tao Hu , Nianjuan Jiang , Xiaoguang Han , Jiangbo Lu

Dynamic neural radiance fields (dynamic NeRFs) have demonstrated impressive results in novel view synthesis on 3D dynamic scenes. However, they often require complete video sequences for training followed by novel view synthesis, which is…

计算机视觉与模式识别 · 计算机科学 2023-05-25 Zhiwen Yan , Chen Li , Gim Hee Lee

We propose a learning-based approach for novel view synthesis for multi-camera 360$^{\circ}$ panorama capture rigs. Previous work constructs RGBD panoramas from such data, allowing for view synthesis with small amounts of translation, but…

计算机视觉与模式识别 · 计算机科学 2020-08-06 Kai-En Lin , Zexiang Xu , Ben Mildenhall , Pratul P. Srinivasan , Yannick Hold-Geoffroy , Stephen DiVerdi , Qi Sun , Kalyan Sunkavalli , Ravi Ramamoorthi

Recently, Neural Radiance Fields (NeRF) has shown promising performances on reconstructing 3D scenes and synthesizing novel views from a sparse set of 2D images. Albeit effective, the performance of NeRF is highly influenced by the quality…

计算机视觉与模式识别 · 计算机科学 2022-09-20 Xuran Pan , Zihang Lai , Shiji Song , Gao Huang

Implicit neural rendering techniques have shown promising results for novel view synthesis. However, existing methods usually encode the entire scene as a whole, which is generally not aware of the object identity and limits the ability to…

计算机视觉与模式识别 · 计算机科学 2021-09-07 Bangbang Yang , Yinda Zhang , Yinghao Xu , Yijin Li , Han Zhou , Hujun Bao , Guofeng Zhang , Zhaopeng Cui

We present a method that synthesizes novel views of complex scenes by interpolating a sparse set of nearby views. The core of our method is a network architecture that includes a multilayer perceptron and a ray transformer that estimates…

The field of novel view synthesis from images has seen rapid advancements with the introduction of Neural Radiance Fields (NeRF) and more recently with 3D Gaussian Splatting. Gaussian Splatting became widely adopted due to its efficiency…

计算机视觉与模式识别 · 计算机科学 2024-11-07 Ruihong Yin , Vladimir Yugay , Yue Li , Sezer Karaoglu , Theo Gevers