中文
相关论文

相关论文: SUDS: Scalable Urban Dynamic Scenes

200 篇论文

The success of the Neural Radiance Fields (NeRFs) for modeling and free-view rendering static objects has inspired numerous attempts on dynamic scenes. Current techniques that utilize neural rendering for facilitating free-view videos…

计算机视觉与模式识别 · 计算机科学 2023-06-16 Liao Wang , Qiang Hu , Qihan He , Ziyu Wang , Jingyi Yu , Tinne Tuytelaars , Lan Xu , Minye Wu

Dynamic Neural Radiance Fields (NeRFs) achieve remarkable visual quality when synthesizing novel views of time-evolving 3D scenes. However, the common reliance on backward deformation fields makes reanimation of the captured object poses…

计算机视觉与模式识别 · 计算机科学 2024-02-12 Lukas Uzolas , Elmar Eisemann , Petr Kellnhofer

Purely MLP-based neural radiance fields (NeRF-based methods) often suffer from underfitting with blurred renderings on large-scale scenes due to limited model capacity. Recent approaches propose to geographically divide the scene and adopt…

计算机视觉与模式识别 · 计算机科学 2023-03-27 Linning Xu , Yuanbo Xiangli , Sida Peng , Xingang Pan , Nanxuan Zhao , Christian Theobalt , Bo Dai , Dahua Lin

Obtaining high-quality 3D reconstructions of room-scale scenes is of paramount importance for upcoming applications in AR or VR. These range from mixed reality applications for teleconferencing, virtual measuring, virtual room planing, to…

计算机视觉与模式识别 · 计算机科学 2022-03-16 Dejan Azinović , Ricardo Martin-Brualla , Dan B Goldman , Matthias Nießner , Justus Thies

3D reconstruction from a single 2D image was extensively covered in the literature but relies on depth supervision at training time, which limits its applicability. To relax the dependence to depth we propose SceneRF, a self-supervised…

计算机视觉与模式识别 · 计算机科学 2023-08-28 Anh-Quan Cao , Raoul de Charette

Neural Radiance Fields (NeRF) have emerged as a paradigm-shifting methodology for the photorealistic rendering of objects and environments, enabling the synthesis of novel viewpoints with remarkable fidelity. This is accomplished through…

计算机视觉与模式识别 · 计算机科学 2024-04-09 Peng Tu , Xun Zhou , Mingming Wang , Xiaojun Yang , Bo Peng , Ping Chen , Xiu Su , Yawen Huang , Yefeng Zheng , Chang Xu

Neural Radiance Fields (NeRF) enable 3D scene reconstruction from 2D images and camera poses for Novel View Synthesis (NVS). Although NeRF can produce photorealistic results, it often suffers from overfitting to training views, leading to…

计算机视觉与模式识别 · 计算机科学 2023-11-07 Fusang Wang , Arnaud Louys , Nathan Piasco , Moussab Bennehar , Luis Roldão , Dzmitry Tsishkou

Neural Radiance Fields (NeRF) is a novel implicit 3D reconstruction method that shows immense potential and has been gaining increasing attention. It enables the reconstruction of 3D scenes solely from a set of photographs. However, its…

计算机视觉与模式识别 · 计算机科学 2023-10-23 Jiaming Gu , Minchao Jiang , Hongsheng Li , Xiaoyuan Lu , Guangming Zhu , Syed Afaq Ali Shah , Liang Zhang , Mohammed Bennamoun

We present a neural radiance field method for urban-scale semantic and building-level instance segmentation from aerial images by lifting noisy 2D labels to 3D. This is a challenging problem due to two primary reasons. Firstly, objects in…

计算机视觉与模式识别 · 计算机科学 2024-03-19 Yuqi Zhang , Guanying Chen , Jiaxing Chen , Shuguang Cui

Extensions of Neural Radiance Fields (NeRFs) to model dynamic scenes have enabled their near photo-realistic, free-viewpoint rendering. Although these methods have shown some potential in creating immersive experiences, two drawbacks limit…

计算机视觉与模式识别 · 计算机科学 2024-06-07 Xinhang Liu , Yu-Wing Tai , Chi-Keung Tang , Pedro Miraldo , Suhas Lohit , Moitreya Chatterjee

We present neural radiance fields for rendering and temporal (4D) reconstruction of humans in motion (H-NeRF), as captured by a sparse set of cameras or even from a monocular video. Our approach combines ideas from neural scene…

计算机视觉与模式识别 · 计算机科学 2021-11-03 Hongyi Xu , Thiemo Alldieck , Cristian Sminchisescu

Neural reconstruction models for autonomous driving simulation have made significant strides in recent years, with dynamic models becoming increasingly prevalent. However, these models are typically limited to handling in-domain objects…

3D reconstruction methods such as Neural Radiance Fields (NeRFs) excel at rendering photorealistic novel views of complex scenes. However, recovering a high-quality NeRF typically requires tens to hundreds of input images, resulting in a…

Neural radiance fields (NeRFs) have become a ubiquitous tool for modeling scene appearance and geometry from multiview imagery. Recent work has also begun to explore how to use additional supervision from lidar or depth sensor measurements…

计算机视觉与模式识别 · 计算机科学 2024-04-09 Anagh Malik , Parsa Mirdehghan , Sotiris Nousias , Kiriakos N. Kutulakos , David B. Lindell

Neural rendering can be used to reconstruct implicit representations of shapes without 3D supervision. However, current neural surface reconstruction methods have difficulty learning high-frequency geometry details, so the reconstructed…

计算机视觉与模式识别 · 计算机科学 2022-09-23 Yiqun Wang , Ivan Skorokhodov , Peter Wonka

3D surface reconstruction from images is essential for numerous applications. Recently, Neural Radiance Fields (NeRFs) have emerged as a promising framework for 3D modeling. However, NeRFs require accurate camera poses as input, and…

计算机视觉与模式识别 · 计算机科学 2024-07-18 Yiyang Chen , Siyan Dong , Xulong Wang , Lulu Cai , Youyi Zheng , Yanchao Yang

Recent methods for neural surface representation and rendering, for example NeuS, have demonstrated the remarkably high-quality reconstruction of static scenes. However, the training of NeuS takes an extremely long time (8 hours), which…

计算机视觉与模式识别 · 计算机科学 2023-11-20 Yiming Wang , Qin Han , Marc Habermann , Kostas Daniilidis , Christian Theobalt , Lingjie Liu

Reasoning the 3D structure of a non-rigid dynamic scene from a single moving camera is an under-constrained problem. Inspired by the remarkable progress of neural radiance fields (NeRFs) in photo-realistic novel view synthesis of static…

计算机视觉与模式识别 · 计算机科学 2023-03-28 Sameera Ramasinghe , Violetta Shevchenko , Gil Avraham , Anton Van Den Hengel

In this study, we introduce BirdNeRF, an adaptation of Neural Radiance Fields (NeRF) designed specifically for reconstructing large-scale scenes using aerial imagery. Unlike previous research focused on small-scale and object-centric NeRF…

计算机视觉与模式识别 · 计算机科学 2024-02-13 Huiqing Zhang , Yifei Xue , Ming Liao , Yizhen Lao

Photorealistic simulation plays a crucial role in applications such as autonomous driving, where advances in neural radiance fields (NeRFs) may allow better scalability through the automatic creation of digital 3D assets. However,…

计算机视觉与模式识别 · 计算机科学 2024-05-07 Shanlin Sun , Bingbing Zhuang , Ziyu Jiang , Buyu Liu , Xiaohui Xie , Manmohan Chandraker