English
Related papers

Related papers: Multi-Level Neural Scene Graphs for Dynamic Urban …

200 papers

Neural radiance field is an emerging rendering method that generates high-quality multi-view consistent images from a neural scene representation and volume rendering. Although neural radiance field-based techniques are robust for scene…

Computer Vision and Pattern Recognition · Computer Science 2024-04-02 Ka Chun Shum , Jaeyeon Kim , Binh-Son Hua , Duc Thanh Nguyen , Sai-Kit Yeung

Due to the complex and highly dynamic motions in the real world, synthesizing dynamic videos from multi-view inputs for arbitrary viewpoints is challenging. Previous works based on neural radiance field or 3D Gaussian splatting are limited…

Computer Vision and Pattern Recognition · Computer Science 2025-07-04 Jiahao Wu , Rui Peng , Jianbo Jiao , Jiayu Yang , Luyang Tang , Kaiqiang Xiong , Jie Liang , Jinbo Yan , Runling Liu , Ronggang Wang

Synthesizing free-view photo-realistic images is an important task in multimedia. With the development of advanced driver assistance systems~(ADAS) and their applications in autonomous vehicles, experimenting with different scenarios…

Computer Vision and Pattern Recognition · Computer Science 2022-05-13 Zhuopeng Li , Lu Li , Zeyu Ma , Ping Zhang , Junbo Chen , Jianke Zhu

Novel view synthesis (NVS) is a challenging task in computer vision that involves synthesizing new views of a scene from a limited set of input images. Neural Radiance Fields (NeRF) have emerged as a powerful approach to address this…

Computer Vision and Pattern Recognition · Computer Science 2023-03-16 Shuja Khalid , Frank Rudzicz

Simulating camera sensors is a crucial task in autonomous driving. Although neural radiance fields are exceptional at synthesizing photorealistic views in driving simulations, they still fail to generate extrapolated views. This paper…

Computer Vision and Pattern Recognition · Computer Science 2023-08-08 Chenming Wu , Jiadai Sun , Zhelun Shen , Liangjun Zhang

Dense 3D reconstruction has many applications in automated driving including automated annotation validation, multimodal data augmentation, providing ground truth annotations for systems lacking LiDAR, as well as enhancing auto-labeling…

Computer Vision and Pattern Recognition · Computer Science 2024-02-13 Shihao Shen , Louis Kerofsky , Varun Ravi Kumar , Senthil Yogamani

Neural Radiance Fields (NeRF) are able to reconstruct scenes with unprecedented fidelity, and various recent works have extended NeRF to handle dynamic scenes. A common approach to reconstruct such non-rigid scenes is through the use of a…

Computer Vision and Pattern Recognition · Computer Science 2021-09-13 Keunhong Park , Utkarsh Sinha , Peter Hedman , Jonathan T. Barron , Sofien Bouaziz , Dan B Goldman , Ricardo Martin-Brualla , Steven M. Seitz

We present a method to map 2D image observations of a scene to a persistent 3D scene representation, enabling novel view synthesis and disentangled representation of the movable and immovable components of the scene. Motivated by the…

Computer Vision and Pattern Recognition · Computer Science 2023-04-11 Prafull Sharma , Ayush Tewari , Yilun Du , Sergey Zakharov , Rares Ambrus , Adrien Gaidon , William T. Freeman , Fredo Durand , Joshua B. Tenenbaum , Vincent Sitzmann

Learning neural radiance fields of a scene has recently allowed realistic novel view synthesis of the scene, but they are limited to synthesize images under the original fixed lighting condition. Therefore, they are not flexible for the…

Computer Vision and Pattern Recognition · Computer Science 2021-10-26 Quan Zheng , Gurprit Singh , Hans-Peter Seidel

Neural radiance field (NeRF) attracts attention as a promising approach to reconstructing the 3D scene. As NeRF emerges, subsequent studies have been conducted to model dynamic scenes, which include motions or topological changes. However,…

Computer Vision and Pattern Recognition · Computer Science 2022-12-07 Hankyu Jang , Daeyoung Kim

Recent advances in Neural Radiance Fields (NeRF) have shown great potential in 3D reconstruction and novel view synthesis, particularly for indoor and small-scale scenes. However, extending NeRF to large-scale outdoor environments presents…

Computer Vision and Pattern Recognition · Computer Science 2025-03-19 Yizhou Li , Yusuke Monno , Masatoshi Okutomi , Yuuichi Tanaka , Seiichi Kataoka , Teruaki Kosiba

Representing and rendering dynamic scenes from 2D images is a fundamental yet challenging problem in computer vision and graphics. This survey provides a comprehensive review of the evolution and advancements in dynamic scene representation…

Graphics · Computer Science 2025-03-12 Jiaxuan Zhu , Hao Tang

This paper addresses the challenge of reconstructing an animatable human model from a multi-view video. Some recent works have proposed to decompose a non-rigidly deforming scene into a canonical neural radiance field and a set of…

Computer Vision and Pattern Recognition · Computer Science 2021-10-08 Sida Peng , Junting Dong , Qianqian Wang , Shangzhan Zhang , Qing Shuai , Xiaowei Zhou , Hujun Bao

We present a portable multiscopic camera system with a dedicated model for novel view and time synthesis in dynamic scenes. Our goal is to render high-quality images for a dynamic scene from any viewpoint at any time using our portable…

Computer Vision and Pattern Recognition · Computer Science 2022-08-31 Tianjia Zhang , Yuen-Fui Lau , Qifeng Chen

Neural Radiance Fields (NeRFs) excel in photorealistically rendering static scenes. However, rendering dynamic, long-duration radiance fields on ubiquitous devices remains challenging, due to data storage and computational constraints. In…

Computer Vision and Pattern Recognition · Computer Science 2023-12-05 Liao Wang , Kaixin Yao , Chengcheng Guo , Zhirui Zhang , Qiang Hu , Jingyi Yu , Lan Xu , Minye Wu

We present Panoptic Neural Fields (PNF), an object-aware neural scene representation that decomposes a scene into a set of objects (things) and background (stuff). Each object is represented by an oriented 3D bounding box and a multi-layer…

Computer Vision and Pattern Recognition · Computer Science 2022-05-10 Abhijit Kundu , Kyle Genova , Xiaoqi Yin , Alireza Fathi , Caroline Pantofaru , Leonidas Guibas , Andrea Tagliasacchi , Frank Dellaert , Thomas Funkhouser

We present an explicit-grid based method for efficiently reconstructing streaming radiance fields for novel view synthesis of real world dynamic scenes. Instead of training a single model that combines all the frames, we formulate the…

Computer Vision and Pattern Recognition · Computer Science 2022-10-27 Lingzhi Li , Zhen Shen , Zhongshu Wang , Li Shen , Ping Tan

Modeling dynamic scenes is important for many applications such as virtual reality and telepresence. Despite achieving unprecedented fidelity for novel view synthesis in dynamic scenes, existing methods based on Neural Radiance Fields…

Computer Vision and Pattern Recognition · Computer Science 2022-06-07 Jia-Wei Liu , Yan-Pei Cao , Weijia Mao , Wenqiao Zhang , David Junhao Zhang , Jussi Keppo , Ying Shan , Xiaohu Qie , Mike Zheng Shou

We present an algorithm for reconstructing the radiance field of a large-scale scene from a single casually captured video. The task poses two core challenges. First, most existing radiance field reconstruction approaches rely on accurate…

Computer Vision and Pattern Recognition · Computer Science 2023-03-27 Andreas Meuleman , Yu-Lun Liu , Chen Gao , Jia-Bin Huang , Changil Kim , Min H. Kim , Johannes Kopf

We present a method for composing photorealistic scenes from captured images of objects. Our work builds upon neural radiance fields (NeRFs), which implicitly model the volumetric density and directionally-emitted radiance of a scene. While…

Computer Vision and Pattern Recognition · Computer Science 2020-12-16 Michelle Guo , Alireza Fathi , Jiajun Wu , Thomas Funkhouser