English
Related papers

Related papers: Modeling Ambient Scene Dynamics for Free-view Synt…

200 papers

Realistic scene reconstruction and view synthesis are essential for advancing autonomous driving systems by simulating safety-critical scenarios. 3D Gaussian Splatting excels in real-time rendering and static scene reconstructions but…

Computer Vision and Pattern Recognition · Computer Science 2024-07-08 Mustafa Khan , Hamidreza Fazlali , Dhruv Sharma , Tongtong Cao , Dongfeng Bai , Yuan Ren , Bingbing Liu

Capturing and reconstructing high-speed dynamic 3D scenes has numerous applications in computer graphics, vision, and interdisciplinary fields such as robotics, aerodynamics, and evolutionary biology. However, achieving this using a single…

Computer Vision and Pattern Recognition · Computer Science 2025-02-10 Zihao Zou , Ziyuan Qu , Xi Peng , Vivek Boominathan , Adithya Pediredla , Praneeth Chakravarthula

Synthesizing consistent and photorealistic 3D scenes is an open problem in computer vision. Video diffusion models generate impressive videos but cannot directly synthesize 3D representations, i.e., lack 3D consistency in the generated…

Computer Vision and Pattern Recognition · Computer Science 2025-03-18 Katja Schwarz , Norman Mueller , Peter Kontschieder

We consider the problem of novel-view synthesis (NVS) for dynamic scenes. Recent neural approaches have accomplished exceptional NVS results for static 3D scenes, but extensions to 4D time-varying scenes remain non-trivial. Prior efforts…

Computer Vision and Pattern Recognition · Computer Science 2024-07-03 Yuanxing Duan , Fangyin Wei , Qiyu Dai , Yuhang He , Wenzheng Chen , Baoquan Chen

3D Gaussian Splatting has recently achieved notable success in novel view synthesis for dynamic scenes and geometry reconstruction in static scenes. Building on these advancements, early methods have been developed for dynamic surface…

Computer Vision and Pattern Recognition · Computer Science 2024-11-12 Decai Chen , Brianne Oberson , Ingo Feldmann , Oliver Schreer , Anna Hilsmann , Peter Eisert

Camera virtualization -- an emerging solution to novel view synthesis -- holds transformative potential for visual entertainment, live performances, and sports broadcasting by enabling the generation of photorealistic images from novel…

Computer Vision and Pattern Recognition · Computer Science 2026-02-18 Yunxiao Zhang , William Stone , Suryansh Kumar

While novel view synthesis for dynamic scenes has made significant progress, capturing skeleton models of objects and re-posing them remains a challenging task. To tackle this problem, in this paper, we propose a novel approach to…

Computer Vision and Pattern Recognition · Computer Science 2024-12-10 Diwen Wan , Yuxiang Wang , Ruijie Lu , Gang Zeng

Reconstructing dynamic 3D scenes from monocular video remains fundamentally challenging due to the need to jointly infer motion, structure, and appearance from limited observations. Existing dynamic scene reconstruction methods based on…

Computer Vision and Pattern Recognition · Computer Science 2025-08-07 Jiahui Li , Shengeng Tang , Jingxuan He , Gang Huang , Zhangye Wang , Yantao Pan , Lechao Cheng

Novel View Synthesis (NVS) for street scenes play a critical role in the autonomous driving simulation. The current mainstream technique to achieve it is neural rendering, such as Neural Radiance Fields (NeRF) and 3D Gaussian Splatting…

Computer Vision and Pattern Recognition · Computer Science 2024-04-01 Zhongrui Yu , Haoran Wang , Jinze Yang , Hanzhang Wang , Zeke Xie , Yunfeng Cai , Jiale Cao , Zhong Ji , Mingming Sun

Digitizing 3D static scenes and 4D dynamic events from multi-view images has long been a challenge in computer vision and graphics. Recently, 3D Gaussian Splatting (3DGS) has emerged as a practical and scalable reconstruction method,…

Computer Vision and Pattern Recognition · Computer Science 2024-09-18 Marko Mihajlovic , Sergey Prokudin , Siyu Tang , Robert Maier , Federica Bogo , Tony Tung , Edmond Boyer

Novel View Synthesis (NVS) from unconstrained photo collections is challenging in computer graphics. Recently, 3D Gaussian Splatting (3DGS) has shown promise for photorealistic and real-time NVS of static scenes. Building on 3DGS, we…

Computer Vision and Pattern Recognition · Computer Science 2024-06-05 Yuze Wang , Junyi Wang , Yue Qi

We leverage repetitive elements in 3D scenes to improve novel view synthesis. Neural Radiance Fields (NeRF) and 3D Gaussian Splatting (3DGS) have greatly improved novel view synthesis but renderings of unseen and occluded parts remain…

Egocentric video provides a unique view into human perception and interaction, with growing relevance for augmented reality, robotics, and assistive technologies. However, rapid camera motion and complex scene dynamics pose major challenges…

Computer Vision and Pattern Recognition · Computer Science 2026-04-28 Jan Warchocki , Xi Wang , Jonas Kulhanek , Jan van Gemert

3D Gaussian Splatting represents a breakthrough in the field of novel view synthesis. It establishes Gaussians as core rendering primitives for highly accurate real-world environment reconstruction. Recent advances have drastically…

Graphics · Computer Science 2025-06-25 Jonathan Haberl , Philipp Fleck , Clemens Arth

We present an efficient neural 3D scene representation for novel-view synthesis (NVS) in large-scale, dynamic urban areas. Existing works are not well suited for applications like mixed-reality or closed-loop simulation due to their limited…

Computer Vision and Pattern Recognition · Computer Science 2024-11-26 Tobias Fischer , Jonas Kulhanek , Samuel Rota Bulò , Lorenzo Porzi , Marc Pollefeys , Peter Kontschieder

This paper presents DENSER, an efficient and effective approach leveraging 3D Gaussian splatting (3DGS) for the reconstruction of dynamic urban environments. While several methods for photorealistic scene representations, both implicitly…

Computer Vision and Pattern Recognition · Computer Science 2024-09-17 Mahmud A. Mohamad , Gamal Elghazaly , Arthur Hubert , Raphael Frank

3D Gaussian Splatting (3DGS) has demonstrated impressive performance in synthesizing novel views after training on a given set of viewpoints. However, its rendering quality deteriorates when the synthesized view deviates significantly from…

Computer Vision and Pattern Recognition · Computer Science 2025-03-13 Jiatong Xia , Lingqiao Liu

This paper investigates an open research challenge of reconstructing high-quality, large 3D open scenes from images. It is observed existing methods have various limitations, such as requiring precise camera poses for input and dense…

Computer Vision and Pattern Recognition · Computer Science 2025-02-25 Chong Cheng , Gaochao Song , Yiyang Yao , Qinzheng Zhou , Gangjian Zhang , Hao Wang

In this paper, we present a method to reconstruct the world and multiple dynamic humans in 3D from a monocular video input. As a key idea, we represent both the world and multiple humans via the recently emerging 3D Gaussian Splatting…

Computer Vision and Pattern Recognition · Computer Science 2024-04-23 Inhee Lee , Byungjun Kim , Hanbyul Joo

Radiance Field methods have recently revolutionized novel-view synthesis of scenes captured with multiple photos or videos. However, achieving high visual quality still requires neural networks that are costly to train and render, while…

Graphics · Computer Science 2023-08-09 Bernhard Kerbl , Georgios Kopanas , Thomas Leimkühler , George Drettakis