English
Related papers

Related papers: Real-time Photorealistic Dynamic Scene Representat…

200 papers

We propose a novel cross-spectral rendering framework based on 3D Gaussian Splatting (3DGS) that generates realistic and semantically meaningful splats from registered multi-view spectrum and segmentation maps. This extension enhances the…

Computer Vision and Pattern Recognition · Computer Science 2024-08-14 Saptarshi Neil Sinha , Holger Graf , Michael Weinmann

3D Gaussian Splatting has recently emerged as a highly promising technique for modeling of static 3D scenes. In contrast to Neural Radiance Fields, it utilizes efficient rasterization allowing for very fast rendering at high-quality.…

Computer Vision and Pattern Recognition · Computer Science 2024-12-02 Wieland Morgenstern , Florian Barthel , Anna Hilsmann , Peter Eisert

This paper aims to tackle the problem of modeling dynamic urban streets for autonomous driving scenes. Recent methods extend NeRF by incorporating tracked vehicle poses to animate vehicles, enabling photo-realistic view synthesis of dynamic…

Computer Vision and Pattern Recognition · Computer Science 2024-08-20 Yunzhi Yan , Haotong Lin , Chenxu Zhou , Weijie Wang , Haiyang Sun , Kun Zhan , Xianpeng Lang , Xiaowei Zhou , Sida Peng

Recently, Gaussian Splatting methods have emerged as a desirable substitute for prior Radiance Field methods for novel-view synthesis of scenes captured with multi-view images or videos. In this work, we propose a novel extension to 4D…

Computer Vision and Pattern Recognition · Computer Science 2025-06-03 Karly Hou , Wanhua Li , Hanspeter Pfister

Reconstructing dynamic 3D scenes from monocular video remains fundamentally challenging due to the need to jointly infer motion, structure, and appearance from limited observations. Existing dynamic scene reconstruction methods based on…

Computer Vision and Pattern Recognition · Computer Science 2025-08-07 Jiahui Li , Shengeng Tang , Jingxuan He , Gang Huang , Zhangye Wang , Yantao Pan , Lechao Cheng

Modeling dynamic 3D scenes is challenging due to their high-dimensional nature, which requires aggregating information from multiple views to reconstruct time-evolving 3D geometry and motion. We present a novel multi-video 4D Gaussian…

Computer Vision and Pattern Recognition · Computer Science 2025-12-05 Yonghan Lee , Tsung-Wei Huang , Shiv Gehlot , Jaehoon Choi , Guan-Ming Su , Dinesh Manocha

Simultaneously localizing camera poses and constructing Gaussian radiance fields in dynamic scenes establish a crucial bridge between 2D images and the 4D real world. Instead of removing dynamic objects as distractors and reconstructing…

Computer Vision and Pattern Recognition · Computer Science 2025-03-24 Yanyan Li , Youxu Fang , Zunjie Zhu , Kunyi Li , Yong Ding , Federico Tombari

3D Gaussian Splatting (3DGS) has become an emerging tool for dynamic scene reconstruction. However, existing methods focus mainly on extending static 3DGS into a time-variant representation, while overlooking the rich motion information…

Computer Vision and Pattern Recognition · Computer Science 2024-03-19 Zhiyang Guo , Wengang Zhou , Li Li , Min Wang , Houqiang Li

The emergence of neural representations has revolutionized our means for digitally viewing a wide range of 3D scenes, enabling the synthesis of photorealistic images rendered from novel views. Recently, several techniques have been proposed…

Computer Vision and Pattern Recognition · Computer Science 2025-02-14 Gal Fiebelman , Tamir Cohen , Ayellet Morgenstern , Peter Hedman , Hadar Averbuch-Elor

This paper presents DENSER, an efficient and effective approach leveraging 3D Gaussian splatting (3DGS) for the reconstruction of dynamic urban environments. While several methods for photorealistic scene representations, both implicitly…

Computer Vision and Pattern Recognition · Computer Science 2024-09-17 Mahmud A. Mohamad , Gamal Elghazaly , Arthur Hubert , Raphael Frank

Neural implicit representations, including Neural Distance Fields and Neural Radiance Fields, have demonstrated significant capabilities for reconstructing surfaces with complicated geometry and topology, and generating novel views of a…

Graphics · Computer Science 2024-02-08 Lin Gao , Jie Yang , Bo-Tao Zhang , Jia-Mu Sun , Yu-Jie Yuan , Hongbo Fu , Yu-Kun Lai

Recently, Gaussian splatting has received more and more attention in the field of static scene rendering. Due to the low computational overhead and inherent flexibility of explicit representations, plane-based explicit methods are popular…

Computer Vision and Pattern Recognition · Computer Science 2024-12-30 Jiawei Xu , Zexin Fan , Jian Yang , Jin Xie

Dynamic scenes rendering is an intriguing yet challenging problem. Although current methods based on NeRF have achieved satisfactory performance, they still can not reach real-time levels. Recently, 3D Gaussian Splatting (3DGS) has garnered…

Computer Vision and Pattern Recognition · Computer Science 2024-11-07 Jiahao Lu , Jiacheng Deng , Ruijie Zhu , Yanzhe Liang , Wenfei Yang , Tianzhu Zhang , Xu Zhou

Surgical simulation is essential for medical training, enabling practitioners to develop crucial skills in a risk-free environment while improving patient safety and surgical outcomes. However, conventional methods for building simulation…

Computer Vision and Pattern Recognition · Computer Science 2025-09-23 Zhenya Yang

3D scene reconstruction and rendering are core tasks in computer vision, with applications spanning industrial monitoring, robotics, and autonomous driving. Recent advances in 3D Gaussian Splatting (GS) and its variants have achieved…

Computer Vision and Pattern Recognition · Computer Science 2026-02-20 Chi-Shiang Gau , Konstantinos D. Polyzos , Athanasios Bacharis , Saketh Madhuvarasu , Tara Javidi

Over the past year, 3D Gaussian Splatting (3DGS) has received significant attention for its ability to represent 3D scenes in a perceptually accurate manner. However, it can require a substantial amount of storage since each splat's…

Computer Vision and Pattern Recognition · Computer Science 2025-04-11 Brent Zoomers , Maarten Wijnants , Ivan Molenaers , Joni Vanherck , Jeroen Put , Lode Jorissen , Nick Michiels

We present a framework that enables fast reconstruction and real-time rendering of urban-scale scenes while maintaining robustness against appearance variations across multi-view captures. Our approach begins with scene partitioning for…

Computer Vision and Pattern Recognition · Computer Science 2025-08-01 Zhensheng Yuan , Haozhi Huang , Zhen Xiong , Di Wang , Guanghua Yang

We reinterpret 4D Gaussian Splatting as a continuous-time dynamical system, where scene motion arises from integrating a learned neural dynamical field rather than applying per-frame deformations. This formulation, which we call EvoGS,…

Computer Vision and Pattern Recognition · Computer Science 2025-12-23 Arnold Caleb Asiimwe , Carl Vondrick

Due to the complex and highly dynamic motions in the real world, synthesizing dynamic videos from multi-view inputs for arbitrary viewpoints is challenging. Previous works based on neural radiance field or 3D Gaussian splatting are limited…

Computer Vision and Pattern Recognition · Computer Science 2025-07-04 Jiahao Wu , Rui Peng , Jianbo Jiao , Jiayu Yang , Luyang Tang , Kaiqiang Xiong , Jie Liang , Jinbo Yan , Runling Liu , Ronggang Wang

Dynamic scene rendering has taken a leap forward with the rise of 4D Gaussian Splatting, but there's still one elusive challenge: how to make 3D Gaussians move through time as naturally as they would in the real world, all while keeping the…

Computer Vision and Pattern Recognition · Computer Science 2025-02-04 Junli Deng , Yihao Luo