English
Related papers

Related papers: Optimizing 4D Gaussians for Dynamic Scene Video fr…

200 papers

The advancement of real-time 3D scene reconstruction and novel view synthesis has been significantly propelled by 3D Gaussian Splatting (3DGS). However, effectively training large-scale 3DGS and rendering it in real-time across various…

Computer Vision and Pattern Recognition · Computer Science 2024-07-18 Yang Liu , He Guan , Chuanchen Luo , Lue Fan , Naiyan Wang , Junran Peng , Zhaoxiang Zhang

3D Gaussian Splatting (3DGS) is a recent approach for scene rendering. Although primarily designed for view synthesis, its potential for scene understanding tasks remains underexplored. In this work, we conduct a comparative evaluation of…

Computer Vision and Pattern Recognition · Computer Science 2026-05-29 Julia Farganus , Krzysztof Żurawicki , Arkadiusz Gaweł , Weronika Jakubowska , Halina Kwaśnicka

While the field of 3D scene reconstruction is dominated by NeRFs due to their photorealistic quality, 3D Gaussian Splatting (3DGS) has recently emerged, offering similar quality with real-time rendering speeds. However, both methods…

Computer Vision and Pattern Recognition · Computer Science 2024-11-01 Jonas Kulhanek , Songyou Peng , Zuzana Kukelova , Marc Pollefeys , Torsten Sattler

In this study, we present an end-to-end pipeline capable of converting drone-captured video streams into high-fidelity 3D reconstructions with minimal latency. Unmanned aerial vehicles (UAVs) are extensively used in aerial real-time…

Computer Vision and Pattern Recognition · Computer Science 2026-02-25 Christos Maikos , Georgios Angelidis , Georgios Th. Papadopoulos

Efficient scene representations are essential for many real-world applications, especially those involving spatial measurement. Although current NeRF-based methods have achieved impressive results in reconstructing building-scale scenes,…

Computer Vision and Pattern Recognition · Computer Science 2025-05-19 Jianlin Guo , Haihong Xiao , Wenxiong Kang

Recent advances in 3D Gaussian Splatting have shown promising results. Existing methods typically assume static scenes and/or multiple images with prior poses. Dynamics, sparse views, and unknown poses significantly increase the problem…

Computer Vision and Pattern Recognition · Computer Science 2024-12-03 Weihang Li , Weirong Chen , Shenhan Qian , Jiajie Chen , Daniel Cremers , Haoang Li

Cinematic video production requires control over scene-subject composition and camera movement, but live-action shooting remains costly due to the need for constructing physical sets. To address this, we introduce the task of cinematic…

Computer Vision and Pattern Recognition · Computer Science 2026-02-09 Kaiyi Huang , Yukun Huang , Yu Li , Jianhong Bai , Xintao Wang , Zinan Lin , Xuefei Ning , Jiwen Yu , Pengfei Wan , Yu Wang , Xihui Liu

4D millimeter-wave radar is a promising sensing modality for autonomous driving, yet effective 3D object detection from 4D radar and monocular images remains challenging. Existing fusion approaches either rely on instance proposals lacking…

Computer Vision and Pattern Recognition · Computer Science 2025-11-11 Xiaokai Bai , Chenxu Zhou , Lianqing Zheng , Si-Yuan Cao , Jianan Liu , Xiaohan Zhang , Yiming Li , Zhengzhuang Zhang , Hui-liang Shen

Recent text-guided generation of individual 3D object has achieved great success using diffusion priors. However, these methods are not suitable for object insertion and replacement tasks as they do not consider the background, leading to…

Computer Vision and Pattern Recognition · Computer Science 2025-08-25 Hanyuan Xiao , Yingshu Chen , Huajian Huang , Haolin Xiong , Jing Yang , Pratusha Prasad , Yajie Zhao

Learning a physical model from video data that can comprehend physical laws and predict the future trajectories of objects is a formidable challenge in artificial intelligence. Prior approaches either leverage various Partial Differential…

Computer Vision and Pattern Recognition · Computer Science 2026-05-12 Nengbo Lu , Minghua Pan

Reconstructing objects and extracting high-quality surfaces play a vital role in the real world. Current 4D representations show the ability to render high-quality novel views for dynamic objects, but cannot reconstruct high-quality meshes…

Computer Vision and Pattern Recognition · Computer Science 2025-08-06 Shuai Zhang , Guanjun Wu , Zhoufeng Xie , Xinggang Wang , Bin Feng , Wenyu Liu

Understanding the motion states of the surrounding environment is critical for safe autonomous driving. These motion states can be accurately derived from scene flow, which captures the three-dimensional motion field of points. Existing…

Computer Vision and Pattern Recognition · Computer Science 2024-07-12 Jaeyeul Kim , Jungwan Woo , Ukcheol Shin , Jean Oh , Sunghoon Im

Gaussian Splatting (GS) has significantly elevated scene reconstruction efficiency and novel view synthesis (NVS) accuracy compared to Neural Radiance Fields (NeRF), particularly for dynamic scenes. However, current 4D NVS methods, whether…

Computer Vision and Pattern Recognition · Computer Science 2025-04-02 Fang Li , Hao Zhang , Narendra Ahuja

Reconstructing large-scale dynamic scenes from visual observations is a fundamental challenge in computer vision, with critical implications for robotics and autonomous systems. While recent differentiable rendering methods such as Neural…

Computer Vision and Pattern Recognition · Computer Science 2026-05-05 Jingkang Wang , Henry Che , Yun Chen , Ze Yang , Lily Goli , Sivabalan Manivasagam , Raquel Urtasun

Open-vocabulary 3D scene understanding is crucial for applications requiring natural language-driven spatial interpretation, such as robotics and augmented reality. While 3D Gaussian Splatting (3DGS) offers a powerful representation for…

Computer Vision and Pattern Recognition · Computer Science 2025-04-17 Wei Sun , Yanzhao Zhou , Jianbin Jiao , Yuan Li

Recent advances in 3D Gaussian Splatting (3DGS) have demonstrated remarkable capabilities in real-time and photorealistic novel view synthesis. However, traditional 3DGS representations often struggle with large-scale scene management and…

Graphics · Computer Science 2025-08-08 Zijian Wang , Beizhen Zhao , Hao Wang

We present DrivingGaussian, an efficient and effective framework for surrounding dynamic autonomous driving scenes. For complex scenes with moving objects, we first sequentially and progressively model the static background of the entire…

Computer Vision and Pattern Recognition · Computer Science 2024-03-21 Xiaoyu Zhou , Zhiwei Lin , Xiaojun Shan , Yongtao Wang , Deqing Sun , Ming-Hsuan Yang

The emergence of 3D Gaussian Splatting (3DGS) has greatly accelerated the rendering speed of novel view synthesis. Unlike neural implicit representations like Neural Radiance Fields (NeRF) that represent a 3D scene with position and…

Computer Vision and Pattern Recognition · Computer Science 2024-04-16 Tong Wu , Yu-Jie Yuan , Ling-Xiao Zhang , Jie Yang , Yan-Pei Cao , Ling-Qi Yan , Lin Gao

Rendering dynamic scenes from monocular videos is a crucial yet challenging task. The recent deformable Gaussian Splatting has emerged as a robust solution to represent real-world dynamic scenes. However, it often leads to heavily redundant…

Computer Vision and Pattern Recognition · Computer Science 2025-02-28 Hanyang Kong , Xingyi Yang , Xinchao Wang

Reconstructing complete and interactive 3D scenes remains a fundamental challenge in computer vision and robotics, particularly due to persistent object occlusions and limited sensor coverage. Multiview observations from a single scene scan…

Computer Vision and Pattern Recognition · Computer Science 2025-08-19 Wenhao Hu , Zesheng Li , Haonan Zhou , Liu Liu , Xuexiang Wen , Zhizhong Su , Xi Li , Gaoang Wang