English
Related papers

Related papers: DrivingRecon: Large 4D Gaussian Reconstruction Mod…

200 papers

3D reconstruction and novel view synthesis are critical for validating autonomous driving systems and training advanced perception models. Recent self-supervised methods have gained significant attention due to their cost-effectiveness and…

Computer Vision and Pattern Recognition · Computer Science 2025-09-17 Xiao Tang , Guirong Zhuo , Cong Wang , Boyuan Zheng , Minqing Huang , Lianqing Zheng , Long Chen , Shouyi Lu

Realtime 4D reconstruction for dynamic scenes remains a crucial challenge for autonomous driving perception. Most existing methods rely on depth estimation through self-supervision or multi-modality sensor fusion. In this paper, we propose…

Computer Vision and Pattern Recognition · Computer Science 2024-12-10 Xin Fei , Wenzhao Zheng , Yueqi Duan , Wei Zhan , Masayoshi Tomizuka , Kurt Keutzer , Jiwen Lu

We propose 4DGT, a 4D Gaussian-based Transformer model for dynamic scene reconstruction, trained entirely on real-world monocular posed videos. Using 4D Gaussian as an inductive bias, 4DGT unifies static and dynamic components, enabling the…

Computer Vision and Pattern Recognition · Computer Science 2025-12-02 Zhen Xu , Zhengqin Li , Zhao Dong , Xiaowei Zhou , Richard Newcombe , Zhaoyang Lv

Synthesizing photo-realistic visual observations from an ego vehicle's driving trajectory is a critical step towards scalable training of self-driving models. Reconstruction-based methods create 3D scenes from driving logs and synthesize…

Computer Vision and Pattern Recognition · Computer Science 2025-01-07 Jiageng Mao , Boyi Li , Boris Ivanovic , Yuxiao Chen , Yan Wang , Yurong You , Chaowei Xiao , Danfei Xu , Marco Pavone , Yue Wang

We propose GGS, a Generalizable Gaussian Splatting method for Autonomous Driving which can achieve realistic rendering under large viewpoint changes. Previous generalizable 3D gaussian splatting methods are limited to rendering novel views…

Computer Vision and Pattern Recognition · Computer Science 2024-09-05 Huasong Han , Kaixuan Zhou , Xiaoxiao Long , Yusen Wang , Chunxia Xiao

Reconstructing large-scale dynamic scenes from visual observations is a fundamental challenge in computer vision, with critical implications for robotics and autonomous systems. While recent differentiable rendering methods such as Neural…

Computer Vision and Pattern Recognition · Computer Science 2026-05-05 Jingkang Wang , Henry Che , Yun Chen , Ze Yang , Lily Goli , Sivabalan Manivasagam , Raquel Urtasun

Robust and realistic rendering for large-scale road scenes is essential in autonomous driving simulation. Recently, 3D Gaussian Splatting (3D-GS) has made groundbreaking progress in neural rendering, but the general fidelity of large-scale…

Computer Vision and Pattern Recognition · Computer Science 2024-08-28 Saining Zhang , Baijun Ye , Xiaoxue Chen , Yuantao Chen , Zongzheng Zhang , Cheng Peng , Yongliang Shi , Hao Zhao

Self-supervised learning has made substantial strides in image processing, while visual pre-training for autonomous driving is still in its infancy. Existing methods often focus on learning geometric scene information while neglecting…

Computer Vision and Pattern Recognition · Computer Science 2024-11-20 Shaoqing Xu , Fang Li , Shengyin Jiang , Ziying Song , Li Liu , Zhi-xin Yang

Reconstructing dynamic driving scenes is essential for developing autonomous systems through sensor-realistic simulation. Although recent methods achieve high-fidelity reconstructions, they either rely on costly human annotations for object…

Computer Vision and Pattern Recognition · Computer Science 2026-03-24 Carl Lindström , Mahan Rafidashti , Maryam Fatemi , Lars Hammarstrand , Martin R. Oswald , Lennart Svensson

This paper aims to tackle the problem of modeling dynamic urban streets for autonomous driving scenes. Recent methods extend NeRF by incorporating tracked vehicle poses to animate vehicles, enabling photo-realistic view synthesis of dynamic…

Computer Vision and Pattern Recognition · Computer Science 2024-08-20 Yunzhi Yan , Haotong Lin , Chenxu Zhou , Weijie Wang , Haiyang Sun , Kun Zhan , Xianpeng Lang , Xiaowei Zhou , Sida Peng

We investigate data augmentation for 3D object detection in autonomous driving. We utilize recent advancements in 3D reconstruction based on Gaussian Splatting for 3D object placement in driving scenes. Unlike existing diffusion-based…

Computer Vision and Pattern Recognition · Computer Science 2025-04-24 Farhad G. Zanjani , Davide Abati , Auke Wiggers , Dimitris Kalatzis , Jens Petersen , Hong Cai , Amirhossein Habibian

Novel view synthesis (NVS) of static and dynamic urban scenes is essential for autonomous driving simulation, yet existing methods often struggle to balance reconstruction time with quality. While state-of-the-art neural radiance fields and…

Computer Vision and Pattern Recognition · Computer Science 2026-01-23 Sheng Miao , Sijin Li , Pan Wang , Dongfeng Bai , Bingbing Liu , Yue Wang , Andreas Geiger , Yiyi Liao

Accurate 3D reconstruction of vehicles is vital for applications such as vehicle inspection, predictive maintenance, and urban planning. Existing methods like Neural Radiance Fields and Gaussian Splatting have shown impressive results but…

Computer Vision and Pattern Recognition · Computer Science 2025-07-17 Davide Di Nucci , Matteo Tomei , Guido Borghi , Luca Ciuffreda , Roberto Vezzani , Rita Cucchiara

Photorealistic 3D scene reconstruction plays an important role in autonomous driving, enabling the generation of novel data from existing datasets to simulate safety-critical scenarios and expand training data without additional acquisition…

Computer Vision and Pattern Recognition · Computer Science 2025-11-26 Pou-Chun Kung , Xianling Zhang , Katherine A. Skinner , Nikita Jaipuria

High-fidelity reconstruction of driving scenes is crucial for autonomous driving. While recent feedforward 3D Gaussian Splatting (3DGS) methods enable fast reconstruction, their per-pixel Gaussian prediction paradigm often suffers from…

Computer Vision and Pattern Recognition · Computer Science 2026-05-13 Cheng Chi , Xianqi Wang , Hongcheng Luo , Mingfei Tu , Gangwei Xu , Zehan Zhang , Bing Wang , Guang Chen , Hangjun Ye , Sida Peng , Xin Yang , Haiyang Sun

Urban scene reconstruction is critical for autonomous driving, enabling structured 3D representations for data synthesis and closed-loop testing. Supervised approaches rely on costly human annotations and lack scalability, while current…

Computer Vision and Pattern Recognition · Computer Science 2025-11-11 Chenpeng Su , Wenhua Wu , Chensheng Peng , Tianchen Deng , Zhe Liu , Hesheng Wang

Reliable autonomous driving relies on large-scale, well-labeled data and robust models. However, manual data collection is resource-intensive, and traditional simulation suffers from a persistent reality gap. While recent generative…

Computer Vision and Pattern Recognition · Computer Science 2026-05-14 Kaicong Huang , Talha Azfar , Weisong Shi , Ruimin Ke

3D Gaussian Splatting (3DGS) leverages densely distributed Gaussian primitives for high-quality scene representation and reconstruction. While existing 3DGS methods perform well in scenes with minor view variation, large view changes from…

Computer Vision and Pattern Recognition · Computer Science 2025-04-29 Chenhao Zhang , Yuanping Cao , Lei Zhang

Reconstructing clean, distractor-free 3D scenes from real-world captures remains a significant challenge, particularly in highly dynamic and cluttered settings such as egocentric videos. To tackle this problem, we introduce DeGauss, a…

Computer Vision and Pattern Recognition · Computer Science 2025-07-25 Rui Wang , Quentin Lohmeyer , Mirko Meboldt , Siyu Tang

The advancement of real-time 3D scene reconstruction and novel view synthesis has been significantly propelled by 3D Gaussian Splatting (3DGS). However, effectively training large-scale 3DGS and rendering it in real-time across various…

Computer Vision and Pattern Recognition · Computer Science 2024-07-18 Yang Liu , He Guan , Chuanchen Luo , Lue Fan , Naiyan Wang , Junran Peng , Zhaoxiang Zhang