English
Related papers

Related papers: DrivingScene: A Multi-Task Online Feed-Forward 3D …

200 papers

Photorealistic 3D reconstruction of street scenes is a critical technique for developing real-world simulators for autonomous driving. Despite the efficacy of Neural Radiance Fields (NeRF) for driving scenes, 3D Gaussian Splatting (3DGS)…

Computer Vision and Pattern Recognition · Computer Science 2024-05-31 Nan Huang , Xiaobao Wei , Wenzhao Zheng , Pengju An , Ming Lu , Wei Zhan , Masayoshi Tomizuka , Kurt Keutzer , Shanghang Zhang

This paper focuses on scene reconstruction under nighttime conditions in autonomous driving simulation. Recent methods based on Neural Radiance Fields (NeRFs) and 3D Gaussian Splatting (3DGS) have achieved photorealistic modeling in…

Computer Vision and Pattern Recognition · Computer Science 2026-02-17 Tae-Kyeong Kim , Xingxin Chen , Guile Wu , Chengjie Huang , Dongfeng Bai , Bingbing Liu

Dynamic scene rendering opens new avenues in autonomous driving by enabling closed-loop simulations with photorealistic data, which is crucial for validating end-to-end algorithms. However, the complex and highly dynamic nature of traffic…

Computer Vision and Pattern Recognition · Computer Science 2025-03-11 Rui Song , Chenwei Liang , Yan Xia , Walter Zimmer , Hu Cao , Holger Caesar , Andreas Festag , Alois Knoll

Reconstructing dynamic driving scenes from dashcam videos has attracted increasing attention due to its significance in autonomous driving and scene understanding. While recent advances have made impressive progress, most methods still…

Computer Vision and Pattern Recognition · Computer Science 2025-10-30 Hongyuan Liu , Haochen Yu , Bochao Zou , Jianfei Jiang , Qiankun Liu , Jiansheng Chen , Huimin Ma

Text-driven 3D indoor scene generation holds broad applications, ranging from gaming and smart homes to AR/VR applications. Fast and high-fidelity scene generation is paramount for ensuring user-friendly experiences. However, existing…

Computer Vision and Pattern Recognition · Computer Science 2024-05-10 Yikun Ma , Dandan Zhan , Zhi Jin

Creating 4D fields of Gaussian Splatting from images or videos is a challenging task due to its under-constrained nature. While the optimization can draw photometric reference from the input videos or be regulated by generative models,…

Computer Vision and Pattern Recognition · Computer Science 2024-05-15 Quankai Gao , Qiangeng Xu , Zhe Cao , Ben Mildenhall , Wenchao Ma , Le Chen , Danhang Tang , Ulrich Neumann

Novel view synthesis has shown rapid progress recently, with methods capable of producing increasingly photorealistic results. 3D Gaussian Splatting has emerged as a promising method, producing high-quality renderings of scenes and enabling…

Computer Vision and Pattern Recognition · Computer Science 2024-07-19 Richard Shaw , Michal Nazarczuk , Jifei Song , Arthur Moreau , Sibi Catley-Chandar , Helisa Dhamo , Eduardo Perez-Pellitero

We introduce Gaussian-Flow, a novel point-based approach for fast dynamic scene reconstruction and real-time rendering from both multi-view and monocular videos. In contrast to the prevalent NeRF-based approaches hampered by slow training…

Computer Vision and Pattern Recognition · Computer Science 2023-12-07 Youtian Lin , Zuozhuo Dai , Siyu Zhu , Yao Yao

We present DrivingGaussian++, an efficient and effective framework for realistic reconstructing and controllable editing of surrounding dynamic autonomous driving scenes. DrivingGaussian++ models the static background using incremental 3D…

Computer Vision and Pattern Recognition · Computer Science 2025-08-29 Yajiao Xiong , Xiaoyu Zhou , Yongtao Wan , Deqing Sun , Ming-Hsuan Yang

Rendering novel view images in dynamic scenes is a crucial yet challenging task. Current methods mainly utilize NeRF-based methods to represent the static scene and an additional time-variant MLP to model scene deformations, resulting in…

Computer Vision and Pattern Recognition · Computer Science 2024-06-07 Diwen Wan , Ruijie Lu , Gang Zeng

State-of-the-art novel view synthesis methods achieve impressive results for multi-view captures of static 3D scenes. However, the reconstructed scenes still lack "liveliness," a key component for creating engaging 3D experiences. Recently,…

Computer Vision and Pattern Recognition · Computer Science 2025-03-10 Thomas Wimmer , Michael Oechsle , Michael Niemeyer , Federico Tombari

Realistic reconstruction of dynamic 4D scenes from monocular videos is essential for understanding the physical world. Despite recent progress in neural rendering, existing methods often struggle to recover accurate 3D geometry and…

Computer Vision and Pattern Recognition · Computer Science 2026-04-01 Haoran Zhou , Gim Hee Lee

Diffusion models are advancing autonomous driving by enabling realistic data synthesis, predictive end-to-end planning, and closed-loop simulation, with a primary focus on temporally consistent generation. However, large-scale 3D scene…

Computer Vision and Pattern Recognition · Computer Science 2025-12-09 Yu Yang , Alan Liang , Jianbiao Mei , Yukai Ma , Yong Liu , Gim Hee Lee

We present FRUC, a feed-forward 3D Gaussian splatting framework for dynamic scene reconstruction from uncalibrated collaborative driving views. Existing multi-agent reconstruction frameworks are often hindered by rigid prerequisites,…

Computer Vision and Pattern Recognition · Computer Science 2026-05-29 Yihang Tao , Yu Guo , Zhengru Fang , Haonan An , Yuguang Fang

The increasing demand for augmented and virtual reality applications has highlighted the importance of crafting immersive 3D scenes from a simple single-view image. However, due to the partial priors provided by single-view input, existing…

Computer Vision and Pattern Recognition · Computer Science 2025-04-01 Tianyi Gong , Boyan Li , Yifei Zhong , Fangxin Wang

Reconstructing dynamic 3D scenes from 2D images and generating diverse views over time is challenging due to scene complexity and temporal dynamics. Despite advancements in neural implicit models, limitations persist: (i) Inadequate Scene…

Computer Vision and Pattern Recognition · Computer Science 2024-02-23 Zeyu Yang , Hongye Yang , Zijie Pan , Li Zhang

Recent developments in 3D Gaussian Splatting have made significant advances in surface reconstruction. However, scaling these methods to large-scale scenes remains challenging due to high computational demands and the complex dynamic…

Graphics · Computer Science 2025-06-24 Shihan Chen , Zhaojin Li , Zeyu Chen , Qingsong Yan , Gaoyang Shen , Ran Duan

Recent advancements in generative models have provided promising solutions for synthesizing realistic driving videos, which are crucial for training autonomous driving perception models. However, existing approaches often struggle with…

Computer Vision and Pattern Recognition · Computer Science 2024-09-13 Wei Wu , Xi Guo , Weixuan Tang , Tingxuan Huang , Chiyu Wang , Dongyue Chen , Chenjing Ding

We introduce Diff4Splat, a feed-forward method that synthesizes controllable and explicit 4D scenes from a single image. Our approach unifies the generative priors of video diffusion models with geometry and motion constraints learned from…

Computer Vision and Pattern Recognition · Computer Science 2026-04-08 Panwang Pan , Chenguo Lin , Jingjing Zhao , Chenxin Li , Yuchen Lin , Haopeng Li , Honglei Yan , Kairun Wen , Yunlong Lin , Yixuan Yuan , Yadong Mu

Reconstructing intricate, ever-changing environments remains a central ambition in computer vision, yet existing solutions often crumble before the complexity of real-world dynamics. We present DynaSplat, an approach that extends Gaussian…

Computer Vision and Pattern Recognition · Computer Science 2025-06-12 Junli Deng , Ping Shi , Qipei Li , Jinyang Guo