English
Related papers

Related papers: VDG: Vision-Only Dynamic Gaussian for Driving Simu…

200 papers

4D content generation has achieved remarkable progress recently. However, existing methods suffer from long optimization times, a lack of motion controllability, and a low quality of details. In this paper, we introduce DreamGaussian4D…

Computer Vision and Pattern Recognition · Computer Science 2024-06-11 Jiawei Ren , Liang Pan , Jiaxiang Tang , Chi Zhang , Ang Cao , Gang Zeng , Ziwei Liu

Novel View Synthesis (NVS) without Structure-from-Motion (SfM) pre-processed camera poses--referred to as SfM-free methods--is crucial for promoting rapid response capabilities and enhancing robustness against variable operating conditions.…

Computer Vision and Pattern Recognition · Computer Science 2024-08-19 Wei Sun , Xiaosong Zhang , Fang Wan , Yanzhao Zhou , Yuan Li , Qixiang Ye , Jianbin Jiao

This paper aims to tackle the problem of modeling dynamic urban streets for autonomous driving scenes. Recent methods extend NeRF by incorporating tracked vehicle poses to animate vehicles, enabling photo-realistic view synthesis of dynamic…

Computer Vision and Pattern Recognition · Computer Science 2024-08-20 Yunzhi Yan , Haotong Lin , Chenxu Zhou , Weijie Wang , Haiyang Sun , Kun Zhan , Xianpeng Lang , Xiaowei Zhou , Sida Peng

We propose DrivingForward, a feed-forward Gaussian Splatting model that reconstructs driving scenes from flexible surround-view input. Driving scene images from vehicle-mounted cameras are typically sparse, with limited overlap, and the…

Computer Vision and Pattern Recognition · Computer Science 2024-12-24 Qijian Tian , Xin Tan , Yuan Xie , Lizhuang Ma

Novel view synthesis of dynamic scenes is becoming important in various applications, including augmented and virtual reality. We propose a novel 4D Gaussian Splatting (4DGS) algorithm for dynamic scenes from casually recorded monocular…

Computer Vision and Pattern Recognition · Computer Science 2024-11-14 Mijeong Kim , Jongwoo Lim , Bohyung Han

The semantic synthesis of unseen scenes from multiple viewpoints is crucial for research in 3D scene understanding. Current methods are capable of rendering novel-view images and semantic maps by reconstructing generalizable Neural Radiance…

Graphics · Computer Science 2025-05-09 Feng Xiao , Hongbin Xu , Wanlin Liang , Wenxiong Kang

Achieving truly practical dynamic 3D reconstruction requires online operation, global pose and map consistency, detailed appearance modeling, and the flexibility to handle both RGB and RGB-D inputs. However, existing SLAM methods typically…

Computer Vision and Pattern Recognition · Computer Science 2025-09-23 Shi Chen , Erik Sandström , Sandro Lombardi , Siyuan Li , Martin R. Oswald

3D Gaussian Splatting (3DGS) techniques have achieved satisfactory 3D scene representation. Despite their impressive performance, they confront challenges due to the limitation of structure-from-motion (SfM) methods on acquiring accurate…

Computer Vision and Pattern Recognition · Computer Science 2025-01-28 Ao Gao , Luosong Guo , Tao Chen , Zhao Wang , Ying Tai , Jian Yang , Zhenyu Zhang

We have recently seen great progress in 3D scene reconstruction through explicit point-based 3D Gaussian Splatting (3DGS), notable for its high quality and fast rendering speed. However, reconstructing dynamic scenes such as complex human…

Computer Vision and Pattern Recognition · Computer Science 2025-03-10 Chao Zhang , Yifeng Zhou , Shuheng Wang , Wenfa Li , Degang Wang , Yi Xu , Shaohui Jiao

Occupancy prediction infers fine-grained 3D geometry and semantics from camera images of the surrounding environment, making it a critical perception task for autonomous driving. Existing methods either adopt dense grids as scene…

Computer Vision and Pattern Recognition · Computer Science 2025-06-13 Yunxiao Shi , Yinhao Zhu , Shizhong Han , Jisoo Jeong , Amin Ansari , Hong Cai , Fatih Porikli

End-to-end autonomous driving has evolved from the conventional paradigm based on sparse perception into vision-language-action (VLA) models, which focus on learning language descriptions as an auxiliary task to facilitate planning. In this…

Computer Vision and Pattern Recognition · Computer Science 2026-04-27 Sicheng Zuo , Zixun Xie , Wenzhao Zheng , Shaoqing Xu , Fang Li , Hanbing Li , Long Chen , Zhi-Xin Yang , Jiwen Lu

Dynamic and static components in scenes often exhibit distinct properties, yet most 4D reconstruction methods treat them indiscriminately, leading to suboptimal performance in both cases. This work introduces SDD-4DGS, the first framework…

Computer Vision and Pattern Recognition · Computer Science 2025-03-13 Dai Sun , Huhao Guan , Kun Zhang , Xike Xie , S. Kevin Zhou

Driving view synthesis along free-form trajectories is essential for realistic driving simulations, enabling closed-loop evaluation of end-to-end driving policies. Existing methods excel at view interpolation along recorded paths but…

Computer Vision and Pattern Recognition · Computer Science 2025-07-09 Zeyu Yang , Zijie Pan , Yuankun Yang , Xiatian Zhu , Li Zhang

3D Gaussian Splatting (3DGS) has emerged as a powerful technique for real-time LiDAR and camera synthesis in autonomous driving simulation. However, simulating LiDAR with 3DGS remains challenging for extrapolated views beyond the training…

Robotics · Computer Science 2026-03-17 Yiming Huang , Xin Kang , Sipeng Zhang , Hongliang Ren , Weihua Zhang , Junjie Lai

Over the past year, 3D Gaussian Splatting (3DGS) has received significant attention for its ability to represent 3D scenes in a perceptually accurate manner. However, it can require a substantial amount of storage since each splat's…

Computer Vision and Pattern Recognition · Computer Science 2025-04-11 Brent Zoomers , Maarten Wijnants , Ivan Molenaers , Joni Vanherck , Jeroen Put , Lode Jorissen , Nick Michiels

3D Gaussians have recently emerged as an effective scene representation for real-time splatting and accurate novel-view synthesis, motivating several works to adapt multi-view structure prediction networks to regress per-pixel 3D Gaussians…

Computer Vision and Pattern Recognition · Computer Science 2025-12-22 Mehdi Hosseinzadeh , Shin-Fang Chng , Yi Xu , Simon Lucey , Ian Reid , Ravi Garg

We aim to address sparse-view reconstruction of a 3D scene by leveraging priors from large-scale vision models. While recent advancements such as 3D Gaussian Splatting (3DGS) have demonstrated remarkable successes in 3D reconstruction,…

Computer Vision and Pattern Recognition · Computer Science 2025-07-29 Hanyang Yu , Xiaoxiao Long , Ping Tan

Rendering novel view images in dynamic scenes is a crucial yet challenging task. Current methods mainly utilize NeRF-based methods to represent the static scene and an additional time-variant MLP to model scene deformations, resulting in…

Computer Vision and Pattern Recognition · Computer Science 2024-06-07 Diwen Wan , Ruijie Lu , Gang Zeng

We propose HoliGS, a novel deformable Gaussian splatting framework that addresses embodied view synthesis from long monocular RGB videos. Unlike prior 4D Gaussian splatting and dynamic NeRF pipelines, which struggle with training overhead…

Computer Vision and Pattern Recognition · Computer Science 2025-06-25 Xiaoyuan Wang , Yizhou Zhao , Botao Ye , Xiaojun Shan , Weijie Lyu , Lu Qi , Kelvin C. K. Chan , Yinxiao Li , Ming-Hsuan Yang

Reconstructing dynamic 3D scenes from monocular video remains fundamentally challenging due to the need to jointly infer motion, structure, and appearance from limited observations. Existing dynamic scene reconstruction methods based on…

Computer Vision and Pattern Recognition · Computer Science 2025-08-07 Jiahui Li , Shengeng Tang , Jingxuan He , Gang Huang , Zhangye Wang , Yantao Pan , Lechao Cheng