English
Related papers

Related papers: SIMSplat: Predictive Driving Scene Editing with La…

200 papers

The scalability of robotic learning is fundamentally bottlenecked by the significant cost and labor of real-world data collection. While simulated data offers a scalable alternative, it often fails to generalize to the real world due to…

User-friendly 3D object editing is a challenging task that has attracted significant attention recently. The limitations of direct 3D object editing without 2D prior knowledge have prompted increased attention towards utilizing 2D…

Graphics · Computer Science 2024-05-10 Sitian Shen , Jing Xu , Yuheng Yuan , Xingyi Yang , Qiuhong Shen , Xinchao Wang

Representation in the family of 3D Gaussian Splats (3DGS) are growing into a viable alternative to traditional graphics for an expanding number of application, including recent techniques that facilitate physics simulation and animation.…

Computer Vision and Pattern Recognition · Computer Science 2026-02-12 Clement Fuji Tsang , Anita Hu , Or Perel , Carsten Kolve , Maria Shugrina

Real-time, high-fidelity reconstruction of dynamic driving scenes is challenged by complex dynamics and sparse views, with prior methods struggling to balance quality and efficiency. We propose DrivingScene, an online, feed-forward…

Computer Vision and Pattern Recognition · Computer Science 2025-10-30 Qirui Hou , Wenzhang Sun , Chang Zeng , Chunfeng Wang , Hao Li , Jianxun Cui

Rendering novel view images in dynamic scenes is a crucial yet challenging task. Current methods mainly utilize NeRF-based methods to represent the static scene and an additional time-variant MLP to model scene deformations, resulting in…

Computer Vision and Pattern Recognition · Computer Science 2024-06-07 Diwen Wan , Ruijie Lu , Gang Zeng

In this paper, we introduce \textbf{GS-SLAM} that first utilizes 3D Gaussian representation in the Simultaneous Localization and Mapping (SLAM) system. It facilitates a better balance between efficiency and accuracy. Compared to recent SLAM…

Computer Vision and Pattern Recognition · Computer Science 2024-04-09 Chi Yan , Delin Qu , Dan Xu , Bin Zhao , Zhigang Wang , Dong Wang , Xuelong Li

This paper focuses on scene reconstruction under nighttime conditions in autonomous driving simulation. Recent methods based on Neural Radiance Fields (NeRFs) and 3D Gaussian Splatting (3DGS) have achieved photorealistic modeling in…

Computer Vision and Pattern Recognition · Computer Science 2026-02-17 Tae-Kyeong Kim , Xingxin Chen , Guile Wu , Chengjie Huang , Dongfeng Bai , Bingbing Liu

The recent Gaussian Splatting achieves high-quality and real-time novel-view synthesis of the 3D scenes. However, it is solely concentrated on the appearance and geometry modeling, while lacking in fine-grained object-level scene…

Computer Vision and Pattern Recognition · Computer Science 2024-07-09 Mingqiao Ye , Martin Danelljan , Fisher Yu , Lei Ke

We present Splat-MOVER, a modular robotics stack for open-vocabulary robotic manipulation, which leverages the editability of Gaussian Splatting (GSplat) scene representations to enable multi-stage manipulation tasks. Splat-MOVER consists…

Recent advancements in 3D scene editing have been propelled by the rapid development of generative models. Existing methods typically utilize generative models to perform text-guided editing on 3D representations, such as 3D Gaussian…

Graphics · Computer Science 2025-05-27 Yansong Qu , Dian Chen , Xinyang Li , Xiaofan Li , Shengchuan Zhang , Liujuan Cao , Rongrong Ji

Gaussian Splatting (GS) is a novel, state-of-the-art technique for rendering points in a 3D scene by approximating their contribution to image pixels through Gaussian distributions, warranting fast training and real-time rendering. The main…

Computer Vision and Pattern Recognition · Computer Science 2024-12-04 Joanna Waczyńska , Piotr Borycki , Sławomir Tadeja , Jacek Tabor , Przemysław Spurek

Vision-language models have recently emerged as promising planners for autonomous driving, where success hinges on topology-aware reasoning over spatial structure and dynamic interactions from multimodal input. However, existing models are…

Computer Vision and Pattern Recognition · Computer Science 2026-03-16 Fabian Schmidt , Markus Enzweiler , Abhinav Valada

We propose VideoRFSplat, a direct text-to-3D model leveraging a video generation model to generate realistic 3D Gaussian Splatting (3DGS) for unbounded real-world scenes. To generate diverse camera poses and unbounded spatial extent of…

Computer Vision and Pattern Recognition · Computer Science 2025-03-21 Hyojun Go , Byeongjun Park , Hyelin Nam , Byung-Hoon Kim , Hyungjin Chung , Changick Kim

Maps play an important role in autonomous driving systems. The recently proposed 3D Gaussian Splatting (3D-GS) produces rendering-quality explicit scene reconstruction results, demonstrating the potential for map construction in autonomous…

Computer Vision and Pattern Recognition · Computer Science 2025-08-05 Luqi Cheng , Zhangshuo Qi , Zijie Zhou , Chao Lu , Guangming Xiong

3D Gaussian Splatting (3DGS) serves as a highly performant and efficient encoding of scene geometry, appearance, and semantics. Moreover, grounding language in 3D scenes has proven to be an effective strategy for 3D scene understanding.…

Computer Vision and Pattern Recognition · Computer Science 2026-01-27 Mengjiao Ma , Qi Ma , Yue Li , Jiahuan Cheng , Runyi Yang , Bin Ren , Nikola Popovic , Mingqiang Wei , Nicu Sebe , Luc Van Gool , Theo Gevers , Martin R. Oswald , Danda Pani Paudel

Photorealistic reconstruction of street scenes is essential for developing real-world simulators in autonomous driving. While recent methods based on 3D/4D Gaussian Splatting (GS) have demonstrated promising results, they still encounter…

Computer Vision and Pattern Recognition · Computer Science 2025-07-10 Xiaobao Wei , Qingpo Wuwu , Zhongyu Zhao , Zhuangzhe Wu , Nan Huang , Ming Lu , Ningning MA , Shanghang Zhang

We present Splat-SAP, a feed-forward approach to render novel views of human-centered scenes from binocular cameras with large sparsity. Gaussian Splatting has shown its promising potential in rendering tasks, but it typically necessitates…

Computer Vision and Pattern Recognition · Computer Science 2025-12-01 Boyao Zhou , Shunyuan Zheng , Zhanfeng Liao , Zihan Ma , Hanzhang Tu , Boning Liu , Yebin Liu

Feed-forward 3D Gaussian Splatting methods enable single-pass reconstruction and real-time rendering. However, they typically adopt rigid pixel-to-Gaussian or voxel-to-Gaussian pipelines that uniformly allocate Gaussians, leading to…

Computer Vision and Pattern Recognition · Computer Science 2026-03-26 Injae Kim , Chaehyeon Kim , Minseong Bae , Minseok Joo , Hyunwoo J. Kim

We present DeSiRe-GS, a self-supervised gaussian splatting representation, enabling effective static-dynamic decomposition and high-fidelity surface reconstruction in complex driving scenarios. Our approach employs a two-stage optimization…

Computer Vision and Pattern Recognition · Computer Science 2025-07-29 Chensheng Peng , Chengwei Zhang , Yixiao Wang , Chenfeng Xu , Yichen Xie , Wenzhao Zheng , Kurt Keutzer , Masayoshi Tomizuka , Wei Zhan

Simulation is crucial for developing and evaluating autonomous vehicle (AV) systems. Recent literature builds on a new generation of generative models to synthesize highly realistic images for full-stack simulation. However, purely…

Computer Vision and Pattern Recognition · Computer Science 2025-06-25 Zehao Zhu , Yuliang Zou , Chiyu Max Jiang , Bo Sun , Vincent Casser , Xiukun Huang , Jiahao Wang , Zhenpei Yang , Ruiqi Gao , Leonidas Guibas , Mingxing Tan , Dragomir Anguelov