English
Related papers

Related papers: Real2Sim: A Physics-driven and Editable Gaussian S…

200 papers

Visual navigation models often struggle in real-world dynamic environments due to limited robustness to the sim-to-real gap and the difficulty of training policies tailored to target deployment environments (e.g., households, restaurants,…

Robotics · Computer Science 2026-02-17 Seungyeon Yoo , Youngseok Jang , Dabin Kim , Youngsoo Han , Seungwoo Jung , H. Jin Kim

Recent advances in Dense Simultaneous Localization and Mapping (SLAM) have demonstrated remarkable performance in static environments. However, dense SLAM in dynamic environments remains challenging. Most methods directly remove dynamic…

Robotics · Computer Science 2025-12-11 Siting Zhu , Yuxiang Huang , Wenhua Wu , Chaokang Jiang , Yongbo Chen , I-Ming Chen , Hesheng Wang

Feed-forward 3D Gaussian Splatting methods have achieved impressive reconstruction quality for autonomous driving scenes, yet they entangle scene geometry with transient appearance properties such as lighting, weather, and time of day. This…

Computer Vision and Pattern Recognition · Computer Science 2026-04-07 Quentin Herau , Tianshuo Xu , Depu Meng , Jiezhi Yang , Chensheng Peng , Spencer Sherk , Yihan Hu , Wei Zhan

Most existing Dynamic Gaussian Splatting methods for complex dynamic urban scenarios rely on accurate object-level supervision from expensive manual labeling, limiting their scalability in real-world applications. In this paper, we…

Computer Vision and Pattern Recognition · Computer Science 2025-03-28 Su Sun , Cheng Zhao , Zhuoyang Sun , Yingjie Victor Chen , Mei Chen

World models that support controllable and editable spatiotemporal environments are valuable for robotics, enabling scalable training data, repro ducible evaluation, and flexible task design. While recent text-to-video models generate…

Computer Vision and Pattern Recognition · Computer Science 2025-10-07 Xuehai He , Shijie Zhou , Thivyanth Venkateswaran , Kaizhi Zheng , Ziyu Wan , Achuta Kadambi , Xin Eric Wang

Driving World Models (DWMs) have been developing rapidly with the advances of generative models. However, existing DWMs lack 3D scene understanding capabilities and can only generate content conditioned on input data, without the ability to…

Computer Vision and Pattern Recognition · Computer Science 2026-05-19 Tianchen Deng , Xuefeng Chen , Yi Chen , Qu Chen , Yuyao Xu , Lijin Yang , Le Xu , Yu Zhang , Bo Zhang , Wuxiong Huang , Hesheng Wang

Real-time rendering of dynamic scenes with view-dependent effects remains a fundamental challenge in computer graphics. While recent advances in Gaussian Splatting have shown promising results separately handling dynamic scenes (4DGS) and…

Computer Vision and Pattern Recognition · Computer Science 2025-03-12 Zhongpai Gao , Benjamin Planche , Meng Zheng , Anwesa Choudhuri , Terrence Chen , Ziyan Wu

Generating realistic 3D scenes from text is crucial for immersive applications like VR, AR, and gaming. While text-driven approaches promise efficiency, existing methods suffer from limited 3D-text data and inconsistent multi-view…

Computer Vision and Pattern Recognition · Computer Science 2026-02-03 Xin Zhang , Shen Chen , Jiale Zhou , Lei Li

For end-to-end autonomous driving (E2E-AD), the evaluation system remains an open problem. Existing closed-loop evaluation protocols usually rely on simulators like CARLA being less realistic; while NAVSIM using real-world vision data, yet…

Robotics · Computer Science 2024-12-16 Junqi You , Xiaosong Jia , Zhiyuan Zhang , Yutao Zhu , Junchi Yan

With the rapid advancement of intelligent transportation systems, text-driven image generation and editing techniques have demonstrated significant potential in providing rich, controllable visual scene data for applications such as traffic…

Computer Vision and Pattern Recognition · Computer Science 2025-12-01 Feng Lv , Haoxuan Feng , Zilu Zhang , Chunlong Xia , Yanfeng Li

Simulation provides a cost-effective and flexible platform for data generation and policy learning to develop robotic systems. However, bridging the gap between simulation and real-world dynamics remains a significant challenge, especially…

Accurate and realistic 3D scene reconstruction enables the lifelike creation of autonomous driving simulation environments. With advancements in 3D Gaussian Splatting (3DGS), previous studies have applied it to reconstruct complex dynamic…

Computer Vision and Pattern Recognition · Computer Science 2025-02-21 Yedong Shen , Xinran Zhang , Yifan Duan , Shiqi Zhang , Heng Li , Yilong Wu , Jianmin Ji , Yanyong Zhang

4D content generation has achieved remarkable progress recently. However, existing methods suffer from long optimization times, a lack of motion controllability, and a low quality of details. In this paper, we introduce DreamGaussian4D…

Computer Vision and Pattern Recognition · Computer Science 2024-06-11 Jiawei Ren , Liang Pan , Jiaxiang Tang , Chi Zhang , Ang Cao , Gang Zeng , Ziwei Liu

Differentiable rendering techniques have recently shown promising results for free-viewpoint video synthesis of characters. However, such methods, either Gaussian Splatting or neural implicit rendering, typically necessitate per-subject…

Computer Vision and Pattern Recognition · Computer Science 2024-11-19 Boyao Zhou , Shunyuan Zheng , Hanzhang Tu , Ruizhi Shao , Boning Liu , Shengping Zhang , Liqiang Nie , Yebin Liu

Urban scene reconstruction is critical for autonomous driving, enabling structured 3D representations for data synthesis and closed-loop testing. Supervised approaches rely on costly human annotations and lack scalability, while current…

Computer Vision and Pattern Recognition · Computer Science 2025-11-11 Chenpeng Su , Wenhua Wu , Chensheng Peng , Tianchen Deng , Zhe Liu , Hesheng Wang

Building simulation environments for developing and testing autonomous vehicles necessitates that the simulators accurately model the statistical realism of the real-world environment, including the interaction with other vehicles driven by…

Reconstructing dynamic 3D scenes with photorealistic detail and strong temporal coherence remains a significant challenge. Existing Gaussian splatting approaches for dynamic scene modeling often rely on per-frame optimization, which can…

Computer Vision and Pattern Recognition · Computer Science 2026-03-13 Tingxuan Huang , Haowei Zhu , Jun-hai Yong , Hao Pan , Bin Wang

We propose a method to enhance 3D Gaussian Splatting (3DGS)~\cite{Kerbl2023}, addressing challenges in initialization, optimization, and density control. Gaussian Splatting is an alternative for rendering realistic images while supporting…

Computer Vision and Pattern Recognition · Computer Science 2025-07-02 Xingjun Wang , Lianlei Shan

Current validation methods often rely on recorded data and basic functional checks, which may not be sufficient to encompass the scenarios an autonomous vehicle might encounter. In addition, there is a growing need for complex scenarios…

Robotics · Computer Science 2024-02-08 Marc Kaufeld , Rainer Trauth , Johannes Betz

Creating accurate, physical simulations directly from real-world robot motion holds great value for safe, scalable, and affordable robot learning, yet remains exceptionally challenging. Real robot data suffers from occlusions, noisy camera…

Robotics · Computer Science 2025-06-10 Ben Moran , Mauro Comi , Arunkumar Byravan , Steven Bohez , Tom Erez , Zhibin Li , Leonard Hasenclever