English
Related papers

Related papers: SimWorld: A Unified Benchmark for Simulator-Condit…

200 papers

Video image datasets are playing an essential role in design and evaluation of traffic vision algorithms. Nevertheless, a longstanding inconvenience concerning image datasets is that manually collecting and annotating large-scale…

Computer Vision and Pattern Recognition · Computer Science 2017-12-25 Xuan Li , Kunfeng Wang , Yonglin Tian , Lan Yan , Fei-Yue Wang

Deep vision models are now mature enough to be integrated in industrial and possibly critical applications such as autonomous navigation. Yet, data collection and labeling to train such models requires too much efforts and costs for a…

Machine Learning · Computer Science 2025-10-24 Estelle Chigot , Dennis G. Wilson , Meriem Ghrib , Fabrice Jimenez , Thomas Oberlin

Generating realistic images of complex visual scenes becomes challenging when one wishes to control the structure of the generated images. Previous approaches showed that scenes with few entities can be controlled using scene graphs, but…

Computer Vision and Pattern Recognition · Computer Science 2020-08-25 Roei Herzig , Amir Bar , Huijuan Xu , Gal Chechik , Trevor Darrell , Amir Globerson

Simulation is essential to validate autonomous driving systems. However, a simple simulation, even for an extremely high number of simulated miles or hours, is not sufficient. We need well-founded criteria showing that simulation does…

Software Engineering · Computer Science 2023-01-24 Changwen Li , Joseph Sifakis , Qiang Wang , Rongjie Yan , Jian Zhang

Action-conditioned video models offer a promising path to building general-purpose robot simulators that can improve directly from data. Yet, despite training on large-scale robot datasets, current state-of-the-art video models still…

Recent advancements in video generation have substantially improved visual quality and temporal coherence, making these models increasingly appealing for applications such as autonomous driving, particularly in the context of driving…

Computer Vision and Pattern Recognition · Computer Science 2025-08-25 Chun-Peng Chang , Chen-Yu Wang , Julian Schmidt , Holger Caesar , Alain Pagani

Scenario generation is one of the essential steps in scenario-based testing and, therefore, a significant part of the verification and validation of driver assistance functions and autonomous driving systems. However, the term scenario…

Robotics · Computer Science 2023-07-25 Barbara Schütt , Joshua Ransiek , Thilo Braun , Eric Sax

End-to-end (E2E) autonomous driving (AD) models require diverse, high-quality data to perform well across various driving scenarios. However, collecting large-scale real-world data is expensive and time-consuming, making high-fidelity…

Robotics · Computer Science 2025-03-25 Junhao Ge , Zuhong Liu , Longteng Fan , Yifan Jiang , Jiaqi Su , Yiming Li , Zhejun Zhang , Siheng Chen

In autonomous driving, end-to-end planners directly utilize raw sensor data, enabling them to extract richer scene features and reduce information loss compared to traditional planners. This raises a crucial research question: how can we…

Computer Vision and Pattern Recognition · Computer Science 2025-03-03 Yingyan Li , Lue Fan , Jiawei He , Yuqi Wang , Yuntao Chen , Zhaoxiang Zhang , Tieniu Tan

3D LiDAR scanners are playing an increasingly important role in autonomous driving as they can generate depth information of the environment. However, creating large 3D LiDAR point cloud datasets with point-level labels requires a…

Computer Vision and Pattern Recognition · Computer Science 2018-04-03 Xiangyu Yue , Bichen Wu , Sanjit A. Seshia , Kurt Keutzer , Alberto L. Sangiovanni-Vincentelli

Driving world models serve as a pivotal technology for autonomous driving by simulating environmental dynamics. However, existing approaches predominantly focus on future scene generation, often overlooking comprehensive 3D scene…

Computer Vision and Pattern Recognition · Computer Science 2026-05-01 Xin Zhou , Dingkang Liang , Xiwu Chen , Feiyang Tan , Dingyuan Zhang , Hengshuang Zhao , Xiang Bai

Understanding the evolution of 3D scenes is important for effective autonomous driving. While conventional methods mode scene development with the motion of individual instances, world models emerge as a generative framework to describe the…

Computer Vision and Pattern Recognition · Computer Science 2024-05-31 Lening Wang , Wenzhao Zheng , Yilong Ren , Han Jiang , Zhiyong Cui , Haiyang Yu , Jiwen Lu

The emergence of connected vehicles is driven by increasing customer and regulatory demands. To meet these, more complex software applications, some of which require service-based cloud and edge backends, are developed. When new software is…

Emerging Technologies · Computer Science 2024-12-18 M. Weiß , J. Stümpfle , F. Dettinger , N. Jazdi , M. Weyrich

Scene graphs (SGs) represent objects and their relationships as structured graphs, enabling applications in image generation, robotics, and 3D understanding. Recent work suggests that conditioning image generation on scene graphs improves…

Computer Vision and Pattern Recognition · Computer Science 2026-05-12 Rajalaxmi Rajagopalan , Romit Roy Choudhury

Robotic world models are a promising paradigm for forecasting future environment states, yet their inference speed and the physical plausibility of generated trajectories remain critical bottlenecks, limiting their real-world applications.…

Robotics · Computer Science 2025-09-26 Sibo Li , Qianyue Hao , Yu Shang , Yong Li

The generation and simulation of diverse real-world scenes have significant application value in the field of autonomous driving, especially for the corner cases. Recently, researchers have explored employing neural radiance fields or…

Robotics · Computer Science 2025-03-04 Bin Xie , Yingfei Liu , Tiancai Wang , Jiale Cao , Xiangyu Zhang

Data-driven learning has advanced autonomous driving, yet task-specific models struggle with out-of-distribution scenarios due to their narrow optimization objectives and reliance on costly annotated data. We present DriveX, a…

Computer Vision and Pattern Recognition · Computer Science 2025-05-27 Chen Shi , Shaoshuai Shi , Kehua Sheng , Bo Zhang , Li Jiang

We introduce Scenario Dreamer, a fully data-driven generative simulator for autonomous vehicle planning that generates both the initial traffic scene - comprising a lane graph and agent bounding boxes - and closed-loop agent behaviours.…

Robotics · Computer Science 2025-03-31 Luke Rowe , Roger Girgis , Anthony Gosselin , Liam Paull , Christopher Pal , Felix Heide

Current world models lack a unified and controlled setting for systematic evaluation, making it difficult to assess whether they truly capture the underlying rules that govern environment dynamics. In this work, we address this open…

Machine Learning · Computer Science 2025-12-01 Xinyi Li , Zaishuo Xia , Weyl Lu , Chenjie Hao , Yubei Chen

Autonomous driving technologies have achieved significant advances in recent years, yet their real-world deployment remains constrained by data scarcity, safety requirements, and the need for generalization across diverse environments. In…

Artificial Intelligence · Computer Science 2026-04-06 A. Humnabadkar , A. Sikdar , B. Cave , H. Zhang , N. Bessis , A. Behera