English
Related papers

Related papers: SimScale: Learning to Drive via Real-World Simulat…

200 papers

Verification and validation of autonomous driving (AD) systems and components is of increasing importance, as such technology increases in real-world prevalence. Safety-critical scenario generation is a key approach to robustify AD policies…

Robotics · Computer Science 2025-07-15 Benjamin Stoler , Ingrid Navarro , Jonathan Francis , Jean Oh

Real-world evaluation of perception-based planning models for robotic systems, such as autonomous vehicles, can be safely and inexpensively conducted offline, i.e. by computing model prediction error over a pre-collected validation dataset…

Robotics · Computer Science 2025-11-11 Animikh Aich , Adwait Kulkarni , Eshed Ohn-Bar

End-to-end autonomous driving models based on Vision-Language-Action (VLA) architectures have shown promising results by learning driving policies through behavior cloning on expert demonstrations. However, imitation learning inherently…

Computer Vision and Pattern Recognition · Computer Science 2026-04-06 Zihao Sheng , Xin Ye , Jingru Luo , Sikai Chen , Liu Ren

Analyzing large volumes of real-world driving data is essential for providing meaningful and reliable insights into real-world trips, scenarios, and human driving behaviors. To this end, we developed a multi-level data processing approach…

Systems and Control · Electrical Eng. & Systems 2025-01-16 Jihun Han , Dominik Karbowski , Ayman Moawad , Namdoo Kim , Aymeric Rousseau , Shihong Fan , Jason Hoon Lee , Jinho Ha

Modern autonomous systems require extensive testing to ensure reliability and build trust in ground vehicles. However, testing these systems in the real-world is challenging due to the lack of large and diverse datasets, especially in edge…

Robotics · Computer Science 2023-06-06 Xiangyu Bai , Yedi Luo , Le Jiang , Aniket Gupta , Pushyami Kaveti , Hanumant Singh , Sarah Ostadabbas

Autonomous driving has gained significant advancements in recent years. However, obtaining a robust control policy for driving remains challenging as it requires training data from a variety of scenarios, including rare situations (e.g.,…

Robotics · Computer Science 2019-07-23 Weizi Li , David Wolinski , Ming C. Lin

Data-driven simulators promise high data-efficiency for driving policy learning. When used for modelling interactions, this data-efficiency becomes a bottleneck: Small underlying datasets often lack interesting and challenging edge cases…

Ensuring the safety of Autonomous Driving Systems (ADS) requires realistic and reproducible test scenarios, yet extracting such scenarios from multimodal crash reports remains a major challenge. Large Language Models (LLMs) often…

Software Engineering · Computer Science 2025-11-26 Siwei Luo , Yang Zhang , Yao Deng , Linfeng Liang , Xi Zheng

AutoDRIVE is envisioned to be a comprehensive research platform for scaled autonomous vehicles. This work is a stepping-stone towards the greater goal of realizing such a research platform. Particularly, this work proposes a…

Robotics · Computer Science 2022-11-18 Tanmay Vilas Samak , Chinmay Vilas Samak

We present a novel method for testing the safety of self-driving vehicles in simulation. We propose an alternative to sensor simulation, as sensor simulation is expensive and has large domain gaps. Instead, we directly simulate the outputs…

Computer Vision and Pattern Recognition · Computer Science 2020-08-14 Kelvin Wong , Qiang Zhang , Ming Liang , Bin Yang , Renjie Liao , Abbas Sadat , Raquel Urtasun

While supervised learning is widely used for perception modules in conventional autonomous driving solutions, scalability is hindered by the huge amount of data labeling needed. In contrast, while end-to-end architectures do not require…

Computer Vision and Pattern Recognition · Computer Science 2021-03-31 Elmira Amirloo , Mohsen Rohani , Ershad Banijamali , Jun Luo , Pascal Poupart

We present Sim-on-Wheels, a safe, realistic, and vehicle-in-loop framework to test autonomous vehicles' performance in the real world under safety-critical scenarios. Sim-on-wheels runs on a self-driving vehicle operating in the physical…

Robotics · Computer Science 2023-06-16 Yuan Shen , Bhargav Chandaka , Zhi-hao Lin , Albert Zhai , Hang Cui , David Forsyth , Shenlong Wang

Most self-driving systems rely on hand-coded perception outputs and engineered driving rules. Learning directly from human driving data with an end-to-end method can allow for a training architecture that is simpler and scales well with…

Computer Vision and Pattern Recognition · Computer Science 2025-04-29 Mitchell Goff , Greg Hogan , George Hotz , Armand du Parc Locmaria , Kacper Raczy , Harald Schäfer , Adeeb Shihadeh , Weixing Zhang , Yassine Yousfi

This paper presents a safe imitation learning approach for autonomous vehicle driving, with attention on real-life human driving data and experimental validation. In order to increase occupant's acceptance and gain drivers' trust, the…

Systems and Control · Electrical Eng. & Systems 2021-10-11 Flavia Sofia Acerbo , Mohsen Alirezaei , Herman Van der Auweraer , Tong Duy Son

Developing control policies in simulation is often more practical and safer than directly running experiments in the real world. This applies to policies obtained from planning and optimization, and even more so to policies obtained from…

Autonomous systems, such as self-driving vehicles, quadrupeds, and robot manipulators, are largely enabled by the rapid development of artificial intelligence. However, such systems involve several trustworthy challenges such as safety,…

Robotics · Computer Science 2023-05-02 Wenhao Ding

End-to-end autonomous driving has been recently seen rapid development, exerting a profound influence on both industry and academia. However, the existing work places excessive focus on ego-vehicle status as their sole learning objectives…

Robotics · Computer Science 2025-08-08 Rui Yu , Xianghang Zhang , Runkai Zhao , Huaicheng Yan , Meng Wang

The capability to follow a lead-vehicle and avoid rear-end collisions is one of the most important functionalities for human drivers and various Advanced Driver Assist Systems (ADAS). Existing safety performance justification of the…

Robotics · Computer Science 2022-05-25 Bowen Weng , Minghao Zhu , Keith Redmill

Imitation learning is a promising approach for training autonomous vehicles (AV) to navigate complex traffic environments by mimicking expert driver behaviors. While existing imitation learning frameworks focus on leveraging expert…

Robotics · Computer Science 2025-09-25 Yasin Sonmez , Hanna Krasowski , Murat Arcak

Large vision-language models (VLMs) have garnered increasing interest in autonomous driving areas, due to their advanced capabilities in complex reasoning tasks essential for highly autonomous vehicle behavior. Despite their potential,…

Computer Vision and Pattern Recognition · Computer Science 2024-07-23 Ming Nie , Renyuan Peng , Chunwei Wang , Xinyue Cai , Jianhua Han , Hang Xu , Li Zhang