English
Related papers

Related papers: Critical concrete scenario generation using scenar…

200 papers

Reinforcement learning (RL) in autonomous driving employs a trial-and-error mechanism, enhancing robustness in unpredictable environments. However, crafting effective reward functions remains challenging, as conventional approaches rely…

Machine Learning · Computer Science 2025-06-02 Yongming Chen , Miner Chen , Liewen Liao , Mingyang Jiang , Xiang Zuo , Hengrui Zhang , Yuchen Xi , Songan Zhang

In urban environments, the complex and uncertain intersection scenarios are challenging for autonomous driving. To ensure safety, it is crucial to develop an adaptive decision making system that can handle the interaction with other…

Robotics · Computer Science 2022-07-26 Xianqi He , Lin Yang , Chao Lu , Zirui Li , Jianwei Gong

To ensure their safe use, autonomous vehicles (AVs) must meet rigorous certification criteria that involve executing maneuvers safely within (arbitrary) scenarios where other actors perform their intended maneuvers. For that purpose,…

Software Engineering · Computer Science 2026-05-27 Aren A. Babikian , Attila Ficsor , Oszkár Semeráth , Gunter Mussbacher , Dániel Varró

Reinforcement learning (RL) in real-world safety-critical target settings like urban driving is hazardous, imperiling the RL agent, other agents, and the environment. To overcome this difficulty, we propose a "safety-critical adaptation"…

Machine Learning · Computer Science 2021-01-19 Jesse Zhang , Brian Cheung , Chelsea Finn , Sergey Levine , Dinesh Jayaraman

Simulation-based testing is crucial for validating autonomous vehicles (AVs), yet existing scenario generation methods either overfit to common driving patterns or operate in an offline, non-interactive manner that fails to expose rare,…

Artificial Intelligence · Computer Science 2025-07-16 Yuewen Mei , Tong Nie , Jian Sun , Ye Tian

The homologation of automated vehicles, being safety-critical complex systems, requires sound evidence for their safe operability. Traditionally, verification and validation activities are guided by a combination of ISO 26262 and ISO/PAS…

Software Engineering · Computer Science 2020-05-12 Christian Neurohr , Lukas Westhofen , Tabea Henning , Thies de Graaff , Eike Möhlmann , Eckard Böde

Navigating urban environments represents a complex task for automated vehicles. They must reach their goal safely and efficiently while considering a multitude of traffic participants. We propose a modular decision making algorithm to…

Robotics · Computer Science 2019-04-26 Maxime Bouton , Alireza Nakhaei , Kikuo Fujimura , Mykel J. Kochenderfer

Compliance with maritime traffic rules is essential for the safe operation of autonomous vessels, yet training reinforcement learning (RL) agents to adhere to them is challenging. The behavior of RL agents is shaped by the training…

Systems and Control · Electrical Eng. & Systems 2026-05-28 Marlon Müller , Florian Finkeldei , Hanna Krasowski , Murat Arcak , Matthias Althoff

Applying reinforcement learning to autonomous driving has garnered widespread attention. However, classical reinforcement learning methods optimize policies by maximizing expected rewards but lack sufficient safety considerations, often…

Robotics · Computer Science 2025-03-28 Bo Leng , Ran Yu , Wei Han , Lu Xiong , Zhuoren Li , Hailong Huang

Scenario generation is one of the essential steps in scenario-based testing and, therefore, a significant part of the verification and validation of driver assistance functions and autonomous driving systems. However, the term scenario…

Robotics · Computer Science 2023-07-25 Barbara Schütt , Joshua Ransiek , Thilo Braun , Eric Sax

In contemporary autonomous driving testing, virtual simulation has become an important approach due to its efficiency and cost effectiveness. However, existing methods usually rely on reinforcement learning to generate risky scenarios,…

Robotics · Computer Science 2026-03-24 Chen Xiong , Cheng Wang , Yuhang Liu , Zirui Wu , Ye Tian

Simulation is essential to validate autonomous driving systems. However, a simple simulation, even for an extremely high number of simulated miles or hours, is not sufficient. We need well-founded criteria showing that simulation does…

Software Engineering · Computer Science 2023-01-24 Changwen Li , Joseph Sifakis , Qiang Wang , Rongjie Yan , Jian Zhang

This work introduces interactive traffic scenarios in the CARLA simulator, which are based on real-world traffic. We concentrate on tactical tasks lasting several seconds, which are especially challenging for current control methods. The…

Scenario-based testing is envisioned as a key approach for the safety assurance of autonomous vehicles. In scenario-based testing, relevant (driving) scenarios are the basis of tests. Many recent works focus on specification, variation,…

Software Engineering · Computer Science 2023-07-12 Till Schallau , Stefan Naujokat , Fiona Kullmann , Falk Howar

The operational space of an autonomous vehicle (AV) can be diverse and vary significantly. This may lead to a scenario that was not postulated in the design phase. Due to this, formulating a rule based decision maker for selecting maneuvers…

Robotics · Computer Science 2019-04-02 Subramanya Nageshrao , Eric Tseng , Dimitar Filev

Generating adversarial safety-critical scenarios is a pivotal method for testing autonomous driving systems, as it identifies potential weaknesses and enhances system robustness and reliability. However, existing approaches predominantly…

Robotics · Computer Science 2025-03-03 Yukuan Yang , Xucheng Lu , Zhili Zhang , Zepeng Wu , Guoqi Li , Lingzhong Meng , Yunzhi Xue

As safety violations can lead to severe consequences in real-world robotic applications, the increasing deployment of Reinforcement Learning (RL) in robotic domains has propelled the study of safe exploration for reinforcement learning…

Artificial Intelligence · Computer Science 2022-09-21 Hanping Zhang , Yuhong Guo

Ensuring safety in autonomous driving (AD) remains a significant challenge, especially in highly dynamic and complex traffic environments where diverse agents interact and unexpected hazards frequently emerge. Traditional reinforcement…

Robotics · Computer Science 2025-10-14 Dong Hu , Fenqing Hu , Lidong Yang , Chao Huang

Recent Autonomous Vehicles (AV) technology includes machine learning and probabilistic techniques that add significant complexity to the traditional verification and validation methods. The research community and industry have widely…

Robotics · Computer Science 2022-06-22 Dhanoop Karunakaran , Julie Stephany Berrio , Stewart Worrall , Eduardo Nebot

Reinforcement Learning (RL) is essentially a trial-and-error learning procedure which may cause unsafe behavior during the exploration-and-exploitation process. This hinders the application of RL to real-world control problems, especially…

Machine Learning · Computer Science 2021-05-03 Yutong Li , Nan Li , H. Eric Tseng , Anouck Girard , Dimitar Filev , Ilya Kolmanovsky