English
Related papers

Related papers: Guidelines for evaluation of complex multi agent t…

200 papers

Rare, yet critical, scenarios pose a significant challenge in testing and evaluating autonomous driving planners. Relying solely on real-world driving scenes requires collecting massive datasets to capture these scenarios. While automatic…

Multi-agent cyber-physical systems are present in a variety of applications. Agent decision-making can be affected due to errors induced by uncertain, dynamic operating environments or due to incorrect actions taken by an agent. When an…

Systems and Control · Electrical Eng. & Systems 2024-10-29 Luyao Niu , Hongchao Zhang , Dinuka Sahabandu , Bhaskar Ramasubramanian , Andrew Clark , Radha Poovendran

It is important to have multi-agent robotic system specifications that ensure correctness properties of safety and liveness. As these systems have concurrency, and often have dynamic environment, the formal specification and verification of…

Software Engineering · Computer Science 2016-04-20 Nadeem Akhtar , Malik M. Saad Missen

Behavior prediction remains one of the most challenging tasks in the autonomous vehicle (AV) software stack. Forecasting the future trajectories of nearby agents plays a critical role in ensuring road safety, as it equips AVs with the…

Artificial Intelligence · Computer Science 2021-11-16 Francis Indaheng , Edward Kim , Kesav Viswanadha , Jay Shenoy , Jinkyu Kim , Daniel J. Fremont , Sanjit A. Seshia

Recent Autonomous Vehicles (AV) technology includes machine learning and probabilistic techniques that add significant complexity to the traditional verification and validation methods. The research community and industry have widely…

Robotics · Computer Science 2022-06-22 Dhanoop Karunakaran , Julie Stephany Berrio , Stewart Worrall , Eduardo Nebot

Automated driving functions (ADFs) have become increasingly popular in recent years. However, their safety must be assured. Thus, the verification and validation of these functions is still an important open issue in research and…

Software Engineering · Computer Science 2023-08-10 Daniel Becker , Guido Küppers , Lutz Eckstein

The ability to operate safely in increasingly complex traffic scenarios is a fundamental requirement for Automated Driving Systems (ADS). Ensuring the safe release of ADS functions necessitates a precise understanding of the occurring…

Machine Learning · Computer Science 2025-10-28 Niklas Roßberg , Marion Neumeier , Sinan Hasirlioglu , Mohamed Essayed Bouzouraa , Michael Botsch

Complex systems have interested researchers across a broad range of fields for many years and as computing has become more accesible and feasible, it is now possible to simulate aspects of these systems. A major point of research is how…

Multiagent Systems · Computer Science 2019-01-16 George Hassan-Coring

Scenario-based testing for automated driving systems (ADS) must be able to simulate traffic scenarios that rely on interactions with other vehicles. Although many languages for high-level scenario modelling have been proposed, they lack the…

Scenario-based testing is an indispensable instrument for the comprehensive validation and verification of automated vehicles (AVs). However, finding a manageable and finite, yet representative subset of scenarios in a scalable, possibly…

Machine Learning · Computer Science 2025-07-08 Ferdinand Mütsch , Maximilian Zipfl , Nikolai Polley , J. Marius Zöllner

The autonomous car technology promises to replace human drivers with safer driving systems. But although autonomous cars can become safer than human drivers this is a long process that is going to be refined over time. Before these vehicles…

Artificial Intelligence · Computer Science 2018-05-09 Thomio Watanabe , Denis Wolf

Scientific testing techniques are essential for ensuring the safe operation of autonomous vehicles (AVs), with high-risk, highly interactive scenarios being a primary focus. To address the limitations of existing testing methods, such as…

Robotics · Computer Science 2025-07-30 Yicheng Guo , Chengkai Xu , Jiaqi Liu , Hao Zhang , Peng Hang , Jian Sun

In this paper, we present ViSTA, a framework for Virtual Scenario-based Testing of Autonomous Vehicles (AV), developed as part of the 2021 IEEE Autonomous Test Driving AI Test Challenge. Scenario-based virtual testing aims to construct…

Artificial Intelligence · Computer Science 2021-11-22 Andrea Piazzoni , Jim Cherian , Mohamed Azhar , Jing Yew Yap , James Lee Wei Shung , Roshan Vijay

Autonomous Vehicles (AV)'s wide-scale deployment appears imminent despite many safety challenges yet to be resolved. The modern autonomous vehicles will undoubtedly include machine learning and probabilistic techniques that add significant…

Robotics · Computer Science 2022-03-16 Dhanoop Karunakaran , Julie Stephany Berrio , Stewart Worrall , Eduardo Nebot

The homologation of automated vehicles, being safety-critical complex systems, requires sound evidence for their safe operability. Traditionally, verification and validation activities are guided by a combination of ISO 26262 and ISO/PAS…

Software Engineering · Computer Science 2020-05-12 Christian Neurohr , Lukas Westhofen , Tabea Henning , Thies de Graaff , Eike Möhlmann , Eckard Böde

This paper presents a method for testing the decision making systems of autonomous vehicles. Our approach involves perturbing stochastic elements in the vehicle's environment until the vehicle is involved in a collision. Instead of applying…

Robotics · Computer Science 2019-02-07 Mark Koren , Saud Alsaif , Ritchie Lee , Mykel J. Kochenderfer

Generating diverse and comprehensive interacting agents to evaluate the decision-making modules is essential for the safe and robust planning of autonomous vehicles~(AV). Due to efficiency and safety concerns, most researchers choose to…

Robotics · Computer Science 2021-03-08 Zhao-Heng Yin , Lingfeng Sun , Liting Sun , Masayoshi Tomizuka , Wei Zhan

Autonomous vehicles (AVs) have significantly advanced in real-world deployment in recent years, yet safety continues to be a critical barrier to widespread adoption. Traditional functional safety approaches, which primarily verify the…

Autonomous Driving Systems (ADS) use complex decision-making (DM) models with multimodal sensory inputs, making rigorous validation and verification (V&V) essential for safety and reliability. These models pose challenges in diagnosing…

Software Engineering · Computer Science 2025-10-07 Halit Eris , Stefan Wagner

The MUSICC project has created a proof-of-concept scenario database to be used as part of a type approval process for the verification of automated driving systems (ADS). This process must include a highly automated means of evaluating test…

Robotics · Computer Science 2020-05-27 Robert Myers , Zeyn Saigol