English
Related papers

Related papers: Reliability Analysis of Artificial Intelligence Sy…

200 papers

While recent developments in autonomous vehicle (AV) technology highlight substantial progress, we lack tools for rigorous and scalable testing. Real-world testing, the $\textit{de facto}$ evaluation environment, places the public in…

Machine Learning · Computer Science 2019-01-15 Matthew O'Kelly , Aman Sinha , Hongseok Namkoong , John Duchi , Russ Tedrake

Assuring safety of artificial intelligence (AI) applied to safety-critical systems is of paramount importance. Especially since research in the field of automated driving shows that AI is able to outperform classical approaches, to handle…

Computers and Society · Computer Science 2025-04-28 Lars Ullrich , Michael Buchholz , Klaus Dietmayer , Knut Graichen

Deep Neural Networks have become the dominant solution for Autonomous Driving perception, but their opacity conflicts with emerging Trustworthy AI guidelines and complicates safety assurance, debugging, and human oversight. While…

Robotics · Computer Science 2026-05-25 Till Beemelmanns , Shayan Sharifi , Manas Mehrotra , Ayushman Choudhuri , Lutz Eckstein

Despite advancements in perception and planning for autonomous vehicles (AVs), validating their performance remains a significant challenge. The deployment of planning algorithms in real-world environments is often ineffective due to…

Robotics · Computer Science 2025-05-07 Joshua Ransiek , Philipp Reis , Tobias Schürmann , Eric Sax

To operate effectively in tomorrow's smart cities, autonomous vehicles (AVs) must rely on intra-vehicle sensors such as camera and radar as well as inter-vehicle communication. Such dependence on sensors and communication links exposes AVs…

Systems and Control · Computer Science 2018-05-09 Aidin Ferdowsi , Ursula Challita , Walid Saad , Narayan B. Mandayam

Background: Due to their diversity, complexity, and above all importance, safety-critical and dependable systems must be developed with special diligence. Criticality increases as these systems likely contain artificial intelligence (AI)…

Software Engineering · Computer Science 2025-06-03 Amra Ramic , Stefan Kugele

Evaluating the safety of an autonomous vehicle (AV) depends on the behavior of surrounding agents which can be heavily influenced by factors such as environmental context and informally-defined driving etiquette. A key challenge is in…

Robotics · Computer Science 2022-10-07 Karen Leung , Sushant Veer , Edward Schmerling , Marco Pavone

Traffic collision reconstruction traditionally relies on human expertise and can be accurate, but pre-crash reconstruction is more challenging. This study develops a multi-agent AI framework that reconstructs pre-crash scenarios and infers…

Artificial Intelligence · Computer Science 2026-04-03 Gerui Xu , Boyou Chen , Huizhong Guo , Dave LeBlanc , Arpan Kusari , Efe Yarbasi , Ananna Ahmed , Zhaonan Sun , Shan Bao

Artificial Intelligence (AI) is increasingly used in critical applications. Thus, the need for dependable AI systems is rapidly growing. In 2018, the European Commission appointed experts to a High-Level Expert Group on AI (AI-HLEG).…

Computers and Society · Computer Science 2021-03-17 Markus Borg , Joshua Bronson , Linus Christensson , Fredrik Olsson , Olof Lennartsson , Elias Sonnsjö , Hamid Ebabi , Martin Karsberg

We present an overview of recently developed data-driven tools for safety analysis of autonomous vehicles and advanced driver assist systems. The core algorithms combine model-based, hybrid system reachability analysis with sensitivity…

Systems and Control · Computer Science 2017-04-24 Chuchu Fan , Bolun Qi , Sayan Mitra

As artificial intelligence (AI) systems become increasingly deployed across the world, they are also increasingly implicated in AI incidents - harm events to individuals and society. As a result, industry, civil society, and governments…

Computers and Society · Computer Science 2024-09-26 Kevin Paeth , Daniel Atherton , Nikiforos Pittaras , Heather Frase , Sean McGregor

An open question in autonomous driving is how best to use simulation to validate the safety of autonomous vehicles. Existing techniques rely on simulated rollouts, which can be inefficient for finding rare failure events, while other…

Robotics · Computer Science 2020-06-29 Anthony Corso , Ritchie Lee , Mykel J. Kochenderfer

The increasing prevalence of Artificial Intelligence (AI) in safety-critical contexts such as air-traffic control leads to systems that are practical and efficient, and to some extent explainable to humans to be trusted and accepted. The…

Computers and Society · Computer Science 2023-06-28 Sabine Theis , Sophie Jentzsch , Fotini Deligiannaki , Charles Berro , Arne Peter Raulf , Carmen Bruder

Safety is a critical concern in autonomous vehicle (AV) systems, especially when AI-based sensing and perception modules are involved. However, due to the black box nature of AI algorithms, it makes closed-loop analysis and synthesis…

Systems and Control · Electrical Eng. & Systems 2025-09-16 Tao Yan , Zheyu Zhang , Jingjing Jiang , Wen-Hua Chen

Deep learning models excel at detecting anomaly patterns in normal data. However, they do not provide a direct solution for anomaly classification and scalability across diverse control systems, frequently failing to distinguish genuine…

Artificial Intelligence · Computer Science 2026-04-06 Jiyong Kwon , Ujin Jeon , Sooji Lee , Guang Lin

Recent progress in artificial intelligence (AI) using deep learning techniques has triggered its wide-scale use across a broad range of applications. These systems can already perform tasks such as natural language processing of voice and…

Computers and Society · Computer Science 2019-10-29 P. Santhanam , Eitan Farchi , Victor Pankratius

For future human-autonomous vehicle (AV) interactions to be effective and smooth, human-aware systems that analyze and align human needs with automation decisions are essential. Achieving this requires systems that account for human…

Artificial Intelligence · Computer Science 2025-05-22 Zahra Zahedi , Shashank Mehrotra , Teruhisa Misu , Kumar Akash

The advancement of automated vehicles introduces complex safety challenges, particularly in dynamic and unpredictable environments where AI-enabled perception systems must operate reliably. Ensuring compliance with safety standards such as…

To validate the safety of automated vehicles (AV), scenario-based testing aims to systematically describe driving scenarios an AV might encounter. In this process, continuous inputs such as velocities result in an infinite number of…

Machine Learning · Computer Science 2022-12-08 Max Winkelmann , Mike Kohlhoff , Hadj Hamma Tadjine , Steffen Müller

Artificial Intelligence (AI) shows promising applications for the perception and planning tasks in autonomous driving (AD) due to its superior performance compared to conventional methods. However, inscrutable AI systems exacerbate the…

Robotics · Computer Science 2024-11-12 Anton Kuznietsov , Balint Gyevnar , Cheng Wang , Steven Peters , Stefano V. Albrecht