English
Related papers

Related papers: The missing link: Developing a safety case for per…

200 papers

This paper investigates runtime monitoring of perception systems. Perception is a critical component of high-integrity applications of robotics and autonomous systems, such as self-driving cars. In these applications, failure of perception…

Robotics · Computer Science 2022-05-24 Pasquale Antonante , Heath Nilsen , Luca Carlone

Extensive evaluation of perception systems is crucial for ensuring the safety of intelligent vehicles in complex driving scenarios. Conventional performance metrics such as precision, recall and the F1-score assess the overall detection…

Robotics · Computer Science 2025-12-18 Jörg Gamerdinger , Sven Teufel , Stephan Amann , Lukas Marc Listl , Oliver Bringmann

Machine Learning (ML) models, such as deep neural networks, are widely applied in autonomous systems to perform complex perception tasks. New dependability challenges arise when ML predictions are used in safety-critical applications, like…

Machine Learning · Computer Science 2024-12-11 Raul Sena Ferreira , Joris Guérin , Kevin Delmas , Jérémie Guiochet , Hélène Waeselynck

Background: Due to their diversity, complexity, and above all importance, safety-critical and dependable systems must be developed with special diligence. Criticality increases as these systems likely contain artificial intelligence (AI)…

Software Engineering · Computer Science 2025-06-03 Amra Ramic , Stefan Kugele

The capability to follow a lead-vehicle and avoid rear-end collisions is one of the most important functionalities for human drivers and various Advanced Driver Assist Systems (ADAS). Existing safety performance justification of the…

Robotics · Computer Science 2022-05-25 Bowen Weng , Minghao Zhu , Keith Redmill

As Automated Driving Systems (ADS) technology advances, ensuring safety and public trust requires robust assurance frameworks, with safety cases emerging as a critical tool toward such a goal. This paper explores an approach to assess how a…

Software Engineering · Computer Science 2025-06-12 Scott Schnelle , Francesca Favaro , Laura Fraade-Blanar , David Wichner , Holland Broce , Justin Miranda

Our transportation world is rapidly transforming induced by an ever increasing level of autonomy. However, to obtain license of fully automated vehicles for widespread public use, it is necessary to assure safety of the entire system, which…

Computer Vision and Pattern Recognition · Computer Science 2022-08-02 Cornelius Buerkle , Fabian Oboril , Johannes Burr , Kay-Ulrich Scholl

In the future, AI will increasingly find its way into systems that can potentially cause physical harm to humans. For such safety-critical systems, it must be demonstrated that their residual risk does not exceed what is acceptable. This…

Artificial Intelligence · Computer Science 2022-02-14 Michael Kläs , Lisa Jöckel , Rasmus Adler , Jan Reich

Despite the increasing testing operations of automated vehicles on public roads, media reports on incidents show that safety issues caused by automated driving systems persist to this day. Manufacturers face high development uncertainty…

Systems and Control · Electrical Eng. & Systems 2025-07-08 Marvin Loba , Nayel Fabian Salem , Marcus Nolte , Andreas Dotzler , Dieter Ludwig , Markus Maurer

Data leakage is the inadvertent transfer of information between training and evaluation datasets that poses a subtle, yet critical, risk to the reliability of machine learning (ML) models in safety-critical systems such as automotive…

Cryptography and Security · Computer Science 2026-04-09 Md Abu Ahammed Babu , Sushant Kumar Pandey , Darko Durisic , Andras Balint , Miroslaw Staron

Advanced Driver Assistance Systems (ADAS) increasingly rely on learning-based perception, yet safety-relevant failures often arise without component malfunction, driven instead by partial observability and semantic ambiguity in how risk is…

Artificial Intelligence · Computer Science 2026-03-31 Jean Douglas Carvalho , Hugo Taciro Kenji , Ahmad Mohammad Saber , Glaucia Melo , Max Mauro Dias Santos , Deepa Kundur

This paper proposes a framework based on a causal model of safety upon which effective safety assurance cases for ML-based applications can be built. In doing so, we build upon established principles of safety engineering as well as…

Software Engineering · Computer Science 2022-08-10 Simon Burton

Motivated by vision-based control of autonomous vehicles, we consider the problem of controlling a known linear dynamical system for which partial state information, such as vehicle position, is extracted from complex and nonlinear data,…

Optimization and Control · Mathematics 2019-12-24 Sarah Dean , Nikolai Matni , Benjamin Recht , Vickie Ye

Perception systems, especially cameras, are the eyes of automated driving systems. Ensuring that they function reliably and robustly is therefore an important building block in the automation of vehicles. There are various approaches to…

Computer Vision and Pattern Recognition · Computer Science 2024-07-15 Philipp Rigoll , Laurenz Adolph , Lennart Ries , Eric Sax

Surrounding perceptions are quintessential for safe driving for connected and autonomous vehicles (CAVs), where the Bird's Eye View has been employed to accurately capture spatial relationships among vehicles. However, severe inherent…

Networking and Internet Architecture · Computer Science 2024-08-22 Zhengru Fang , Senkang Hu , Haonan An , Yuang Zhang , Jingjing Wang , Hangcheng Cao , Xianhao Chen , Yuguang Fang

Artificial intelligence (AI) models are becoming key components in an autonomous vehicle (AV), especially in handling complicated perception tasks. However, closing the loop through AI-based feedback may pose significant risks on…

Systems and Control · Electrical Eng. & Systems 2025-09-16 Tao Yan , Zheyu Zhang , Jingjing Jiang , Wen-Hua Chen

Machine Learning (ML) is a fundamental part of modern perception systems. In the last decade, the performance of computer vision using trained deep neural networks has outperformed previous approaches based on careful feature engineering.…

Software Engineering · Computer Science 2021-03-03 Markus Borg , Ronald Jabangwe , Simon Åberg , Arvid Ekblom , Ludwig Hedlund , August Lidfeldt

Assurance cases are used to communicate and assess confidence in critical system properties such as safety and security. Historically, assurance cases have been manually created documents, which are evaluated by system stakeholders through…

Software Engineering · Computer Science 2024-06-11 Ran Wei , Simon Foster , Haitao Mei , Fang Yan , Ruizhe Yang , Ibrahim Habli , Colin O'Halloran , Nick Tudor , Tim Kelly , Yakoub Nemouchi

In recent years, vision-centric perception has flourished in various autonomous driving tasks, including 3D detection, semantic map construction, motion forecasting, and depth estimation. Nevertheless, the latency of vision-centric…

Computer Vision and Pattern Recognition · Computer Science 2022-12-20 Xiaofeng Wang , Zheng Zhu , Yunpeng Zhang , Guan Huang , Yun Ye , Wenbo Xu , Ziwei Chen , Xingang Wang

Perception components in autonomous systems are often developed and optimized independently of downstream decision-making and control components, relying on established performance metrics like accuracy, precision, and recall. Traditional…

Robotics · Computer Science 2024-12-05 Weisi Fan , Jesse Lane , Qisai Liu , Soumik Sarkar , Tichakorn Wongpiromsarn