English
Related papers

Related papers: Facilitating Change Implementation for Continuous …

200 papers

Countless domains rely on Machine Learning (ML) models, including safety-critical domains, such as autonomous driving, which this paper focuses on. While the black box nature of ML is simply a nuisance in some domains, in safety-critical…

Artificial Intelligence · Computer Science 2024-06-24 Lynn Vonderhaar , Timothy Elvira , Tyler Procko , Omar Ochoa

Predictive safety filters enable the integration of potentially unsafe learning-based control approaches and humans into safety-critical systems. In addition to simple constraint satisfaction, many control problems involve additional…

Systems and Control · Electrical Eng. & Systems 2024-09-19 Elias Milios , Kim Peter Wabersich , Felix Berkel , Lukas Schwenkel

Safety-critical Autonomous Systems require trustworthy and transparent decision-making process to be deployable in the real world. The advancement of Machine Learning introduces high performance but largely through black-box algorithms. We…

Robotics · Computer Science 2022-12-02 Hongrui Zheng , Zirui Zang , Shuo Yang , Rahul Mangharam

Vision-language models (VLMs) are increasingly deployed in real-world and embodied settings where safety decisions depend on visual context. However, it remains unclear which visual evidence drives these judgments. We study whether…

Computer Vision and Pattern Recognition · Computer Science 2026-03-20 Carlos Hinojosa , Clemens Grange , Bernard Ghanem

This paper describes the comprehensive safety framework that underpinned the development, release process, and regulatory approval of BMW's first SAE Level 3 Automated Driving System. The framework combines established qualitative and…

Robotics · Computer Science 2025-03-27 Moritz Werling , Rainer Faller , Wolfgang Betz , Daniel Straub

The steadily increasing level of automation in human-centred systems demands rigorous design methods for analysing and controlling interactions between humans and automated components, especially in safety-critical applications. The…

Human-Computer Interaction · Computer Science 2025-11-19 Mehrnoush Hajnorouzi , Astrid Rakow , Martin Fränzle

Machine learning based image classification algorithms, such as deep neural network approaches, will be increasingly employed in critical settings such as quality control in industry, where transparency and comprehensibility of decisions…

Machine Learning · Computer Science 2022-03-18 Dennis Müller , Michael März , Stephan Scheele , Ute Schmid

Machine learning (ML) models are increasingly used as decision-support tools in high-risk domains. Evaluating the causal impact of deploying such models can be done with a randomized controlled trial (RCT) that randomizes users to ML vs.…

Methodology · Statistics 2025-07-17 Jacob M. Chen , Michael Oberst

Software organizations are increasingly incorporating machine learning (ML) into their product offerings, driving a need for new data management tools. Many of these tools facilitate the initial development of ML applications, but…

Software Engineering · Computer Science 2022-07-19 Shreya Shankar , Aditya Parameswaran

This paper presents a framework for the safety-critical control of robotic systems, when safety is defined on safe regions in the configuration space. To maintain safety, we synthesize a safe velocity based on control barrier function…

Robotics · Computer Science 2022-11-21 Tamas G. Molnar , Ryan K. Cosner , Andrew W. Singletary , Wyatt Ubellacker , Aaron D. Ames

Recent advancements in Multimodal Large Language Models (MLLMs) have demonstrated impressive capabilities in general visual understanding. However, their application to safety-critical driving scenarios remains limited by an inability to…

Computer Vision and Pattern Recognition · Computer Science 2026-05-22 Tomaso Trinci , Henrique Piñeiro Monteagudo , Leonardo Taccari

Model-based safety analysis approaches aim at finding critical failure combinations by analysis of models of the whole system (i.e. software, hardware, failure modes and environment). The advantage of these methods compared to traditional…

Logic in Computer Science · Computer Science 2010-06-29 Matthias Güdemann , Frank Ortmeier

Advanced Driver Assistance Systems (ADAS) increasingly rely on learning-based perception, yet safety-relevant failures often arise without component malfunction, driven instead by partial observability and semantic ambiguity in how risk is…

Artificial Intelligence · Computer Science 2026-03-31 Jean Douglas Carvalho , Hugo Taciro Kenji , Ahmad Mohammad Saber , Glaucia Melo , Max Mauro Dias Santos , Deepa Kundur

The automotive industry is experiencing a transition from assisted to highly automated driving. New concepts for validation of Automated Driving System (ADS) include amongst other a shift from a "technology based" approach to a "scenario…

Software Engineering · Computer Science 2023-02-02 Ilona Cieslik , Víctor J. Expósito Jiménez , Helmut Martin , Heiko Scharke , Hannes Schneider

Context: Machine learning (ML)-enabled systems are being increasingly adopted by companies aiming to enhance their products and operational processes. Objective: This paper aims to deliver a comprehensive overview of the current status quo…

Machine Learning (ML) seems to be one of the most promising solution to automate partially or completely some of the complex tasks currently realized by humans, such as driving vehicles, recognizing voice, etc. It is also an opportunity to…

This paper presents a scenario generation framework that creates diverse, parametrized, and safety-critical driving situations to validate the safety features of autonomous vehicles in simulation [15]. By modeling factors such as road…

Systems and Control · Electrical Eng. & Systems 2026-04-09 Kiruthiga Chandra Shekar , Aliasghar Moj Arab

This is an article or technical note which is intended to provides an insight journey of Machine Learning Systems (MLS) testing, its evolution, current paradigm and future work. Machine Learning Models, used in critical applications such as…

Software Engineering · Computer Science 2021-02-23 Raju

Machine learning algorithms increasingly influence our decisions and interact with us in all parts of our daily lives. Therefore, just as we consider the safety of power plants, highways, and a variety of other engineered socio-technical…

Computers and Society · Computer Science 2017-08-23 Kush R. Varshney , Homa Alemzadeh

Discovering potential failures of an autonomous system is important prior to deployment. Falsification-based methods are often used to assess the safety of such systems, but the cost of running many accurate simulation can be high. The…

Robotics · Computer Science 2023-10-03 Marc R. Schlichting , Nina V. Boord , Anthony L. Corso , Mykel J. Kochenderfer