English
Related papers

Related papers: A causal model of safety assurance for machine lea…

200 papers

We propose a framework for building graphical causal model that is based on the concept of causal mechanisms. Causal models are intuitive for human users and, more importantly, support the prediction of the effect of manipulation. We…

Artificial Intelligence · Computer Science 2013-01-18 Tsai-Ching Lu , Marek J. Druzdzel , Tze-Yun Leong

Despite the increasing testing operations of automated vehicles on public roads, media reports on incidents show that safety issues caused by automated driving systems persist to this day. Manufacturers face high development uncertainty…

Systems and Control · Electrical Eng. & Systems 2025-07-08 Marvin Loba , Nayel Fabian Salem , Marcus Nolte , Andreas Dotzler , Dieter Ludwig , Markus Maurer

The rapid advancement of machine learning (ML) has led to its increasing integration into cyber-physical systems (CPS) across diverse domains. While CPS offer powerful capabilities, incorporating ML components introduces significant safety…

Machine Learning · Computer Science 2025-07-15 Calum Corrie Imrie , Ioannis Stefanakos , Sepeedeh Shahbeigi , Richard Hawkins , Simon Burton

The article explores the emerging domain of incentive-aware machine learning (ML), which focuses on algorithmic decision-making in contexts where individuals can strategically modify their inputs to influence outcomes. It categorizes the…

Computer Science and Game Theory · Computer Science 2025-05-09 Chara Podimata

A typical problem in causal modeling is the instability of model structure learning, i.e., small changes in finite data can result in completely different optimal models. The present work introduces a novel causal modeling algorithm for…

Ensuring safety and explainability of machine learning (ML) is a topic of increasing relevance as data-driven applications venture into safety-critical application domains, traditionally committed to high safety standards that are not…

Machine Learning · Computer Science 2020-05-28 Koorosh Aslansefat , Ioannis Sorokos , Declan Whiting , Ramin Tavakoli Kolagari , Yiannis Papadopoulos

In spite of machine learning's rapid growth, its engineering support is scattered in many forms, and tends to favor certain engineering stages, stakeholders, and evaluation preferences. We envision a capability-based framework, which uses…

Artificial Intelligence · Computer Science 2023-02-14 Chenyang Yang , Rachel Brower-Sinning , Grace A. Lewis , Christian Kästner , Tongshuang Wu

This paper serves as a literature review of methodology concerning the (modern) causal inference methods to address the causal estimand with observational/survey data that have been or will be used in social science research. Mainly, this…

Econometrics · Economics 2024-08-02 Guanghui Pan

The zeitgeist of the digital era has been dominated by an expanding integration of Artificial Intelligence~(AI) in a plethora of applications across various domains. With this expansion, however, questions of the safety and reliability of…

Artificial Intelligence · Computer Science 2023-12-19 Al-Harith Farhad , Ioannis Sorokos , Mohammed Naveed Akram , Koorosh Aslansefat , Daniel Schneider

Many methods of estimating causal models do not provide estimates of confidence in the resulting model. In this work, a metric is proposed for validating the output of a causal model fit; the robustness of the model structure with resampled…

While it has been repeatedly shown that learning-based controllers can provide superior performance, they often lack of safety guarantees. This paper aims at addressing this problem by introducing a model predictive safety certification…

Systems and Control · Computer Science 2019-04-09 Kim P. Wabersich , Melanie N. Zeilinger

High-accurate machine learning (ML) image classifiers cannot guarantee that they will not fail at operation. Thus, their deployment in safety-critical applications such as autonomous vehicles is still an open issue. The use of fault…

Artificial Intelligence · Computer Science 2021-10-05 Raul Sena Ferreira , Jean Arlat , Jeremie Guiochet , Hélène Waeselynck

Background: Symbolic models, particularly decision trees, are widely used in software engineering for explainable analytics in defect prediction, configuration tuning, and software quality assessment. Most of these models rely on…

Software Engineering · Computer Science 2026-02-19 Amirali Rayegan , Tim Menzies

Medication errors continue to be the leading cause of avoidable patient harm in hospitals. This paper sets out a framework to assure medication safety that combines machine learning and safety engineering methods. It uses safety analysis to…

Machine Learning · Computer Science 2021-01-15 Yan Jia , Tom Lawton , John McDermid , Eric Rojas , Ibrahim Habli

Autonomous vehicles rely on machine learning to solve challenging tasks in perception and motion planning. However, automotive software safety standards have not fully evolved to address the challenges of machine learning safety such as…

Machine Learning · Computer Science 2019-12-23 Sina Mohseni , Mandar Pitale , Vasu Singh , Zhangyang Wang

Large Reasoning Models (LRMs) have exhibited extraordinary prowess in tasks like mathematics and coding, leveraging their advanced reasoning capabilities. Nevertheless, as these capabilities progress, significant concerns regarding their…

Computation and Language · Computer Science 2025-05-27 Cheng Wang , Yue Liu , Baolong Bi , Duzhen Zhang , Zhong-Zhi Li , Yingwei Ma , Yufei He , Shengju Yu , Xinfeng Li , Junfeng Fang , Jiaheng Zhang , Bryan Hooi

Machine Learning (ML) technologies have been increasingly adopted in Medical Cyber-Physical Systems (MCPS) to enable smart healthcare. Assuring the safety and effectiveness of learning-enabled MCPS is challenging, as such systems must…

Machine Learning · Computer Science 2024-09-21 Maryam Bagheri , Josephine Lamp , Xugui Zhou , Lu Feng , Homa Alemzadeh

Despite the growing number of automated vehicles on public roads, operating such systems in open contexts inevitably involves incidents. Developing a defensible case that the residual risk is reduced to a reasonable (societally acceptable)…

Systems and Control · Electrical Eng. & Systems 2026-05-14 Marvin Loba , Robert Graubohm , Niklas Braun , Nayel Fabian Salem , Andreas Dotzler , Marcus Nolte , Torben Stolte , Richard Schubert , Markus Maurer

Machine learning (ML) systems are utilized in critical sectors, such as healthcare, law enforcement, and finance. However, these systems are often trained on historical data that contains demographic biases, leading to ML decisions that…

Machine Learning · Computer Science 2025-06-10 Jake Robertson , Noah Hollmann , Samuel Müller , Noor Awad , Frank Hutter

Machine learning (ML) components are increasingly integrated into software products, yet their complexity and inherent uncertainty often lead to unintended and hazardous consequences, both for individuals and society at large. Despite these…

Software Engineering · Computer Science 2025-09-15 Yining Hong , Christopher S. Timperley , Christian Kästner