English
Related papers

Related papers: Towards Counterfactual Explanation and Assertion I…

200 papers

To construct interpretable explanations that are consistent with the original ML model, counterfactual examples---showing how the model's output changes with small perturbations to the input---have been proposed. This paper extends the work…

Machine Learning · Computer Science 2020-06-16 Divyat Mahajan , Chenhao Tan , Amit Sharma

Clustering algorithms rely on complex optimisation processes that may be difficult to comprehend, especially for individuals who lack technical expertise. While many explainable artificial intelligence techniques exist for supervised…

Machine Learning · Computer Science 2024-09-20 Aurora Spagnol , Kacper Sokol , Pietro Barbiero , Marc Langheinrich , Martin Gjoreski

Machine learning models that automate decision-making are increasingly being used in consequential areas such as loan approvals, pretrial bail, hiring, and many more. Unfortunately, most of these models are black-boxes, i.e., they are…

Artificial Intelligence · Computer Science 2023-10-24 Sopam Dasgupta , Farhad Shakerin , Joaquín Arias , Elmer Salazar , Gopal Gupta

We present a new method for counterfactual explanations (CFEs) based on Bayesian optimisation that applies to both classification and regression models. Our method is a globally convergent search algorithm with support for arbitrary…

Machine Learning · Computer Science 2021-06-30 Thomas Spooner , Danial Dervovic , Jason Long , Jon Shepard , Jiahao Chen , Daniele Magazzeni

Counterfactual Explanations (CEs) help address the question: How can the factors that influence the prediction of a predictive model be changed to achieve a more favorable outcome from a user's perspective? Thus, they bear the potential to…

Machine Learning · Computer Science 2023-11-27 Xuan Zhao , Klaus Broelemann , Gjergji Kasneci

Counterfactual explanations describe how to modify a feature vector in order to flip the outcome of a trained classifier. Obtaining robust counterfactual explanations is essential to provide valid algorithmic recourse and meaningful…

Machine Learning · Computer Science 2024-03-22 Alexandre Forel , Axel Parmentier , Thibaut Vidal

Given the safety-critical functions of autonomous cyber-physical systems (CPS) across diverse domains, testing these systems is essential. While conventional software and hardware testing methodologies offer partial insights, they…

Systems and Control · Electrical Eng. & Systems 2024-02-15 Sanaz Sheikhi , Stanley Bak

This paper studies provable security guarantees for cyber-physical systems (CPS) under actuator attacks. In particular, we consider CPS safety and propose a new attack detection mechanism based on zeroing control barrier function (ZCBF)…

Systems and Control · Electrical Eng. & Systems 2025-02-21 Kunal Garg , Ricardo G. Sanfelice , Alvaro A. Cardenas

The rigorous safety verification of control systems in critical applications is essential, given their increasing complexity and integration into everyday life. Simulation-based falsification approaches play a pivotal role in the safety…

Systems and Control · Electrical Eng. & Systems 2024-03-13 Joshua Yancosek , Ali Baheri

Interpretable machine learning seeks to understand the reasoning process of complex black-box systems that are long notorious for lack of explainability. One flourishing approach is through counterfactual explanations, which provide…

Artificial Intelligence · Computer Science 2023-06-02 Vy Vo , Trung Le , Van Nguyen , He Zhao , Edwin Bonilla , Gholamreza Haffari , Dinh Phung

Software verification is a tedious process that involves the analysis of multiple failed verification attempts, and adjustments of the program or specification. This is especially the case for complex requirements, e.g., regarding security…

Evaluating hypothetical statements about how the world would be had a different course of action been taken is arguably one key capability expected from modern AI systems. Counterfactual reasoning underpins discussions in fairness, the…

Machine Learning · Computer Science 2022-10-04 Kevin Xia , Yushu Pan , Elias Bareinboim

Counterfactual Explanations (CEs) are an important tool in Algorithmic Recourse for addressing two questions: 1. What are the crucial factors that led to an automated prediction/decision? 2. How can these factors be changed to achieve a…

Machine Learning · Computer Science 2023-11-23 Xuan Zhao , Klaus Broelemann , Gjergji Kasneci

We propose an architecture for training generative models of counterfactual conditionals of the form, 'can we modify event A to cause B instead of C?', motivated by applications in robot control. Using an 'adversarial training' paradigm, an…

Robotics · Computer Science 2020-09-23 Simón C. Smith , Subramanian Ramamoorthy

Cascades are a classical strategy to enable inference cost to vary adaptively across samples, wherein a sequence of classifiers are invoked in turn. A deferral rule determines whether to invoke the next classifier in the sequence, or to…

While recent years have witnessed the emergence of various explainable methods in machine learning, to what degree the explanations really represent the reasoning process behind the model prediction -- namely, the faithfulness of…

Computation and Language · Computer Science 2021-09-07 Yingqiang Ge , Shuchang Liu , Zelong Li , Shuyuan Xu , Shijie Geng , Yunqi Li , Juntao Tan , Fei Sun , Yongfeng Zhang

Referred to as the third rung of the causal inference ladder, counterfactual queries typically ask the "What if ?" question retrospectively. The standard approach to estimate counterfactuals resides in using a structural equation model that…

Machine Learning · Computer Science 2023-01-18 Edward De Brouwer

Interactive constraint systems often suffer from infeasibility (no solution) due to conflicting user constraints. A common approach to recover infeasibility is to eliminate the constraints that cause the conflicts in the system. This…

Artificial Intelligence · Computer Science 2022-04-08 Sharmi Dev Gupta , Begum Genc , Barry O'Sullivan

Causal-consistent reversible debugging allows one to explore concurrent computations back and forth in order to locate the source of an error. In this setting, backward steps can be chosen freely as long as they are "causal consistent",…

Programming Languages · Computer Science 2024-06-11 Juan José González-Abril , Germán Vidal

Generative AI disrupts the practice of giving credit to work that came before. Ideally, a generative model would give credit to any work on which its output depends in a significant way. \emph{Counterfactual credit attribution} (CCA) is a…

Machine Learning · Computer Science 2026-05-05 Aloni Cohen , Chenhao Zhang