English
Related papers

Related papers: Trustworthy Actionable Perturbations

200 papers

Our work addresses a fundamental problem in the context of counterfactual inference for Markov Decision Processes (MDPs). Given an MDP path $\tau$, this kind of inference allows us to derive counterfactual paths $\tau'$ describing what-if…

Artificial Intelligence · Computer Science 2025-03-28 Milad Kazemi , Jessica Lally , Ekaterina Tishchenko , Hana Chockler , Nicola Paoletti

Human interpretability of deep neural networks' decisions is crucial, especially in domains where these directly affect human lives. Counterfactual explanations of already trained neural networks can be generated by perturbing input…

Computer Vision and Pattern Recognition · Computer Science 2021-02-02 Oana-Iuliana Popescu , Maha Shadaydeh , Joachim Denzler

Counterfactual explanations are usually obtained by identifying the smallest change made to an input to change a prediction made by a fixed model (hereafter called sparse methods). Recent work, however, has revitalized an old insight: there…

Machine Learning · Computer Science 2020-06-24 Martin Pawelczyk , Klaus Broelemann , Gjergji Kasneci

The deployment of safe and trustworthy machine learning systems, and particularly complex black box neural networks, in real-world applications requires reliable and certified guarantees on their performance. The conformal prediction…

Computer Vision and Pattern Recognition · Computer Science 2024-06-14 Paul Melki , Lionel Bombrun , Boubacar Diallo , Jérôme Dias , Jean-Pierre da Costa

In recent years, various machine and deep learning architectures have been successfully introduced to the field of predictive process analytics. Nevertheless, the inherent opacity of these algorithms poses a significant challenge for human…

Artificial Intelligence · Computer Science 2024-03-15 Alexander Stevens , Chun Ouyang , Johannes De Smedt , Catarina Moreira

Counterfactual explanations and adversarial attacks have a related goal: flipping output labels with minimal perturbations regardless of their characteristics. Yet, adversarial attacks cannot be used directly in a counterfactual explanation…

Computer Vision and Pattern Recognition · Computer Science 2023-03-20 Guillaume Jeanneret , Loïc Simon , Frédéric Jurie

Deep reinforcement learning methods have been widely used in recent years for autonomous vehicle's decision-making. A key issue is that deep neural networks can be fragile to adversarial attacks or other unseen inputs. In this paper, we…

Systems and Control · Electrical Eng. & Systems 2020-03-19 Songan Zhang , Huei Peng , Subramanya Nageshrao , H. Eric Tseng

With the ongoing rise of machine learning, the need for methods for explaining decisions made by artificial intelligence systems is becoming a more and more important topic. Especially for image classification tasks, many state-of-the-art…

Machine Learning · Computer Science 2022-05-10 Silvan Mertes , Tobias Huber , Katharina Weitz , Alexander Heimerl , Elisabeth André

Machine learning plays a role in many deployed decision systems, often in ways that are difficult or impossible to understand by human stakeholders. Explaining, in a human-understandable way, the relationship between the input and output of…

Machine Learning · Computer Science 2022-11-17 Sahil Verma , Varich Boonsanong , Minh Hoang , Keegan E. Hines , John P. Dickerson , Chirag Shah

Visual counterfactual explanations are ideal hypothetical images that change the decision-making of the classifier with high confidence toward the desired class while remaining visually plausible and close to the initial image. In this…

Computer Vision and Pattern Recognition · Computer Science 2025-04-15 Tung Luu , Nam Le , Duc Le , Bac Le

Ensuring fairness in machine learning predictions is a critical challenge, especially when models are deployed in sensitive domains such as credit scoring, healthcare, and criminal justice. While many fairness interventions rely on data…

Artificial Intelligence · Computer Science 2026-04-09 Irina Arévalo , Marcos Oliva

Feature attributions are a common paradigm for model explanations due to their simplicity in assigning a single numeric score for each input feature to a model. In the actionable recourse setting, wherein the goal of the explanations is to…

Machine Learning · Computer Science 2022-05-17 Emanuele Albini , Jason Long , Danial Dervovic , Daniele Magazzeni

Counterfactual explanations are one of the prominent eXplainable Artificial Intelligence (XAI) techniques, and suggest changes to input data that could alter predictions, leading to more favourable outcomes. Existing counterfactual methods…

Artificial Intelligence · Computer Science 2025-05-22 Andrei Buliga , Chiara Di Francescomarino , Chiara Ghidini , Marco Montali , Massimiliano Ronzani

We study counterfactual classification as a new tool for decision-making under hypothetical (contrary to fact) scenarios. We propose a doubly-robust nonparametric estimator for a general counterfactual classifier, where we can incorporate…

Machine Learning · Computer Science 2023-01-31 Kwangho Kim , Edward H. Kennedy , José R. Zubizarreta

Counterfactual examples explain a prediction by highlighting changes of instance that flip the outcome of a classifier. This paper proposes TIGTEC, an efficient and modular method for generating sparse, plausible and diverse counterfactual…

Machine Learning · Computer Science 2023-04-26 Milan Bhan , Jean-Noel Vittaut , Nicolas Chesneau , Marie-Jeanne Lesot

Counterfactual explanations are a prominent example of post-hoc interpretability methods in the explainable Artificial Intelligence research domain. They provide individuals with alternative scenarios and a set of recommendations to achieve…

Artificial Intelligence · Computer Science 2021-01-20 Andrea Ferrario , Michele Loi

Work in Counterfactual Explanations tends to focus on the principle of "the closest possible world" that identifies small changes leading to the desired outcome. In this paper we argue that while this approach might initially seem…

Machine Learning · Computer Science 2020-02-25 Rafael Poyiadzi , Kacper Sokol , Raul Santos-Rodriguez , Tijl De Bie , Peter Flach

The recent adoption of machine learning as a tool in real world decision making has spurred interest in understanding how these decisions are being made. Counterfactual Explanations are a popular interpretable machine learning technique…

Machine Learning · Computer Science 2021-10-05 Andrew O'Brien , Edward Kim

A highly accurate but overconfident model is ill-suited for deployment in critical applications such as healthcare and autonomous driving. The classification outcome should reflect a high uncertainty on ambiguous in-distribution samples…

Machine Learning · Computer Science 2022-10-25 Sumedha Singla , Nihal Murali , Forough Arabshahi , Sofia Triantafyllou , Kayhan Batmanghelich

Reinforcement Learning (RL) agents in the real world must satisfy safety constraints in addition to maximizing a reward objective. Model-based RL algorithms hold promise for reducing unsafe real-world actions: they may synthesize policies…

Machine Learning · Computer Science 2021-12-16 Yecheng Jason Ma , Andrew Shen , Osbert Bastani , Dinesh Jayaraman