English
Related papers

Related papers: Generating robust counterfactual explanations

200 papers

As machine learning models are increasingly being employed in various high-stakes settings, it becomes important to ensure that predictions of these models are not only adversarially robust, but also readily explainable to relevant…

Machine Learning · Computer Science 2024-07-25 Satyapriya Krishna , Chirag Agarwal , Himabindu Lakkaraju

Transparency is an essential requirement of machine learning based decision making systems that are deployed in real world. Often, transparency of a given system is achieved by providing explanations of the behavior and predictions of the…

Machine Learning · Computer Science 2021-05-18 André Artelt , Barbara Hammer

Explaining autonomous and intelligent systems is critical in order to improve trust in their decisions. Counterfactuals have emerged as one of the most compelling forms of explanation. They address ``why not'' questions by revealing how…

Artificial Intelligence · Computer Science 2026-02-05 Leila Amgoud , Martin Cooper

While recent years have witnessed the emergence of various explainable methods in machine learning, to what degree the explanations really represent the reasoning process behind the model prediction -- namely, the faithfulness of…

Computation and Language · Computer Science 2021-09-07 Yingqiang Ge , Shuchang Liu , Zelong Li , Shuyuan Xu , Shijie Geng , Yunqi Li , Juntao Tan , Fei Sun , Yongfeng Zhang

A new understanding of adversarial examples and adversarial robustness is proposed by decoupling the data generator and the label generator (which we call the teacher). In our framework, adversarial robustness is a conditional concept---the…

Machine Learning · Computer Science 2020-12-15 Chao Ma , Lexing Ying

There has been considerable recent interest in explainability in AI, especially with black-box machine learning models. As correctly observed by the planning community, when the application at hand is not a single-shot decision or…

Artificial Intelligence · Computer Science 2025-02-14 Vaishak Belle

Feature based explanations, that provide importance of each feature towards the model prediction, is arguably one of the most intuitive ways to explain a model. In this paper, we establish a novel set of evaluation criteria for such feature…

Machine Learning · Computer Science 2021-04-12 Cheng-Yu Hsieh , Chih-Kuan Yeh , Xuanqing Liu , Pradeep Ravikumar , Seungyeon Kim , Sanjiv Kumar , Cho-Jui Hsieh

Counterfactual explanations are one of the prominent eXplainable Artificial Intelligence (XAI) techniques, and suggest changes to input data that could alter predictions, leading to more favourable outcomes. Existing counterfactual methods…

Artificial Intelligence · Computer Science 2025-05-22 Andrei Buliga , Chiara Di Francescomarino , Chiara Ghidini , Marco Montali , Massimiliano Ronzani

Recent advancements in machine learning have emphasized the need for transparency in model predictions, particularly as interpretability diminishes when using increasingly complex architectures. In this paper, we propose leveraging…

Machine Learning · Computer Science 2025-07-18 Chenrui Zhu , Louenas Bounia , Vu Linh Nguyen , Sébastien Destercke , Arthur Hoarau

Counterfactuals answer questions of what would have been observed under altered circumstances and can therefore offer valuable insights. Whereas the classical interventional interpretation of counterfactuals has been studied extensively,…

Artificial Intelligence · Computer Science 2024-08-13 Klaus-Rudolf Kladny , Julius von Kügelgen , Bernhard Schölkopf , Michael Muehlebach

We leverage diffusion models to study the robustness-performance tradeoff of robust classifiers. Our approach introduces a simple, pretrained diffusion method to generate low-norm counterfactual examples (CEs): semantically altered data…

Machine Learning · Computer Science 2024-04-18 Eric Yeats , Cameron Darwin , Eduardo Ortega , Frank Liu , Hai Li

Counterfactual explanations are a prominent example of post-hoc interpretability methods in the explainable Artificial Intelligence research domain. They provide individuals with alternative scenarios and a set of recommendations to achieve…

Artificial Intelligence · Computer Science 2021-01-20 Andrea Ferrario , Michele Loi

Accurately predicting the relevance of items to users is crucial to the success of many social platforms. Conventional approaches train models on logged historical data; but recommendation systems, media services, and online marketplaces…

Machine Learning · Computer Science 2022-10-11 Amir Feder , Guy Horowitz , Yoav Wald , Roi Reichart , Nir Rosenfeld

A causal claim is any assertion that invokes causal relationships between variables, for example that a drug has a certain effect on preventing a disease. Causal claims are established through a combination of data and a set of causal…

Artificial Intelligence · Computer Science 2012-07-19 Judea Pearl

Post-hoc interpretability approaches have been proven to be powerful tools to generate explanations for the predictions made by a trained black-box model. However, they create the risk of having explanations that are a result of some…

Machine Learning · Computer Science 2021-04-14 Thibault Laugel , Marie-Jeanne Lesot , Christophe Marsala , Xavier Renard , Marcin Detyniecki

Interactive constraint systems often suffer from infeasibility (no solution) due to conflicting user constraints. A common approach to recover infeasibility is to eliminate the constraints that cause the conflicts in the system. This…

Artificial Intelligence · Computer Science 2022-04-08 Sharmi Dev Gupta , Begum Genc , Barry O'Sullivan

Counterfactual explanations have been widely studied in explainability, with a range of application dependent methods prominent in fairness, recourse and model understanding. The major shortcoming associated with these methods, however, is…

Machine Learning · Computer Science 2023-12-19 Dan Ley , Saumitra Mishra , Daniele Magazzeni

As machine learning black boxes are increasingly being deployed in real-world applications, there has been a growing interest in developing post hoc explanations that summarize the behaviors of these black boxes. However, existing…

Machine Learning · Computer Science 2020-11-13 Himabindu Lakkaraju , Nino Arsov , Osbert Bastani

Counterfactual explanations provide ways of achieving a favorable model outcome with minimum input perturbation. However, counterfactual explanations can also be leveraged to reconstruct the model by strategically training a surrogate model…

Machine Learning · Computer Science 2024-11-13 Pasan Dissanayake , Sanghamitra Dutta

Massive deployment of Graph Neural Networks (GNNs) in high-stake applications generates a strong demand for explanations that are robust to noise and align well with human intuition. Most existing methods generate explanations by…

Machine Learning · Computer Science 2022-07-14 Mohit Bajaj , Lingyang Chu , Zi Yu Xue , Jian Pei , Lanjun Wang , Peter Cho-Ho Lam , Yong Zhang