English
Related papers

Related papers: Attention Is Not the Only Choice: Counterfactual R…

200 papers

There has been a recent resurgence of interest in explainable artificial intelligence (XAI) that aims to reduce the opaqueness of AI-based decision-making systems, allowing humans to scrutinize and trust them. Prior work in this context has…

Artificial Intelligence · Computer Science 2021-06-24 Sainyam Galhotra , Romila Pradhan , Babak Salimi

The attention mechanism is a core component of the Transformer architecture. Beyond improving performance, attention has been proposed as a mechanism for explainability via attention weights, which are associated with input features (e.g.,…

Computation and Language · Computer Science 2025-08-15 Andrés Carvallo , Denis Parra , Peter Brusilovsky , Hernan Valdivieso , Gabriel Rada , Ivania Donoso , Vladimir Araujo

The prevalence of employing attention mechanisms has brought along concerns on the interpretability of attention distributions. Although it provides insights about how a model is operating, utilizing attention as the explanation of model…

Computer Vision and Pattern Recognition · Computer Science 2022-09-16 Tristan Gomez , Suiyi Ling , Thomas Fréour , Harold Mouchère

Counterfactual explanations describe how to modify a feature vector in order to flip the outcome of a trained classifier. Obtaining robust counterfactual explanations is essential to provide valid algorithmic recourse and meaningful…

Machine Learning · Computer Science 2024-03-22 Alexandre Forel , Axel Parmentier , Thibaut Vidal

Counterfactual reasoning is an important paradigm applicable in many fields, such as healthcare, economics, and education. In this work, we propose a novel method to address the issue of \textit{selection bias}. We learn two groups of…

Machine Learning · Computer Science 2019-12-20 Zichen Zhang , Qingfeng Lan , Lei Ding , Yue Wang , Negar Hassanpour , Russell Greiner

A graphical model provides a compact and efficient representation of the association structure of a multivariate distribution by means of a graph. Relevant features of the distribution are represented by vertices, edges and other…

Statistics Theory · Mathematics 2020-09-03 Alberto Roverato , Robert Castelo

Interpretable machine learning seeks to understand the reasoning process of complex black-box systems that are long notorious for lack of explainability. One flourishing approach is through counterfactual explanations, which provide…

Artificial Intelligence · Computer Science 2023-06-02 Vy Vo , Trung Le , Van Nguyen , He Zhao , Edwin Bonilla , Gholamreza Haffari , Dinh Phung

Counterfactual explanation is one branch of interpretable machine learning that produces a perturbation sample to change the model's original decision. The generated samples can act as a recommendation for end-users to achieve their desired…

Machine Learning · Computer Science 2023-03-28 Tri Dung Duong , Qian Li , Guandong Xu

The increasing application of Artificial Intelligence and Machine Learning models poses potential risks of unfair behavior and, in light of recent regulations, has attracted the attention of the research community. Several researchers…

Machine Learning · Computer Science 2023-02-17 Giandomenico Cornacchia , Vito Walter Anelli , Fedelucio Narducci , Azzurra Ragone , Eugenio Di Sciascio

The feedback data of recommender systems are often subject to what was exposed to the users; however, most learning and evaluation methods do not account for the underlying exposure mechanism. We first show in theory that applying…

Information Retrieval · Computer Science 2020-12-07 Da Xu , Chuanwei Ruan , Evren Korpeoglu , Sushant Kumar , Kannan Achan

In the domain of non-generative visual counterfactual explanations (CE), traditional techniques frequently involve the substitution of sections within a query image with corresponding sections from distractor images. Such methods have…

Computer Vision and Pattern Recognition · Computer Science 2025-11-18 Lintong Zhang , Kang Yin , Seong-Whan Lee

Explaining the predictions of a deep neural network is a nontrivial task, yet high-quality explanations for predictions are often a prerequisite for practitioners to trust these models. Counterfactual explanations aim to explain predictions…

Machine Learning · Computer Science 2025-01-16 Andreas Abildtrup Hansen , Paraskevas Pegios , Anna Calissano , Aasa Feragen

Model explanations based on pure observational data cannot compute the effects of features reliably, due to their inability to estimate how each factor alteration could affect the rest. We argue that explanations should be based on the…

Machine Learning · Statistics 2019-09-20 Álvaro Parafita , Jordi Vitrià

Explainable AI (XAI) methods identify which features are relevant to a model's predictions but often fail to clarify why certain decisions are made. In this work, we present a novel method that integrates causality with argument-based…

Artificial Intelligence · Computer Science 2026-05-22 Henry Salgado , Meagan R. Kendall , Martine Ceberio

Responsible use of machine learning requires models to be audited for undesirable properties. While a body of work has proposed using explanations for auditing, how to do so and why has remained relatively ill-understood. This work…

Machine Learning · Computer Science 2023-06-06 Chhavi Yadav , Michal Moshkovitz , Kamalika Chaudhuri

Counterfactual inference is a powerful tool, capable of solving challenging problems in high-profile sectors. To perform counterfactual inference, one requires knowledge of the underlying causal mechanisms. However, causal mechanisms cannot…

Machine Learning · Computer Science 2023-01-23 Athanasios Vlontzos , Bernhard Kainz , Ciaran M. Gilligan-Lee

We introduce an Attention Overload Model that captures the idea that alternatives compete for the decision maker's attention, and hence the attention that each alternative receives decreases as the choice problem becomes larger. Using this…

Theoretical Economics · Economics 2024-09-17 Matias D. Cattaneo , Paul Cheung , Xinwei Ma , Yusufcan Masatlioglu

As data-driven predictive models are increasingly used to inform decisions, it has been argued that decision makers should provide explanations that help individuals understand what would have to change for these decisions to be beneficial…

Machine Learning · Computer Science 2020-10-15 Stratis Tsirtsis , Manuel Gomez-Rodriguez

The widespread deployment of machine learning systems in critical real-world decision-making applications has highlighted the urgent need for counterfactual explainability methods that operate effectively. Global counterfactual…

Trajectory prediction models in autonomous driving are vulnerable to perturbations from non-causal agents whose actions should not affect the ego-agent's behavior. Such perturbations can lead to incorrect predictions of other agents'…

Robotics · Computer Science 2026-05-19 Ehsan Ahmadi , Ray Mercurius , Soheil Alizadeh , Kasra Rezaee , Amir Rasouli