English
Related papers

Related papers: Debiasing Concept-based Explanations with Causal A…

200 papers

How can we understand classification decisions made by deep neural networks? Many existing explainability methods rely solely on correlations and fail to account for confounding, which may result in potentially misleading explanations. To…

Machine Learning · Computer Science 2020-03-02 Yash Goyal , Amir Feder , Uri Shalit , Been Kim

We propose an information-theoretic bias measurement technique through a causal interpretation of spurious correlation, which is effective to identify the feature-level algorithmic bias by taking advantage of conditional mutual information.…

Machine Learning · Computer Science 2022-01-11 Seonguk Seo , Joon-Young Lee , Bohyung Han

Model explanations such as saliency maps can improve user trust in AI by highlighting important features for a prediction. However, these become distorted and misleading when explaining predictions of images that are subject to systematic…

Computer Vision and Pattern Recognition · Computer Science 2022-03-30 Wencan Zhang , Mariella Dimiccoli , Brian Y. Lim

Most traditional models of uncertainty have focused on the associational relationship among variables as captured by conditional dependence. In order to successfully manage intelligent systems for decision making, however, we must be able…

Artificial Intelligence · Computer Science 2015-05-19 David Heckerman , Ross D. Shachter

Though notable progress has been made, neural-based aspect-based sentiment analysis (ABSA) models are prone to learn spurious correlations from annotation biases, resulting in poor robustness on adversarial data transformations. Among the…

Computation and Language · Computer Science 2024-06-07 Jialong Wu , Linhai Zhang , Deyu Zhou , Guoqiang Xu

Model explanations such as saliency maps can improve user trust in AI by highlighting important features for a prediction. However, these become distorted and misleading when explaining predictions of images that are subject to systematic…

Human-Computer Interaction · Computer Science 2022-03-02 Wencan Zhang , Mariella Dimiccoli , Brian Y. Lim

Understanding predictions made by deep neural networks is notoriously difficult, but also crucial to their dissemination. As all machine learning based methods, they are as good as their training data, and can also capture unwanted biases.…

Computation and Language · Computer Science 2022-11-15 Amir Feder , Nadav Oved , Uri Shalit , Roi Reichart

Observational data is increasingly used as a means for making individual-level causal predictions and intervention recommendations. The foremost challenge of causal inference from observational data is hidden confounding, whose presence…

Machine Learning · Statistics 2018-10-30 Nathan Kallus , Aahlad Manas Puli , Uri Shalit

Concept-based explanations have emerged as a popular way of extracting human-interpretable representations from deep discriminative models. At the same time, the disentanglement learning literature has focused on extracting similar…

Machine Learning · Computer Science 2021-04-15 Dmitry Kazhdan , Botty Dimanov , Helena Andres Terre , Mateja Jamnik , Pietro Liò , Adrian Weller

Causal concept effect estimation is gaining increasing interest in the field of interpretable machine learning. This general approach explains the behaviors of machine learning models by estimating the causal effect of human-understandable…

Machine Learning · Computer Science 2024-11-15 Jifan Gao , Guanhua Chen

Causal modeling has been recognized as a potential solution to many challenging problems in machine learning (ML). Here, we describe how a recently proposed counterfactual approach developed to deconfound linear structural causal models can…

Machine Learning · Computer Science 2020-11-23 Elias Chaibub Neto

In a world that constantly changes, it is crucial to understand how those changes impact different systems, such as industrial manufacturing or critical infrastructure. Explaining critical changes, referred to as concept drift in the field…

Machine Learning · Computer Science 2025-10-14 David Komnick , Kathrin Lammers , Barbara Hammer , Valerie Vaquet , Fabian Hinder

Causal approaches to post-hoc explainability for black-box prediction models (e.g., deep neural networks trained on image pixel data) have become increasingly popular. However, existing approaches have two important shortcomings: (i) the…

Machine Learning · Computer Science 2025-08-12 Numair Sani , Daniel Malinsky , Ilya Shpitser

While concept-based interpretability methods have traditionally focused on local explanations of neural network predictions, we propose a novel framework and interactive tool that extends these methods into the domain of mechanistic…

Machine Learning · Computer Science 2025-07-09 Sofiia Chorna , Kateryna Tarelkina , Eloïse Berthier , Gianni Franchi

Adjusting for latent covariates is crucial for estimating causal effects from observational textual data. Most existing methods only account for confounding covariates that affect both treatment and outcome, potentially leading to biased…

Computation and Language · Computer Science 2023-11-27 Yuxiang Zhou , Yulan He

Causal effect estimation from observational data is one of the essential problems in causal inference. However, most estimation methods rely on the strong assumption that all confounders are observed, which is impractical and untestable in…

Methodology · Statistics 2023-02-14 Yubai Yuan , Annie Qu

Explaining deep learning model inferences is a promising venue for scientific understanding, improving safety, uncovering hidden biases, evaluating fairness, and beyond, as argued by many scholars. One of the principal benefits of…

Machine Learning · Computer Science 2022-03-16 Asma Ghandeharioun , Been Kim , Chun-Liang Li , Brendan Jou , Brian Eoff , Rosalind W. Picard

In some causal inference scenarios, the treatment variable is measured inaccurately, for instance in epidemiology or econometrics. Failure to correct for the effect of this measurement error can lead to biased causal effect estimates.…

Machine Learning · Computer Science 2024-09-13 Antti Pöllänen , Pekka Marttinen

Inferring causal effects of a treatment, intervention or policy from observational data is central to many applications. However, state-of-the-art methods for causal inference seldom consider the possibility that covariates have missing…

Methodology · Statistics 2020-02-26 Imke Mayer , Julie Josse , Félix Raimundo , Jean-Philippe Vert

Explainable recommendation systems leverage transparent reasoning to foster user trust and improve decision-making processes. Current approaches typically decouple recommendation generation from explanation creation, violating causal…

Artificial Intelligence · Computer Science 2025-03-12 Guanrong Li , Haolin Yang , Xinyu Liu , Zhen Wu , Xinyu Dai