English
Related papers

Related papers: Evaluating and Mitigating Bias in Image Classifier…

200 papers

The use of machine learning models in high-stake applications (e.g., healthcare, lending, college admission) has raised growing concerns due to potential biases against protected social groups. Various fairness notions and methods have been…

Machine Learning · Computer Science 2023-11-10 Zhiqun Zuo , Mohammad Mahdi Khalili , Xueru Zhang

Counterfactual Explanations (CEs) are an important tool in Algorithmic Recourse for addressing two questions: 1. What are the crucial factors that led to an automated prediction/decision? 2. How can these factors be changed to achieve a…

Machine Learning · Computer Science 2023-11-23 Xuan Zhao , Klaus Broelemann , Gjergji Kasneci

Counterfactuals have become a popular technique nowadays for interacting with black-box machine learning models and understanding how to change a particular instance to obtain a desired outcome from the model. However, most existing…

Machine Learning · Computer Science 2021-09-29 Philip Naumann , Eirini Ntoutsi

The field of generating recommendations within the framework of causal inference has seen a recent surge, with recommendations being likened to treatments. This approach enhances insights into the influence of recommendations on user…

Information Retrieval · Computer Science 2023-08-21 Guanglin Zhou , Chengkai Huang , Xiaocong Chen , Xiwei Xu , Chen Wang , Liming Zhu , Lina Yao

Counterfactual generation offers a principled framework for simulating hypothetical changes in medical imaging, with potential applications in understanding disease mechanisms and generating physiologically plausible data. However,…

Image and Video Processing · Electrical Eng. & Systems 2025-08-25 Pengwei Sun , Wei Peng , Lun Yu Li , Yixin Wang , Kilian M. Pohl

A novel explainable AI method called CLEAR Image is introduced in this paper. CLEAR Image is based on the view that a satisfactory explanation should be contrastive, counterfactual and measurable. CLEAR Image explains an image's…

Computer Vision and Pattern Recognition · Computer Science 2022-06-10 Adam White , Kwun Ho Ngan , James Phelan , Saman Sadeghi Afgeh , Kevin Ryan , Constantino Carlos Reyes-Aldasoro , Artur d'Avila Garcez

Predictive models can fail to generalize from training to deployment environments because of dataset shift, posing a threat to model reliability and the safety of downstream decisions made in practice. Instead of using samples from the…

Machine Learning · Statistics 2018-08-10 Adarsh Subbaswamy , Suchi Saria

In this paper titled A Symbolic Approach for Counterfactual Explanations we propose a novel symbolic approach to provide counterfactual explanations for a classifier predictions. Contrary to most explanation approaches where the goal is to…

Artificial Intelligence · Computer Science 2022-06-22 Ryma Boumazouza , Fahima Cheikh-Alili , Bertrand Mazure , Karim Tabia

Causal world models are systems that can answer counterfactual questions about an environment of interest, i.e. predict how it would have evolved if an arbitrary subset of events had been realized differently. It requires understanding the…

Artificial Intelligence · Computer Science 2025-05-21 Gaël Gendron , Jože M. Rožanec , Michael Witbrock , Gillian Dobbie

Counterfactuals answer questions of what would have been observed under altered circumstances and can therefore offer valuable insights. Whereas the classical interventional interpretation of counterfactuals has been studied extensively,…

Artificial Intelligence · Computer Science 2024-08-13 Klaus-Rudolf Kladny , Julius von Kügelgen , Bernhard Schölkopf , Michael Muehlebach

Currently, there is a significant amount of research being conducted in the field of artificial intelligence to improve the explainability and interpretability of deep learning models. It is found that if end-users understand the reason for…

Information Retrieval · Computer Science 2023-06-02 Niloofar Ranjbar , Saeedeh Momtazi , MohammadMehdi Homayounpour

This paper investigates the problem of bounding counterfactual queries from an arbitrary collection of observational and experimental distributions and qualitative knowledge about the underlying data-generating model represented in the form…

Artificial Intelligence · Computer Science 2021-10-13 Junzhe Zhang , Jin Tian , Elias Bareinboim

We propose a BlackBox Counterfactual Explainer, designed to explain image classification models for medical applications. Classical approaches (e.g., saliency maps) that assess feature importance do not explain "how" imaging features in…

Computer Vision and Pattern Recognition · Computer Science 2022-11-21 Sumedha Singla , Motahhare Eslami , Brian Pollack , Stephen Wallace , Kayhan Batmanghelich

The reliance of text classifiers on spurious correlations can lead to poor generalization at deployment, raising concerns about their use in safety-critical domains such as healthcare. In this work, we propose to use counterfactual data…

Machine Learning · Computer Science 2024-01-10 Amir Feder , Yoav Wald , Claudia Shi , Suchi Saria , David Blei

Machine learning models are increasingly used in critical areas such as loan approvals and hiring, yet they often function as black boxes, obscuring their decision-making processes. Transparency is crucial, as individuals need explanations…

Artificial Intelligence · Computer Science 2024-10-31 Sopam Dasgupta , Joaquín Arias , Elmer Salazar , Gopal Gupta

We tackle the problem of computing counterfactual explanations -- minimal changes to the features that flip an undesirable model prediction. We propose a solution to this question for linear Support Vector Machine (SVMs) models. Moreover,…

Machine Learning · Computer Science 2022-12-16 Sebastian Salazar , Samuel Denton , Ansaf Salleb-Aouissi

Counterfactual explanations provide actionable insights by identifying minimal input changes required to achieve a desired model prediction. Beyond their interpretability benefits, counterfactuals can also be leveraged for model…

Machine Learning · Computer Science 2025-12-12 Xuan Zhao , Zhuo Cao , Arya Bangun , Hanno Scharr , Ira Assent

The rise of deep learning in image classification has brought unprecedented accuracy but also highlighted a key issue: the use of 'shortcuts' by models. Such shortcuts are easy-to-learn patterns from the training data that fail to…

Computer Vision and Pattern Recognition · Computer Science 2025-01-30 James Hinns , David Martens

Counterfactual Explanations (CEs) are a powerful technique used to explain Machine Learning models by showing how the input to a model should be minimally changed for the model to produce a different output. Similar proposals have been made…

Artificial Intelligence · Computer Science 2025-09-01 Nicola Gigante , Francesco Leofante , Andrea Micheli

Recent text generation models are easy to generate relevant and fluent text for the given text, while lack of causal reasoning ability when we change some parts of the given text. Counterfactual story rewriting is a recently proposed task…

Computation and Language · Computer Science 2021-04-05 Changying Hao , Liang Pang , Yanyan Lan , Yan Wang , Jiafeng Guo , Xueqi Cheng