English
Related papers

Related papers: Explaining a machine learning decision to physicia…

200 papers

Visual counterfactual explanation (CF) methods modify image concepts, e.g, shape, to change a prediction to a predefined outcome while closely resembling the original query image. Unlike self-explainable models (SEMs) and heatmap…

Computer Vision and Pattern Recognition · Computer Science 2024-09-20 Anselm Haselhoff , Kevin Trelenberg , Fabian Küppers , Jonas Schneider

We present a new method for counterfactual explanations (CFEs) based on Bayesian optimisation that applies to both classification and regression models. Our method is a globally convergent search algorithm with support for arbitrary…

Machine Learning · Computer Science 2021-06-30 Thomas Spooner , Danial Dervovic , Jason Long , Jon Shepard , Jiahao Chen , Daniele Magazzeni

When applied in healthcare, reinforcement learning (RL) seeks to dynamically match the right interventions to subjects to maximize population benefit. However, the learned policy may disproportionately allocate efficacious actions to one…

Machine Learning · Statistics 2025-01-15 Jitao Wang , Chengchun Shi , John D. Piette , Joshua R. Loftus , Donglin Zeng , Zhenke Wu

Model interpretability has become an important problem in machine learning (ML) due to the increased effect that algorithmic decisions have on humans. Counterfactual explanations can help users understand not only why ML models make certain…

Machine Learning · Computer Science 2021-12-20 Ana Lucic , Harrie Oosterhuis , Hinda Haned , Maarten de Rijke

Counterfactual explanations (CFEs) offer a tangible and actionable way to explain recommendations by showing users a "what-if" scenario that demonstrates how small changes in their history would alter the system's output. However, existing…

Information Retrieval · Computer Science 2025-08-13 Arjan Hasami , Masoud Mansoury

Counterfactual explanations (CFE) are methods that explain a machine learning model by giving an alternate class prediction of a data point with some minimal changes in its features. It helps the users to identify their data attributes that…

Artificial Intelligence · Computer Science 2023-12-01 Shashank Shekhar , Asif Salim , Adesh Bansode , Vivaswan Jinturkar , Anirudha Nayak

To collaborate effectively with humans, language models must be able to explain their decisions in natural language. We study a specific type of self-explanation: self-generated counterfactual explanations (SCEs), where a model explains its…

Machine Learning · Computer Science 2025-09-12 Harry Mayne , Ryan Othniel Kearns , Yushi Yang , Andrew M. Bean , Eoin Delaney , Chris Russell , Adam Mahdi

Explanations are an important tool for gaining insights into the behavior of ML models, calibrating user trust and ensuring regulatory compliance. Past few years have seen a flurry of post-hoc methods for generating model explanations, many…

Computation and Language · Computer Science 2025-09-24 Zahra Dehghanighobadi , Asja Fischer , Muhammad Bilal Zafar

In the field of Explainable AI (XAI), counterfactual (CF) explanations are one prominent method to interpret a black-box model by suggesting changes to the input that would alter a prediction. In real-world applications, the input is…

Machine Learning · Computer Science 2024-10-15 Emmanouil Panagiotou , Manuel Heurich , Tim Landgraf , Eirini Ntoutsi

Deep learning models in computer vision have made remarkable progress, but their lack of transparency and interpretability remains a challenge. The development of explainable AI can enhance the understanding and performance of these models.…

Computer Vision and Pattern Recognition · Computer Science 2025-01-14 Bismillah Khan , Syed Ali Tariq , Tehseen Zia , Muhammad Ahsan , David Windridge

Counterfactual explanation is a form of interpretable machine learning that generates perturbations on a sample to achieve the desired outcome. The generated samples can act as instructions to guide end users on how to observe the desired…

Machine Learning · Computer Science 2023-03-28 Tri Dung Duong , Qian Li , Guandong Xu

Machine learning (ML) applications have automated numerous real-life tasks, improving both private and public life. However, the black-box nature of many state-of-the-art models poses the challenge of model verification; how can one be sure…

Machine Learning · Computer Science 2022-01-19 Ioannis Papantonis , Vaishak Belle

The popularity of deep learning methods in the time series domain boosts interest in interpretability studies, including counterfactual (CF) methods. CF methods identify minimal changes in instances to alter the model predictions. Despite…

Machine Learning · Computer Science 2024-10-11 Ziwen Kan , Shahbaz Rezaei , Xin Liu

With the ongoing rise of machine learning, the need for methods for explaining decisions made by artificial intelligence systems is becoming a more and more important topic. Especially for image classification tasks, many state-of-the-art…

Machine Learning · Computer Science 2022-05-10 Silvan Mertes , Tobias Huber , Katharina Weitz , Alexander Heimerl , Elisabeth André

Machine learning is used in medicine to support physicians in examination, diagnosis, and predicting outcomes. One of the most dynamic area is the usage of patient generated health data from intensive care units. The goal of this paper is…

The need for interpretability in deep learning has driven interest in counterfactual explanations, which identify minimal changes to an instance that change a model's prediction. Current counterfactual (CF) generation methods require…

Computation and Language · Computer Science 2025-12-11 Van Bach Nguyen , Christin Seifert , Jörg Schlötterer

Recourse generators provide actionable insights, often through feature-based counterfactual explanations (CFEs), to help negatively classified individuals understand how to adjust their input features to achieve a positive classification.…

Machine Learning · Computer Science 2025-06-04 Keziah Naggita , Matthew R. Walter , Avrim Blum

Many researchers and policymakers have expressed excitement about algorithmic explanations enabling more fair and responsible decision-making. However, recent experimental studies have found that explanations do not always improve human use…

Human-Computer Interaction · Computer Science 2022-08-30 Yaniv Yacoby , Ben Green , Christopher L. Griffin , Finale Doshi Velez

Machine learning plays a role in many deployed decision systems, often in ways that are difficult or impossible to understand by human stakeholders. Explaining, in a human-understandable way, the relationship between the input and output of…

Machine Learning · Computer Science 2022-11-17 Sahil Verma , Varich Boonsanong , Minh Hoang , Keegan E. Hines , John P. Dickerson , Chirag Shah

Counterfactual explanations (CFE) are being widely used to explain algorithmic decisions, especially in consequential decision-making contexts (e.g., loan approval or pretrial bail). In this context, CFEs aim to provide individuals affected…

Machine Learning · Computer Science 2021-02-09 Kiarash Mohammadi , Amir-Hossein Karimi , Gilles Barthe , Isabel Valera