English
Related papers

Related papers: Explaining the Black-box Smoothly- A Counterfactua…

200 papers

Although counterfactual explanations are a popular approach to explain ML black-box classifiers, they are less widespread in NLP. Most methods find those explanations by iteratively perturbing the target document until it is classified…

Computation and Language · Computer Science 2024-04-24 Julien Delaunay , Luis Galárraga , Christine Largouët

The paper proposes summarized attribution-based post-hoc explanations for the detection and identification of bias in data. A global explanation is proposed, and a step-by-step framework on how to detect and test bias is introduced. Since…

Machine Learning · Computer Science 2020-10-26 Agnieszka Mikołajczyk , Michał Grochowski , Arkadiusz Kwasigroch

The application of deep learning in medical imaging has significantly advanced diagnostic capabilities, enhancing both accuracy and efficiency. Despite these benefits, the lack of transparency in these AI models, often termed "black boxes,"…

Computer Vision and Pattern Recognition · Computer Science 2024-09-23 Eleonora Beatrice Rossi , Eleonora Lopez , Danilo Comminiello

Counterfactual explanation methods have recently received significant attention for explaining CNN-based image classifiers due to their ability to provide easily understandable explanations that align more closely with human reasoning.…

Computer Vision and Pattern Recognition · Computer Science 2025-01-22 Syed Ali Tariq , Tehseen Zia

Deep learning models in medical imaging often fail when deployed in new clinical environments due to distribution shifts in demographics, scanner hardware, or acquisition protocols. A central challenge is underspecification, where models…

Computer Vision and Pattern Recognition · Computer Science 2026-05-12 Moritz Stammel , Fabio De Sousa Ribeiro , Raghav Mehta , Mélanie Roschewitz , Ben Glocker

Abstaining classifiers have the option to abstain from making predictions on inputs that they are unsure about. These classifiers are becoming increasingly popular in high-stakes decision-making problems, as they can withhold uncertain…

Machine Learning · Statistics 2023-11-10 Yo Joong Choe , Aditya Gangrade , Aaditya Ramdas

While deep learning has led to huge progress in complex image classification tasks like ImageNet, unexpected failure modes, e.g. via spurious features, call into question how reliably these classifiers work in the wild. Furthermore, for…

Computer Vision and Pattern Recognition · Computer Science 2024-07-15 Maximilian Augustin , Yannic Neuhaus , Matthias Hein

When an image classifier makes a prediction, which parts of the image are relevant and why? We can rephrase this question to ask: which parts of the image, if they were not seen by the classifier, would most change its decision? Producing…

Computer Vision and Pattern Recognition · Computer Science 2019-02-27 Chun-Hao Chang , Elliot Creager , Anna Goldenberg , David Duvenaud

In recent years, deep learning has become prevalent to solve applications from multiple domains. Convolutional Neural Networks (CNNs) particularly have demonstrated state of the art performance for the task of image classification. However,…

Computer Vision and Pattern Recognition · Computer Science 2021-12-01 Meghna P Ayyar , Jenny Benois-Pineau , Akka Zemmari

Counterfactual explanations have emerged as a popular solution for the eXplainable AI (XAI) problem of elucidating the predictions of black-box deep-learning systems due to their psychological validity, flexibility across problem domains…

Machine Learning · Computer Science 2022-12-20 Eoin Delaney , Arjun Pakrashi , Derek Greene , Mark T. Keane

Visual counterfactual explanations identify modifications to an image that would change the prediction of a classifier. We propose a set of techniques based on generative models (VAE) and a classifier ensemble directly trained in the latent…

Computer Vision and Pattern Recognition · Computer Science 2022-11-29 Claire Theobald , Frédéric Pennerath , Brieuc Conan-Guez , Miguel Couceiro , Amedeo Napoli

The use of deep learning in computer vision tasks such as image classification has led to a rapid increase in the performance of such systems. Due to this substantial increment in the utility of these systems, the use of artificial…

Image and Video Processing · Electrical Eng. & Systems 2023-04-05 Vinay Jogani , Joy Purohit , Ishaan Shivhare , Seema C Shrawne

This paper addresses the challenge of generating Counterfactual Explanations (CEs), involving the identification and modification of the fewest necessary features to alter a classifier's prediction for a given image. Our proposed method,…

Computer Vision and Pattern Recognition · Computer Science 2023-11-16 Guillaume Jeanneret , Loïc Simon , Frédéric Jurie

Deep neural networks and other intricate Artificial Intelligence (AI) models have reached high levels of accuracy on many biomedical natural language processing tasks. However, their applicability in real-world use cases may be limited due…

Artificial Intelligence · Computer Science 2020-10-22 Milad Moradi , Matthias Samwald

Counterfactual examples for an input -- perturbations that change specific features but not others -- have been shown to be useful for evaluating bias of machine learning models, e.g., against specific demographic groups. However,…

Computer Vision and Pattern Recognition · Computer Science 2022-01-07 Saloni Dash , Vineeth N Balasubramanian , Amit Sharma

The recent prevalence of publicly accessible, large medical imaging datasets has led to a proliferation of artificial intelligence (AI) models for cardiovascular image classification and analysis. At the same time, the potentially…

Human-Computer Interaction · Computer Science 2024-04-26 Grace Guo , Lifu Deng , Animesh Tandon , Alex Endert , Bum Chul Kwon

Causal approaches to post-hoc explainability for black-box prediction models (e.g., deep neural networks trained on image pixel data) have become increasingly popular. However, existing approaches have two important shortcomings: (i) the…

Machine Learning · Computer Science 2025-08-12 Numair Sani , Daniel Malinsky , Ilya Shpitser

Convolutional neural networks (CNNs) are widely used for high-stakes applications like medicine, often surpassing human performance. However, most explanation methods rely on post-hoc attribution, approximating the decision-making process…

Machine Learning · Computer Science 2026-02-23 Kerol Djoumessi , Philipp Berens

There has been a recent resurgence of interest in explainable artificial intelligence (XAI) that aims to reduce the opaqueness of AI-based decision-making systems, allowing humans to scrutinize and trust them. Prior work in this context has…

Artificial Intelligence · Computer Science 2021-06-24 Sainyam Galhotra , Romila Pradhan , Babak Salimi

This study investigates the impact of machine learning models on the generation of counterfactual explanations by conducting a benchmark evaluation over three different types of models: a decision tree (fully transparent, interpretable,…

Machine Learning · Computer Science 2024-11-11 Catarina Moreira , Yu-Liang Chou , Chihcheng Hsieh , Chun Ouyang , João Madeiras Pereira , Joaquim Jorge