English
Related papers

Related papers: Counterfactual Visual Explanations

200 papers

We tackle the problem of computing counterfactual explanations -- minimal changes to the features that flip an undesirable model prediction. We propose a solution to this question for linear Support Vector Machine (SVMs) models. Moreover,…

Machine Learning · Computer Science 2022-12-16 Sebastian Salazar , Samuel Denton , Ansaf Salleb-Aouissi

Rapid improvements in the performance of machine learning models have pushed them to the forefront of data-driven decision-making. Meanwhile, the increased integration of these models into various application domains has further highlighted…

Human-Computer Interaction · Computer Science 2021-09-14 Oscar Gomez , Steffen Holter , Jun Yuan , Enrico Bertini

Counterfactual inference is a powerful tool, capable of solving challenging problems in high-profile sectors. To perform counterfactual inference, one requires knowledge of the underlying causal mechanisms. However, causal mechanisms cannot…

Machine Learning · Computer Science 2023-01-23 Athanasios Vlontzos , Bernhard Kainz , Ciaran M. Gilligan-Lee

There are now many explainable AI methods for understanding the decisions of a machine learning model. Among these are those based on counterfactual reasoning, which involve simulating features changes and observing the impact on the…

Machine Learning · Computer Science 2024-04-15 Vincent Lemaire , Nathan Le Boudec , Victor Guyomard , Françoise Fessant

One of the primary challenges limiting the applicability of deep learning is its susceptibility to learning spurious correlations rather than the underlying mechanisms of the task of interest. The resulting failure to generalise cannot be…

Computer Vision and Pattern Recognition · Computer Science 2020-04-21 Damien Teney , Ehsan Abbasnedjad , Anton van den Hengel

We present DiffExplainer, a novel framework that, leveraging language-vision models, enables multimodal global explainability. DiffExplainer employs diffusion models conditioned on optimized text prompts, synthesizing images that maximize…

Computer Vision and Pattern Recognition · Computer Science 2024-04-04 Matteo Pennisi , Giovanni Bellitto , Simone Palazzo , Mubarak Shah , Concetto Spampinato

Concept-driven counterfactuals explain decisions of classifiers by altering the model predictions through semantic changes. In this paper, we present a novel approach that leverages cross-modal decompositionality and image-specific concepts…

Computer Vision and Pattern Recognition · Computer Science 2025-12-23 Alina Elena Baia , Andrea Cavallaro

We propose a self-supervised method to learn feature representations from videos. A standard approach in traditional self-supervised methods uses positive-negative data pairs to train with contrastive learning strategy. In such a case,…

Computer Vision and Pattern Recognition · Computer Science 2020-08-13 Li Tao , Xueting Wang , Toshihiko Yamasaki

Contrastive learning has delivered impressive results for various tasks in the self-supervised regime. However, existing approaches optimize for learning representations specific to downstream scenarios, i.e., \textit{global}…

Machine Learning · Computer Science 2021-10-29 Shuang Ma , Zhaoyang Zeng , Daniel McDuff , Yale Song

We present a simple regularization of adversarial perturbations based upon the perceptual loss. While the resulting perturbations remain imperceptible to the human eye, they differ from existing adversarial perturbations in that they are…

Computer Vision and Pattern Recognition · Computer Science 2021-04-01 Andrew Elliott , Stephen Law , Chris Russell

Machine learning plays an increasingly significant role in many aspects of our lives (including medicine, transportation, security, justice and other domains), making the potential consequences of false predictions increasingly devastating.…

Computer Vision and Pattern Recognition · Computer Science 2020-07-01 Yuval Bahat , Gregory Shakhnarovich

Model explanations based on pure observational data cannot compute the effects of features reliably, due to their inability to estimate how each factor alteration could affect the rest. We argue that explanations should be based on the…

Machine Learning · Statistics 2019-09-20 Álvaro Parafita , Jordi Vitrià

Counterfactual (CF) explanations have been employed as one of the modes of explainability in explainable AI-both to increase the transparency of AI systems and to provide recourse. Cognitive science and psychology, however, have pointed out…

Artificial Intelligence · Computer Science 2022-12-14 Marko Tesic , Ulrike Hahn

Counterfactual Explanations (CEs) help address the question: How can the factors that influence the prediction of a predictive model be changed to achieve a more favorable outcome from a user's perspective? Thus, they bear the potential to…

Machine Learning · Computer Science 2023-11-27 Xuan Zhao , Klaus Broelemann , Gjergji Kasneci

This paper addresses the generation of explanations with visual examples. Given an input sample, we build a system that not only classifies it to a specific category, but also outputs linguistic explanations and a set of visual examples…

Computer Vision and Pattern Recognition · Computer Science 2019-05-21 Atsushi Kanehira , Tatsuya Harada

Machine-learning models, which are known to accurately predict patterns from large datasets, are crucial in decision making. Consequently, counterfactual explanations-methods explaining predictions by introducing input perturbations-have…

Machine Learning · Computer Science 2024-04-23 Yuta Sumiya , Hayaru shouno

Counterfactual explanations have been a popular method of post-hoc explainability for a variety of settings in Machine Learning. Such methods focus on explaining classifiers by generating new data points that are similar to a given…

Machine Learning · Computer Science 2024-10-21 Joshua Nathaniel Williams , Anurag Katakkar , Hoda Heidari , J. Zico Kolter

Counterfactual Explanations (CEs) are an important tool in Algorithmic Recourse for addressing two questions: 1. What are the crucial factors that led to an automated prediction/decision? 2. How can these factors be changed to achieve a…

Machine Learning · Computer Science 2023-11-23 Xuan Zhao , Klaus Broelemann , Gjergji Kasneci

Due to the common content of anatomy, radiology images with their corresponding reports exhibit high similarity. Such inherent data bias can predispose automatic report generation models to learn entangled and spurious representations…

Computer Vision and Pattern Recognition · Computer Science 2024-07-22 Mingjie Li , Haokun Lin , Liang Qiu , Xiaodan Liang , Ling Chen , Abdulmotaleb Elsaddik , Xiaojun Chang

Although the human visual system can recognize many concepts under challenging conditions, it still has some biases. In this paper, we investigate whether we can extract these biases and transfer them into a machine recognition system. We…

Computer Vision and Pattern Recognition · Computer Science 2015-11-17 Carl Vondrick , Hamed Pirsiavash , Aude Oliva , Antonio Torralba