English
Related papers

Related papers: Contrastive Learning with Counterfactual Explanati…

200 papers

Machine learning plays a role in many deployed decision systems, often in ways that are difficult or impossible to understand by human stakeholders. Explaining, in a human-understandable way, the relationship between the input and output of…

Machine Learning · Computer Science 2022-11-17 Sahil Verma , Varich Boonsanong , Minh Hoang , Keegan E. Hines , John P. Dickerson , Chirag Shah

The image-based diagnosis is now a vital aspect of modern automation assisted diagnosis. To enable models to produce pixel-level diagnosis, pixel-level ground-truth labels are essentially required. However, since it is often not straight…

Computer Vision and Pattern Recognition · Computer Science 2023-01-24 Tehseen Zia , Zeeshan Nisar , Shakeeb Murtaza

We present a general causal generative modelling framework for accurate estimation of high fidelity image counterfactuals with deep structural causal models. Estimation of interventional and counterfactual queries for high-dimensional…

Machine Learning · Computer Science 2023-07-19 Fabio De Sousa Ribeiro , Tian Xia , Miguel Monteiro , Nick Pawlowski , Ben Glocker

In this paper, we propose leveraging causal generative learning as an interpretable tool for explaining image classifiers. Specifically, we present a generative counterfactual inference approach to study the influence of visual features…

Machine Learning · Computer Science 2024-01-23 Will Taylor-Melanson , Zahra Sadeghi , Stan Matwin

A radiology report comprises presentation-style vocabulary, which ensures clarity and organization, and factual vocabulary, which provides accurate and objective descriptions based on observable findings. While manually writing these…

Image and Video Processing · Electrical Eng. & Systems 2026-05-28 Kang Liu , Zhuoqi Ma , Mengmeng Liu , Zhicheng Jiao , Xiaolu Kang , Qiguang Miao , Kun Xie

The impression section of a radiology report summarizes the most prominent observation from the findings section and is the most important section for radiologists to communicate to physicians. Summarizing findings is time-consuming and can…

Computation and Language · Computer Science 2022-06-09 Jinpeng Hu , Zhuo Li , Zhihong Chen , Zhen Li , Xiang Wan , Tsung-Hui Chang

Natural language explanations of deep neural network decisions provide an intuitive way for a AI agent to articulate a reasoning process. Current textual explanations learn to discuss class discriminative features in an image. However, it…

Computer Vision and Pattern Recognition · Computer Science 2018-06-27 Lisa Anne Hendricks , Ronghang Hu , Trevor Darrell , Zeynep Akata

Mammogram benign or malignant classification with only image-level labels is challenging due to the absence of lesion annotations. Motivated by the symmetric prior that the lesions on one side of breasts rarely appear in the corresponding…

Computer Vision and Pattern Recognition · Computer Science 2021-10-04 Chu-ran Wang , Jing Li , Fandong Zhang , Xinwei Sun , Hao Dong , Yizhou Yu , Yizhou Wang

Medical image registration is a fundamental task in medical image analysis, enabling the alignment of images from different modalities or time points. However, intensity inconsistencies and nonlinear tissue deformations pose significant…

Computer Vision and Pattern Recognition · Computer Science 2026-04-23 Eytan Kats , Christoph Grossbroehmer , Ziad Al-Haj Hemidi , Fenja Falta , Wiebke Heyer , Mattias P. Heinrich

Evaluating hypothetical statements about how the world would be had a different course of action been taken is arguably one key capability expected from modern AI systems. Counterfactual reasoning underpins discussions in fairness, the…

Machine Learning · Computer Science 2022-10-04 Kevin Xia , Yushu Pan , Elias Bareinboim

Contrastive learning is an approach to representation learning that utilizes naturally occurring similar and dissimilar pairs of data points to find useful embeddings of data. In the context of document classification under topic modeling…

Machine Learning · Computer Science 2020-03-05 Christopher Tosh , Akshay Krishnamurthy , Daniel Hsu

Graph Neural Networks achieve remarkable results on problems with structured data but come as black-box predictors. Transferring existing explanation techniques, such as occlusion, fails as even removing a single node or edge can lead to…

Machine Learning · Computer Science 2020-10-27 Lukas Faber , Amin K. Moghaddam , Roger Wattenhofer

The use of machine learning systems to support decision making in healthcare raises questions as to what extent these systems may introduce or exacerbate disparities in care for historically underrepresented and mistreated groups, due to…

Machine Learning · Computer Science 2019-07-16 Stephen Pfohl , Tony Duan , Daisy Yi Ding , Nigam H. Shah

Present language understanding methods have demonstrated extraordinary ability of recognizing patterns in texts via machine learning. However, existing methods indiscriminately use the recognized patterns in the testing phase that is…

Computation and Language · Computer Science 2021-06-08 Fuli Feng , Jizhi Zhang , Xiangnan He , Hanwang Zhang , Tat-Seng Chua

Counterfactual inference has become a ubiquitous tool in online advertisement, recommendation systems, medical diagnosis, and econometrics. Accurate modeling of outcome distributions associated with different interventions -- known as…

Machine Learning · Statistics 2021-07-13 Krikamol Muandet , Motonobu Kanagawa , Sorawit Saengkyongam , Sanparith Marukatat

Neural Image Classifiers are effective but inherently hard to interpret and susceptible to adversarial attacks. Solutions to both problems exist, among others, in the form of counterfactual examples generation to enhance explainability or…

Computer Vision and Pattern Recognition · Computer Science 2023-10-03 Rafael Bischof , Florian Scheidegger , Michael A. Kraus , A. Cristiano I. Malossi

Fair machine learning aims to mitigate the biases of model predictions against certain subpopulations regarding sensitive attributes such as race and gender. Among the many existing fairness notions, counterfactual fairness measures the…

Machine Learning · Computer Science 2022-01-12 Jing Ma , Ruocheng Guo , Mengting Wan , Longqi Yang , Aidong Zhang , Jundong Li

Plausible counterfactual explanations (p-CFEs) are perturbations that minimally modify inputs to change classifier decisions while remaining plausible under the data distribution. In this study, we demonstrate that classifiers can be…

Machine Learning · Computer Science 2025-11-14 Shpresim Sadiku , Kartikeya Chitranshi , Hiroshi Kera , Sebastian Pokutta

Visual counterfactual explanations are ideal hypothetical images that change the decision-making of the classifier with high confidence toward the desired class while remaining visually plausible and close to the initial image. In this…

Computer Vision and Pattern Recognition · Computer Science 2025-04-15 Tung Luu , Nam Le , Duc Le , Bac Le

Diffusion probabilistic models (DPMs) have become the state-of-the-art in high-quality image generation. However, DPMs have an arbitrary noisy latent space with no interpretable or controllable semantics. Although there has been significant…

Machine Learning · Computer Science 2024-08-27 Aneesh Komanduri , Chen Zhao , Feng Chen , Xintao Wu