English
Related papers

Related papers: Counterfactual Explanations for Medical Image Clas…

200 papers

Causal effect estimation (CEE) provides a crucial tool for predicting the unobserved counterfactual outcome for an entity. As CEE relaxes the requirement for ``perfect'' counterfactual samples (e.g., patients with identical attributes and…

Machine Learning · Computer Science 2024-11-19 Hechuan Wen , Tong Chen , Guanhua Ye , Li Kheng Chai , Shazia Sadiq , Hongzhi Yin

Explainability of deep convolutional neural networks (DCNNs) is an important research topic that tries to uncover the reasons behind a DCNN model's decisions and improve their understanding and reliability in high-risk environments. In this…

Computer Vision and Pattern Recognition · Computer Science 2025-01-14 Syed Ali Tariq , Tehseen Zia , Mubeen Ghafoor

Translating the internal representations and computations of models into concepts that humans can understand is a key goal of interpretability. While recent dictionary learning methods such as Sparse Autoencoders (SAEs) provide a promising…

Computation and Language · Computer Science 2026-02-27 Usha Bhalla , Alex Oesterling , Claudio Mayrink Verdun , Himabindu Lakkaraju , Flavio P. Calmon

Sparse autoencoders (SAEs) emerged as a promising tool for mechanistic interpretability of transformer-based foundation models. Very recently, SAEs were also adopted for the visual domain, enabling the discovery of visual concepts and their…

Computer Vision and Pattern Recognition · Computer Science 2025-07-17 Muhammed Furkan Dasdelen , Hyesu Lim , Michele Buck , Katharina S. Götze , Carsten Marr , Steffen Schneider

To truly understand vision models, we must not only interpret their learned features but also validate these interpretations through controlled experiments. While earlier work offers either rich semantics or direct control, few post-hoc…

Computer Vision and Pattern Recognition · Computer Science 2025-11-25 Samuel Stevens , Wei-Lun Chao , Tanya Berger-Wolf , Yu Su

Conditional Variational Auto Encoders (VAE) are gathering significant attention as an Explainable Artificial Intelligence (XAI) tool. The codes in the latent space provide a theoretically sound way to produce counterfactuals, i.e.…

Machine Learning · Computer Science 2021-02-02 Nicolas Vercheval , Aleksandra Pizurica

Object-centric representations form the basis of human perception, and enable us to reason about the world and to systematically generalize to new settings. Currently, most works on unsupervised object discovery focus on slot-based…

Machine Learning · Computer Science 2022-11-21 Sindy Löwe , Phillip Lippe , Maja Rudolph , Max Welling

In visual object classification, humans often justify their choices by comparing objects to prototypical examples within that class. We may therefore increase the interpretability of deep learning models by imbuing them with a similar style…

Computer Vision and Pattern Recognition · Computer Science 2023-10-26 Ayodeji Ijishakin , Ahmed Abdulaal , Adamos Hadjivasiliou , Sophie Martin , James Cole

Learning Interpretable representation in medical applications is becoming essential for adopting data-driven models into clinical practice. It has been recently shown that learning a disentangled feature representation is important for a…

Machine Learning · Computer Science 2019-04-19 Mhd Hasan Sarhan , Abouzar Eslami , Nassir Navab , Shadi Albarqouni

Context-aware emotion recognition (CAER) has recently boosted the practical applications of affective computing techniques in unconstrained environments. Mainstream CAER methods invariably extract ensemble representations from diverse…

Computer Vision and Pattern Recognition · Computer Science 2024-06-04 Dingkang Yang , Kun Yang , Mingcheng Li , Shunli Wang , Shuaibing Wang , Lihua Zhang

Learning-based surrogate models have become a practical alternative to high-fidelity CFD solvers, but their latent representations remain opaque and hinder adoption in safety-critical or regulation-bound settings. This work introduces a…

Computational Engineering, Finance, and Science · Computer Science 2025-07-23 Yeping Hu , Shusen Liu

Recourse generators provide actionable insights, often through feature-based counterfactual explanations (CFEs), to help negatively classified individuals understand how to adjust their input features to achieve a positive classification.…

Machine Learning · Computer Science 2025-06-04 Keziah Naggita , Matthew R. Walter , Avrim Blum

Image classification is a primary task in data analysis where explainable models are crucially demanded in various applications. Although amounts of methods have been proposed to obtain explainable knowledge from the black-box classifiers,…

Computer Vision and Pattern Recognition · Computer Science 2024-12-31 Ruitao Xie , Jingbang Chen , Limai Jiang , Rui Xiao , Yi Pan , Yunpeng Cai

In causality, estimating the effect of a treatment without confounding inference remains a major issue because requires to assess the outcome in both case with and without treatment. Not being able to observe simultaneously both of them,…

Machine Learning · Computer Science 2021-12-09 Celine Beji , Florian Yger , Jamal Atif

Counterfactual explanations promote explainability in machine learning models by answering the question "how should an input instance be perturbed to obtain a desired predicted label?". The comparison of this instance before and after…

Machine Learning · Computer Science 2022-11-09 Jing Ma , Ruocheng Guo , Saumitra Mishra , Aidong Zhang , Jundong Li

Shortcut learning is when a model -- e.g. a cardiac disease classifier -- exploits correlations between the target label and a spurious shortcut feature, e.g. a pacemaker, to predict the target label based on the shortcut rather than real…

Computer Vision and Pattern Recognition · Computer Science 2024-07-18 Nina Weng , Paraskevas Pegios , Eike Petersen , Aasa Feragen , Siavash Bigdeli

Modern neural networks achieve strong performance but remain difficult to interpret in high-dimensional visual domains. Counterfactual explanations (CFEs) provide a principled approach to interpreting black-box predictions by identifying…

Machine Learning · Computer Science 2026-03-19 Ahmed Zeid , Sidney Bender

Text-to-image diffusion models generate images through an iterative denoising process, so internal neural layers produce trajectories of activations rather than single static representations. Sparse autoencoders (SAEs) have recently been…

Computer Vision and Pattern Recognition · Computer Science 2026-05-28 Calvin Yeung , Prathyush Poduval , Ali Zakeri , Zhuowen Zou , Mohsen Imani

Variational Autoencoders (VAEs) have been a pioneering force in the realm of deep generative models. Amongst its legions of progenies, Wasserstein Autoencoders (WAEs) stand out in particular due to the dual offering of heightened generative…

Machine Learning · Statistics 2023-12-12 Anish Chakrabarty , Arkaprabha Basu , Swagatam Das

In generative modeling, numerous successful approaches leverage a low-dimensional latent space, e.g., Stable Diffusion models the latent space induced by an encoder and generates images through a paired decoder. Although the selection of…

Machine Learning · Computer Science 2023-10-31 Tianyang Hu , Fei Chen , Haonan Wang , Jiawei Li , Wenjia Wang , Jiacheng Sun , Zhenguo Li