English
Related papers

Related papers: Counterfactual Stress Testing for Image Classifica…

200 papers

Variational autoencoders (VAEs) and other generative methods have garnered growing interest not just for their generative properties but also for the ability to dis-entangle a low-dimensional latent variable space. However, few existing…

Machine Learning · Computer Science 2023-02-14 Sunay Bhat , Jeffrey Jiang , Omead Pooladzandi , Gregory Pottie

The discovery of patient-specific imaging markers that are predictive of future disease outcomes can help us better understand individual-level heterogeneity of disease evolution. In fact, deep learning models that can provide data-driven…

Computer Vision and Pattern Recognition · Computer Science 2022-08-05 Amar Kumar , Anjun Hu , Brennan Nichyporuk , Jean-Pierre R. Falet , Douglas L. Arnold , Sotirios Tsaftaris , Tal Arbel

Neural networks are prone to learning shortcuts -- they often model simple correlations, ignoring more complex ones that potentially generalize better. Prior works on image classification show that instead of learning a connection to object…

Machine Learning · Computer Science 2021-01-18 Axel Sauer , Andreas Geiger

Artificial intelligence is increasingly leveraged across various domains to automate decision-making processes that significantly impact human lives. In medical image analysis, deep learning models have demonstrated remarkable performance.…

Machine Learning · Computer Science 2025-07-28 Julia Siekiera , Stefan Kramer

Accurate estimation of counterfactual outcomes in high-dimensional data is crucial for decision-making and understanding causal relationships and intervention outcomes in various domains, including healthcare, economics, and social…

Machine Learning · Computer Science 2024-07-31 Jiageng Zhu , Hanchen Xie , Jiazhi Li , Wael Abd-Almageed

Deep generative models can emulate the perceptual properties of complex image datasets, providing a latent representation of the data. However, manipulating such representation to perform meaningful and controllable transformations in the…

Machine Learning · Computer Science 2019-12-13 Michel Besserve , Arash Mehrjou , Rémy Sun , Bernhard Schölkopf

The image-based diagnosis is now a vital aspect of modern automation assisted diagnosis. To enable models to produce pixel-level diagnosis, pixel-level ground-truth labels are essentially required. However, since it is often not straight…

Computer Vision and Pattern Recognition · Computer Science 2023-01-24 Tehseen Zia , Zeeshan Nisar , Shakeeb Murtaza

From simulating galaxy formation to viral transmission in a pandemic, scientific models play a pivotal role in developing scientific theories and supporting government policy decisions that affect us all. Given these critical applications,…

Software Engineering · Computer Science 2023-07-03 Andrew G. Clark , Michael Foster , Benedikt Prifling , Neil Walkinshaw , Robert M. Hierons , Volker Schmidt , Robert D. Turner

Randomized experiments have become a cornerstone of evidence-based decision-making in contexts ranging from online platforms to public health. However, in experimental settings with network interference, a unit's treatment can influence…

Machine Learning · Computer Science 2025-10-22 Sadegh Shirani , Yuwei Luo , William Overman , Ruoxuan Xiong , Mohsen Bayati

Parametric causal modelling techniques rarely provide functionality for counterfactual estimation, often at the expense of modelling complexity. Since causal estimations depend on the family of functions used to model the data, simplistic…

Machine Learning · Statistics 2020-06-16 Álvaro Parafita , Jordi Vitrià

We describe Countersynth, a conditional generative model of diffeomorphic deformations that induce label-driven, biologically plausible changes in volumetric brain images. The model is intended to synthesise counterfactual training data…

Computer Vision and Pattern Recognition · Computer Science 2021-12-01 Guilherme Pombo , Robert Gray , Jorge Cardoso , Sebastien Ourselin , Geraint Rees , John Ashburner , Parashkev Nachev

Healthcare requires AI that is predictive, reliable, and data-efficient. However, recent generative models lack physical foundation and temporal reasoning required for clinical decision support. As scaling language models show diminishing…

Machine Learning · Computer Science 2025-11-21 Mohammad Areeb Qazi , Maryam Nadeem , Mohammad Yaqub

We propose an automated algorithm to stress-test a trained visual model by generating language-guided counterfactual test images (LANCE). Our method leverages recent progress in large language modeling and text-based image editing to…

Computer Vision and Pattern Recognition · Computer Science 2023-10-31 Viraj Prabhu , Sriram Yenamandra , Prithvijit Chattopadhyay , Judy Hoffman

Reducing the requirement for densely annotated masks in medical image segmentation is important due to cost constraints. In this paper, we consider the problem of inferring pixel-level predictions of brain lesions by only using image-level…

Computer Vision and Pattern Recognition · Computer Science 2022-07-26 Pedro Sanchez , Antanas Kascenas , Xiao Liu , Alison Q. O'Neil , Sotirios A. Tsaftaris

We propose a novel approach to mitigate biases in computer vision models by utilizing counterfactual generation and fine-tuning. While counterfactuals have been used to analyze and address biases in DNN models, the counterfactuals…

Computer Vision and Pattern Recognition · Computer Science 2024-07-01 Pushkar Shukla , Dhruv Srikanth , Lee Cohen , Matthew Turk

Evaluating generative models for synthetic medical imaging is crucial yet challenging, especially given the high standards of fidelity, anatomical accuracy, and safety required for clinical applications. Standard evaluation of generated…

Image and Video Processing · Electrical Eng. & Systems 2025-05-13 Yash Deo , Yan Jia , Toni Lassila , William A. P. Smith , Tom Lawton , Siyuan Kang , Alejandro F. Frangi , Ibrahim Habli

Counterfactual instances offer human-interpretable insight into the local behaviour of machine learning models. We propose a general framework to generate sparse, in-distribution counterfactual model explanations which match a desired…

Machine Learning · Computer Science 2021-01-26 Arnaud Van Looveren , Janis Klaise , Giovanni Vacanti , Oliver Cobb

With the ongoing rise of machine learning, the need for methods for explaining decisions made by artificial intelligence systems is becoming a more and more important topic. Especially for image classification tasks, many state-of-the-art…

Machine Learning · Computer Science 2022-05-10 Silvan Mertes , Tobias Huber , Katharina Weitz , Alexander Heimerl , Elisabeth André

Reconstructing medical images from partial measurements is an important inverse problem in Computed Tomography (CT) and Magnetic Resonance Imaging (MRI). Existing solutions based on machine learning typically train a model to directly map…

Image and Video Processing · Electrical Eng. & Systems 2022-06-17 Yang Song , Liyue Shen , Lei Xing , Stefano Ermon

The number of samples in structural brain MRI studies is often too small to properly train deep learning models. Generative models show promise in addressing this issue by effectively learning the data distribution and generating…

Computer Vision and Pattern Recognition · Computer Science 2026-03-20 Wei Peng , Tian Xia , Fabio De Sousa Ribeiro , Tomas Bosschieter , Ehsan Adeli , Qingyu Zhao , Ben Glocker , Kilian M. Pohl