English
Related papers

Related papers: Counterfactual Stress Testing for Image Classifica…

200 papers

Recently, generative machine-learning models have gained popularity in physics, driven by the goal of improving the efficiency of Markov chain Monte Carlo techniques and of exploring their potential in capturing experimental data…

Statistical Mechanics · Physics 2021-09-03 Japneet Singh , Vipul Arora , Vinay Gupta , Mathias S. Scheurer

Deep learning analyses have offered sensitivity leaps in detection of cognitive states from functional MRI (fMRI) measurements across the brain. Yet, as deep models perform hierarchical nonlinear transformations on their input, interpreting…

Signal Processing · Electrical Eng. & Systems 2023-07-20 Hasan Atakan Bedel , Tolga Çukur

Even as deep neural networks (DNNs) have achieved remarkable success on vision-related tasks, their performance is brittle to transformations in the input. Of particular interest are semantic transformations that model changes that have a…

Machine Learning · Computer Science 2020-07-21 Lakshya Jain , Varun Chandrasekaran , Uyeong Jang , Wilson Wu , Andrew Lee , Andy Yan , Steven Chen , Somesh Jha , Sanjit A. Seshia

Latest methods for visual counterfactual explanations (VCE) harness the power of deep generative models to synthesize new examples of high-dimensional images of impressive quality. However, it is currently difficult to compare the…

Computer Vision and Pattern Recognition · Computer Science 2023-08-14 Philipp Vaeth , Alexander M. Fruehwald , Benjamin Paassen , Magda Gregorova

Despite the success of deep learning in dermoscopy image analysis, its inherent black-box nature hinders clinical trust, motivating the use of prototypical networks for case-based visual transparency. However, inevitable selection bias in…

Image and Video Processing · Electrical Eng. & Systems 2026-03-02 Junhao Jia , Yueyi Wu , Huangwei Chen , Haodong Jing , Haishuai Wang , Jiajun Bu , Lei Wu

Acquiring large quantities of data and annotations is known to be effective for developing high-performing deep learning models, but is difficult and expensive to do in the healthcare context. Adding synthetic training data using generative…

Image and Video Processing · Electrical Eng. & Systems 2023-10-06 Menghan Yu , Sourabh Kulhare , Courosh Mehanian , Charles B Delahunt , Daniel E Shea , Zohreh Laverriere , Ishan Shah , Matthew P Horning

In medical image analysis, model predictions can be affected by sensitive attributes, such as race and gender, leading to fairness concerns and potential biases in diagnostic outcomes. To mitigate this, we present a causal modeling…

Computer Vision and Pattern Recognition · Computer Science 2024-12-09 Bowei Tian , Yexiao He , Meng Liu , Yucong Dai , Ziyao Wang , Shwai He , Guoheng Sun , Zheyu Shen , Wanghao Ye , Yongkai Wu , Ang Li

In the domain of Visual Question Answering (VQA), studies have shown improvement in users' mental model of the VQA system when they are exposed to examples of how these systems answer certain Image-Question (IQ) pairs. In this work, we show…

Computer Vision and Pattern Recognition · Computer Science 2021-10-19 Kamran Alipour , Arijit Ray , Xiao Lin , Michael Cogswell , Jurgen P. Schulze , Yi Yao , Giedrius T. Burachas

Medical Visual Question Answering (MedVQA) aims to answer medical questions according to medical images. However, the complexity of medical data leads to confounders that are difficult to observe, so bias between images and questions is…

Computer Vision and Pattern Recognition · Computer Science 2026-03-27 Zibo Xu , Qiang Li , Weizhi Nie , Weijie Wang , Anan Liu

Using deep learning to analyze mechanical stress distributions has been gaining interest with the demand for fast stress analysis methods. Deep learning approaches have achieved excellent outcomes when utilized to speed up stress…

Computer Vision and Pattern Recognition · Computer Science 2021-02-24 Haoliang Jiang , Zhenguo Nie , Roselyn Yeo , Amir Barati Farimani , Levent Burak Kara

Causal discovery can be a powerful tool for investigating causality when a system can be observed but is inaccessible to experiments in practice. Despite this, it is rarely used in any scientific or medical fields. One of the major hurdles…

Machine Learning · Statistics 2019-10-07 Erich Kummerfeld , Alexander Rix

Learning-based signal processing systems increasingly support high-stakes medical decisions using heterogeneous biomedical signals, including medical images, physiological time series, and clinical records. Despite strong predictive…

Signal Processing · Electrical Eng. & Systems 2026-03-02 Surajit Das , Maxine Tan

Interpreting the inference-time behavior of deep neural networks remains a challenging problem. Existing approaches to counterfactual explanation typically ask: What is the closest alternative input that would alter the model's prediction…

Machine Learning · Computer Science 2026-02-12 Brian Hyeongseok Kim , Jacqueline L. Mitchell , Chao Wang

Predictive models can fail to generalize from training to deployment environments because of dataset shift, posing a threat to model reliability and the safety of downstream decisions made in practice. Instead of using samples from the…

Machine Learning · Statistics 2018-08-10 Adarsh Subbaswamy , Suchi Saria

Predicting counterfactual distributions in complex dynamical systems is essential for scientific modeling and decision-making in domains such as public health and medicine. However, existing methods often rely on point estimates or purely…

Machine Learning · Computer Science 2025-09-15 Wenhao Mu , Zhi Cao , Mehmed Uludag , Alexander Rodríguez

Counterfactuals can explain classification decisions of neural networks in a human interpretable way. We propose a simple but effective method to generate such counterfactuals. More specifically, we perform a suitable diffeomorphic…

Machine Learning · Computer Science 2022-06-17 Ann-Kathrin Dombrowski , Jan E. Gerken , Klaus-Robert Müller , Pan Kessel

We propose an interactive methodology for generating counterfactual explanations for univariate time series data in classification tasks by leveraging 2D projections and decision boundary maps to tackle interpretability challenges. Our…

Machine Learning · Computer Science 2024-08-21 Udo Schlegel , Julius Rauscher , Daniel A. Keim

This research addresses the challenge of conducting interpretable causal inference between a binary treatment and its resulting outcome when not all confounders are known. Confounders are factors that have an influence on both the treatment…

Machine Learning · Computer Science 2023-10-24 Sohaib Kiani , Jared Barton , Jon Sushinsky , Lynda Heimbach , Bo Luo

Counterfactual reasoning allows us to explore hypothetical scenarios in order to explain the impacts of our decisions. However, addressing such inquires is impossible without establishing the appropriate mathematical framework. In this…

Machine Learning · Computer Science 2025-06-25 Kurt Butler , Marija Iloska , Petar M. Djuric

Neural networks used for image classification tasks in critical applications must be tested with sufficient realistic data to assure their correctness. To effectively test an image classification neural network, one must obtain realistic…

Machine Learning · Computer Science 2020-02-18 Taejoon Byun , Abhishek Vijayakumar , Sanjai Rayadurgam , Darren Cofer