English
Related papers

Related papers: Fast Diffusion-Based Counterfactuals for Shortcut …

200 papers

Spurious correlations in the data, where multiple cues are predictive of the target labels, often lead to shortcut learning phenomena, where a model may rely on erroneous, easy-to-learn, cues while ignoring reliable ones. In this work, we…

Computer Vision and Pattern Recognition · Computer Science 2023-11-21 Luca Scimeca , Alexander Rubinstein , Armand Mihai Nicolicioiu , Damien Teney , Yoshua Bengio

Deep learning models trained in a fully supervised manner have been shown to rely on so-called "shortcut" features. Shortcut features are inputs that are associated with the outcome of interest in the training data, but are either no longer…

Machine Learning · Computer Science 2022-07-12 Anil Palepu , Andrew L Beam

Diffusion probabilistic models (DPMs) have become the state-of-the-art in high-quality image generation. However, DPMs have an arbitrary noisy latent space with no interpretable or controllable semantics. Although there has been significant…

Machine Learning · Computer Science 2024-08-27 Aneesh Komanduri , Chen Zhao , Feng Chen , Xintao Wu

Score-based diffusion models have significantly advanced generative deep learning for image processing. Measurement conditioned models have also been applied to inverse problems such as CT reconstruction. However, the conventional approach,…

Medical Physics · Physics 2025-02-24 Matthew Tivnan , Dufan Wu , Quanzheng Li

Machine learning models often learn to make predictions that rely on sensitive social attributes like gender and race, which poses significant fairness risks, especially in societal applications, such as hiring, banking, and criminal…

Machine Learning · Computer Science 2023-08-25 Yi Zhang , Jitao Sang , Junyang Wang , Dongmei Jiang , Yaowei Wang

Deep learning models were frequently reported to learn from shortcuts like dataset biases. As deep learning is playing an increasingly important role in the modern healthcare system, it is of great need to combat shortcut learning in…

Image and Video Processing · Electrical Eng. & Systems 2022-08-05 Luyang Luo , Dunyuan Xu , Hao Chen , Tien-Tsin Wong , Pheng-Ann Heng

Developing reliable and generalizable deep learning systems for medical imaging faces significant obstacles due to spurious correlations, data imbalances, and limited text annotations in datasets. Addressing these challenges requires…

Computer Vision and Pattern Recognition · Computer Science 2025-07-23 Amar Kumar , Anita Kriz , Mohammad Havaei , Tal Arbel

Prompt learning has garnered attention for its efficiency over traditional model training and fine-tuning. However, existing methods, constrained by inadequate theoretical foundations, encounter difficulties in achieving causally invariant…

Artificial Intelligence · Computer Science 2025-07-29 Xinshu Li , Ruoyu Wang , Erdun Gao , Mingming Gong , Lina Yao

Accurate estimation of counterfactual outcomes in high-dimensional data is crucial for decision-making and understanding causal relationships and intervention outcomes in various domains, including healthcare, economics, and social…

Machine Learning · Computer Science 2024-07-31 Jiageng Zhu , Hanchen Xie , Jiazhi Li , Wael Abd-Almageed

Scaling by training on large datasets has been shown to enhance the quality and fidelity of image generation and manipulation with diffusion models; however, such large datasets are not always accessible in medical imaging due to cost and…

Computer Vision and Pattern Recognition · Computer Science 2025-04-14 Yousef Yeganeh , Azade Farshad , Ioannis Charisiadis , Marta Hasny , Martin Hartenberger , Björn Ommer , Nassir Navab , Ehsan Adeli

Counterfactuals are a popular framework for interpreting machine learning predictions. These what if explanations are notoriously challenging to create for computer vision models: standard gradient-based methods are prone to produce…

Machine Learning · Computer Science 2025-04-23 Jeremy Goldwasser , Giles Hooker

Large-scale, big-variant, high-quality data are crucial for developing robust and successful deep-learning models for medical applications since they potentially enable better generalization performance and avoid overfitting. However, the…

Computer Vision and Pattern Recognition · Computer Science 2024-12-17 Zheyuan Zhang , Lanhong Yao , Bin Wang , Debesh Jha , Gorkem Durak , Elif Keles , Alpay Medetalibeyoglu , Ulas Bagci

Shortcut learning, or `Clever Hans effect` refers to situations where a learning agent (e.g., deep neural networks) learns spurious correlations present in data, resulting in biased models. We focus on finding shortcuts in deep learning…

Machine Learning · Computer Science 2023-06-02 Hye-jin Shim , Rosa González Hautamäki , Md Sahidullah , Tomi Kinnunen

Denoising diffusion probabilistic models enable high-fidelity image synthesis and editing. In biomedicine, these models facilitate counterfactual image editing, producing pairs of images where one is edited to simulate hypothetical…

Image and Video Processing · Electrical Eng. & Systems 2024-07-23 Malek Ben Alaya , Daniel M. Lang , Benedikt Wiestler , Julia A. Schnabel , Cosmin I. Bercea

We introduce Mediffusion -- a new method for semi-supervised learning with explainable classification based on a joint diffusion model. The medical imaging domain faces unique challenges due to scarce data labelling -- insufficient for…

Computer Vision and Pattern Recognition · Computer Science 2024-11-15 Joanna Kaleta , Paweł Skierś , Jan Dubiński , Przemysław Korzeniowski , Kamil Deja

Interpreting the inference-time behavior of deep neural networks remains a challenging problem. Existing approaches to counterfactual explanation typically ask: What is the closest alternative input that would alter the model's prediction…

Machine Learning · Computer Science 2026-02-12 Brian Hyeongseok Kim , Jacqueline L. Mitchell , Chao Wang

Recent models for natural language understanding are inclined to exploit simple patterns in datasets, commonly known as shortcuts. These shortcuts hinge on spurious correlations between labels and latent features existing in the training…

Computation and Language · Computer Science 2024-11-19 Ukyo Honda , Tatsushi Oka , Peinan Zhang , Masato Mita

Counterfactual medical image generation effectively addresses data scarcity and enhances the interpretability of medical images. However, due to the complex and diverse pathological features of medical images and the imbalanced class…

Computer Vision and Pattern Recognition · Computer Science 2025-04-25 Weizhi Nie , Zichun Zhang , Weijie Wang , Bruno Lepri , Anan Liu , Nicu Sebe

Semi-supervised medical image segmentation aims to leverage limited annotated data and rich unlabeled data to perform accurate segmentation. However, existing semi-supervised methods are highly dependent on the quality of self-generated…

Image and Video Processing · Electrical Eng. & Systems 2024-07-16 Xinyu Liu , Wuyang Li , Yixuan Yuan

Recent progress in generative models has made it easier for a wide audience to edit and create image content, raising concerns about the proliferation of deepfakes, especially in healthcare. Despite the availability of numerous techniques…

Image and Video Processing · Electrical Eng. & Systems 2024-10-22 Fred Grabovski , Lior Yasur , Guy Amit , Yisroel Mirsky