English
Related papers

Related papers: Generating Realistic Counterfactuals for Retinal F…

200 papers

Retinal fundus images play a crucial role in the early detection of eye diseases. However, the impact of technical factors on these images can pose challenges for reliable AI applications in ophthalmology. For example, large fundus cohorts…

Computer Vision and Pattern Recognition · Computer Science 2025-06-24 Sarah Müller , Lisa M. Koch , Hendrik P. A. Lensch , Philipp Berens

Despite their high accuracies, modern complex image classifiers cannot be trusted for sensitive tasks due to their unknown decision-making process and potential biases. Counterfactual explanations are very effective in providing…

Computer Vision and Pattern Recognition · Computer Science 2022-06-13 Kamran Alipour , Aditya Lahiri , Ehsan Adeli , Babak Salimi , Michael Pazzani

Neural Image Classifiers are effective but inherently hard to interpret and susceptible to adversarial attacks. Solutions to both problems exist, among others, in the form of counterfactual examples generation to enhance explainability or…

Computer Vision and Pattern Recognition · Computer Science 2023-10-03 Rafael Bischof , Florian Scheidegger , Michael A. Kraus , A. Cristiano I. Malossi

We propose a novel approach to mitigate biases in computer vision models by utilizing counterfactual generation and fine-tuning. While counterfactuals have been used to analyze and address biases in DNN models, the counterfactuals…

Computer Vision and Pattern Recognition · Computer Science 2024-07-01 Pushkar Shukla , Dhruv Srikanth , Lee Cohen , Matthew Turk

When an image classifier outputs a wrong class label, it can be helpful to see what changes in the image would lead to a correct classification. This is the aim of algorithms generating counterfactual explanations. However, there is no…

Computer Vision and Pattern Recognition · Computer Science 2021-12-01 Benedikt Höltgen , Lisa Schut , Jan M. Brauner , Yarin Gal

We report, to our knowledge, the first end-to-end application of Generative Adversarial Networks (GANs) towards the synthesis of Optical Coherence Tomography (OCT) images of the retina. Generative models have gained recent attention for the…

Computer Vision and Pattern Recognition · Computer Science 2019-02-19 Stephen G. Odaibo , M. D. , M. S. , M. S.

Segmentation masks of pathological areas are useful in many medical applications, such as brain tumour and stroke management. Moreover, healthy counterfactuals of diseased images can be used to enhance radiologists' training files and to…

Image and Video Processing · Electrical Eng. & Systems 2024-10-02 Alessandro Fontanella , Grant Mair , Joanna Wardlaw , Emanuele Trucco , Amos Storkey

Denoising diffusion probabilistic models enable high-fidelity image synthesis and editing. In biomedicine, these models facilitate counterfactual image editing, producing pairs of images where one is edited to simulate hypothetical…

Image and Video Processing · Electrical Eng. & Systems 2024-07-23 Malek Ben Alaya , Daniel M. Lang , Benedikt Wiestler , Julia A. Schnabel , Cosmin I. Bercea

Deep learning analyses have offered sensitivity leaps in detection of cognitive states from functional MRI (fMRI) measurements across the brain. Yet, as deep models perform hierarchical nonlinear transformations on their input, interpreting…

Signal Processing · Electrical Eng. & Systems 2023-07-20 Hasan Atakan Bedel , Tolga Çukur

Reducing the requirement for densely annotated masks in medical image segmentation is important due to cost constraints. In this paper, we consider the problem of inferring pixel-level predictions of brain lesions by only using image-level…

Computer Vision and Pattern Recognition · Computer Science 2022-07-26 Pedro Sanchez , Antanas Kascenas , Xiao Liu , Alison Q. O'Neil , Sotirios A. Tsaftaris

Foundation models trained on web-scraped datasets propagate societal biases to downstream tasks. While counterfactual generation enables bias analysis, existing methods introduce artifacts by modifying contextual elements like clothing and…

Computer Vision and Pattern Recognition · Computer Science 2024-12-13 Kirill Sirotkin , Marcos Escudero-Viñolo , Pablo Carballeira , Mayug Maniparambil , Catarina Barata , Noel E. O'Connor

Diabetic Retinopathy (DR) refers to a barrier that takes place in diabetes mellitus damaging the blood vessel network present in the retina. This may endanger the subjects' vision if they have diabetes. It can take some time to perform a DR…

Computer Vision and Pattern Recognition · Computer Science 2023-05-02 V. Banupriya , S. Anusuya

As black-box AI-driven decision-making systems become increasingly widespread in modern document processing workflows, improving their transparency and reliability has become critical, especially in high-stakes applications where biases or…

Computer Vision and Pattern Recognition · Computer Science 2025-08-07 Saifullah Saifullah , Stefan Agne , Andreas Dengel , Sheraz Ahmed

Generative models are becoming popular for the synthesis of medical images. Recently, neural diffusion models have demonstrated the potential to generate photo-realistic images of objects. However, their potential to generate medical images…

Image and Video Processing · Electrical Eng. & Systems 2022-11-03 Hazrat Ali , Shafaq Murad , Zubair Shah

Counterfactual examples have proven to be valuable in the field of natural language processing (NLP) for both evaluating and improving the robustness of language models to spurious correlations in datasets. Despite their demonstrated…

Machine Learning · Computer Science 2023-11-01 Tiep Le , Vasudev Lal , Phillip Howard

Shortcut learning is when a model -- e.g. a cardiac disease classifier -- exploits correlations between the target label and a spurious shortcut feature, e.g. a pacemaker, to predict the target label based on the shortcut rather than real…

Computer Vision and Pattern Recognition · Computer Science 2024-07-18 Nina Weng , Paraskevas Pegios , Eike Petersen , Aasa Feragen , Siavash Bigdeli

Counterfactual medical image generation effectively addresses data scarcity and enhances the interpretability of medical images. However, due to the complex and diverse pathological features of medical images and the imbalanced class…

Computer Vision and Pattern Recognition · Computer Science 2025-04-25 Weizhi Nie , Zichun Zhang , Weijie Wang , Bruno Lepri , Anan Liu , Nicu Sebe

Nowadays, deep vision models are being widely deployed in safety-critical applications, e.g., autonomous driving, and explainability of such models is becoming a pressing concern. Among explanation methods, counterfactual explanations aim…

Computer Vision and Pattern Recognition · Computer Science 2023-03-27 Mehdi Zemni , Mickaël Chen , Éloi Zablocki , Hédi Ben-Younes , Patrick Pérez , Matthieu Cord

Deep generative models have demonstrated remarkable success in medical image synthesis. However, ensuring conditioning faithfulness and high-quality synthetic images for direct or counterfactual generation remains a challenge. In this work,…

Computer Vision and Pattern Recognition · Computer Science 2025-10-31 Fangrui Huang , Alan Wang , Binxu Li , Bailey Trang , Ridvan Yesiloglu , Tianyu Hua , Wei Peng , Ehsan Adeli

Recent advancements in diffusion models have enabled the generation of realistic deepfakes from textual prompts in natural language. While these models have numerous benefits across various sectors, they have also raised concerns about the…

Computer Vision and Pattern Recognition · Computer Science 2024-05-22 Roberto Amoroso , Davide Morelli , Marcella Cornia , Lorenzo Baraldi , Alberto Del Bimbo , Rita Cucchiara