English
Related papers

Related papers: Mitigating attribute amplification in counterfactu…

200 papers

Radiology Report Generation (RRG) draws attention as a vision-and-language interaction of biomedical fields. Previous works inherited the ideology of traditional language generation tasks, aiming to generate paragraphs with high readability…

Computer Vision and Pattern Recognition · Computer Science 2024-07-31 Xiao Song , Jiafan Liu , Yun Li , Yan Liu , Wenbin Lei , Ruxin Wang

In this paper, we propose leveraging causal generative learning as an interpretable tool for explaining image classifiers. Specifically, we present a generative counterfactual inference approach to study the influence of visual features…

Machine Learning · Computer Science 2024-01-23 Will Taylor-Melanson , Zahra Sadeghi , Stan Matwin

Spurious correlations threaten the validity of statistical classifiers. While model accuracy may appear high when the test data is from the same distribution as the training data, it can quickly degrade when the test distribution changes.…

Machine Learning · Computer Science 2020-12-21 Zhao Wang , Aron Culotta

In medical image analysis, model predictions can be affected by sensitive attributes, such as race and gender, leading to fairness concerns and potential biases in diagnostic outcomes. To mitigate this, we present a causal modeling…

Computer Vision and Pattern Recognition · Computer Science 2024-12-09 Bowei Tian , Yexiao He , Meng Liu , Yucong Dai , Ziyao Wang , Shwai He , Guoheng Sun , Zheyu Shen , Wanghao Ye , Yongkai Wu , Ang Li

An algorithm effects a causal representation of relations between features and labels in the human's perception. Such a representation might conflict with the human's prior belief. Explanations can direct the human's attention to the…

Human-Computer Interaction · Computer Science 2024-02-14 Charles Wan , Rodrigo Belo , Leid Zejnilović , Susana Lavado

It is evidence that representation learning can improve model's performance over multiple downstream tasks in many real-world scenarios, such as image classification and recommender systems. Existing learning approaches rely on establishing…

Machine Learning · Computer Science 2022-02-18 Mengyue Yang , Xinyu Cai , Furui Liu , Xu Chen , Zhitang Chen , Jianye Hao , Jun Wang

One of the primary challenges limiting the applicability of deep learning is its susceptibility to learning spurious correlations rather than the underlying mechanisms of the task of interest. The resulting failure to generalise cannot be…

Computer Vision and Pattern Recognition · Computer Science 2020-04-21 Damien Teney , Ehsan Abbasnedjad , Anton van den Hengel

Deep learning has become a popular tool for medical image analysis, but the limited availability of training data remains a major challenge, particularly in the medical field where data acquisition can be costly and subject to privacy…

Image and Video Processing · Electrical Eng. & Systems 2024-06-11 Aghiles Kebaili , Jérôme Lapuyade-Lahorgue , Su Ruan

Mammogram benign or malignant classification with only image-level labels is challenging due to the absence of lesion annotations. Motivated by the symmetric prior that the lesions on one side of breasts rarely appear in the corresponding…

Computer Vision and Pattern Recognition · Computer Science 2021-10-04 Chu-ran Wang , Jing Li , Fandong Zhang , Xinwei Sun , Hao Dong , Yizhou Yu , Yizhou Wang

We study the phenomenon of bias amplification in classifiers, wherein a machine learning model learns to predict classes with a greater disparity than the underlying ground truth. We demonstrate that bias amplification can arise via an…

Machine Learning · Computer Science 2019-10-22 Klas Leino , Emily Black , Matt Fredrikson , Shayak Sen , Anupam Datta

Neural network-based approaches can achieve high accuracy in various medical image segmentation tasks. However, they generally require large labelled datasets for supervised learning. Acquiring and manually labelling a large medical dataset…

Image and Video Processing · Electrical Eng. & Systems 2020-06-25 Chen Chen , Chen Qin , Huaqi Qiu , Cheng Ouyang , Shuo Wang , Liang Chen , Giacomo Tarroni , Wenjia Bai , Daniel Rueckert

Despite large-scale pre-trained language models have achieved striking results for text classificaion, recent work has raised concerns about the challenge of shortcut learning. In general, a keyword is regarded as a shortcut if it creates a…

Computation and Language · Computer Science 2023-07-06 Rui Song , Fausto Giunchiglia , Yingji Li , Hao Xu

Foundation models trained on web-scraped datasets propagate societal biases to downstream tasks. While counterfactual generation enables bias analysis, existing methods introduce artifacts by modifying contextual elements like clothing and…

Computer Vision and Pattern Recognition · Computer Science 2024-12-13 Kirill Sirotkin , Marcos Escudero-Viñolo , Pablo Carballeira , Mayug Maniparambil , Catarina Barata , Noel E. O'Connor

Adequate sampling space coverage is the keystone to effectively train trustworthy Machine Learning models. Unfortunately, real data do carry several inherent risks due to the many potential biases they exhibit when gathered without a proper…

Machine Learning · Computer Science 2025-03-27 Antonio Maratea , Rita Perna

Ascription of an image gives insights into the objects that influence the classification of the whole image or its pixels towards a specific category. These insights help radiologists to visualize deformities in medical imaging. Most of the…

Computer Vision and Pattern Recognition · Computer Science 2026-05-08 Shakeeb Murtaza

Medical image classification is one of the most critical problems in the image recognition area. One of the major challenges in this field is the scarcity of labelled training data. Additionally, there is often class imbalance in datasets…

Image and Video Processing · Electrical Eng. & Systems 2022-09-29 Khushboo Mehra , Hassan Soliman , Soumya Ranjan Sahoo

Contrastive learning, a prominent approach within self-supervised learning, has demonstrated significant effectiveness in developing generalizable models for various applications involving natural images. However, recent research indicates…

Computer Vision and Pattern Recognition · Computer Science 2025-01-07 Zijie Cheng , Boxuan Li , André Altmann , Pearse A Keane , Yukun Zhou

In recent years, image generation has made great strides in improving the quality of images, producing high-fidelity ones. Also, quite recently, there are architecture designs, which enable GAN to unsupervisedly learn the semantic…

Computer Vision and Pattern Recognition · Computer Science 2022-08-10 Xin Jin , Shu Zhao , Le Zhang , Xin Zhao , Qiang Deng , Chaoen Xiao

Soft augmentation regularizes the supervised learning process of image classifiers by reducing label confidence of a training sample based on the magnitude of random-crop augmentation applied to it. This paper extends this adaptive label…

Computer Vision and Pattern Recognition · Computer Science 2025-07-23 Georg Siedel , Ekagra Gupta , Weijia Shao , Silvia Vock , Andrey Morozov

Counterfactual image generation presents significant challenges, including preserving identity, maintaining perceptual quality, and ensuring faithfulness to an underlying causal model. While existing auto-encoding frameworks admit semantic…

Machine Learning · Computer Science 2025-06-10 Rajat Rasal , Avinash Kori , Fabio De Sousa Ribeiro , Tian Xia , Ben Glocker