English
Related papers

Related papers: Slicing Through Bias: Explaining Performance Gaps …

200 papers

Shortcut learning is a phenomenon where machine learning models prioritize learning simple, potentially misleading cues from data that do not generalize well beyond the training set. While existing research primarily investigates this in…

Image and Video Processing · Electrical Eng. & Systems 2024-06-28 Manxi Lin , Nina Weng , Kamil Mikolaj , Zahra Bashir , Morten Bo Søndergaard Svendsen , Martin Tolsgaard , Anders Nymark Christensen , Aasa Feragen

In semantic segmentation, even state-of-the-art deep learning models fall short of the performance required in certain high-stakes applications such as medical image analysis. In these cases, performance can be improved by allowing a model…

Machine Learning · Computer Science 2026-05-26 Bruno Laboissiere Camargos Borges , Bruno Machado Pacheco , Danilo Silva

Distributional drift detection is important in medical applications as it helps ensure the accuracy and reliability of models by identifying changes in the underlying data distribution that could affect the prediction results of machine…

Image and Video Processing · Electrical Eng. & Systems 2025-05-12 Yusen Wu , Phuong Nguyen , Rose Yesha , Yelena Yesha

While deep learning has shown promise in improving the automated diagnosis of disease based on chest X-rays, deep networks may exhibit undesirable behavior related to shortcuts. This paper studies the case of spurious class skew in which…

Computer Vision and Pattern Recognition · Computer Science 2020-09-23 Sarah Jabbour , David Fouhey , Ella Kazerooni , Michael W. Sjoding , Jenna Wiens

Automated pain detection through machine learning (ML) and deep learning (DL) algorithms holds significant potential in healthcare, particularly for patients unable to self-report pain levels. However, the accuracy and fairness of these…

Computer Vision and Pattern Recognition · Computer Science 2025-06-16 Dylan Green , Yuting Shang , Jiaee Cheong , Yang Liu , Hatice Gunes

Automated diagnosis from chest CT has improved considerably with deep learning, but models trained on skewed datasets tend to perform unevenly across patient demographics. However, the situation is worse than simple demographic bias. In…

Computer Vision and Pattern Recognition · Computer Science 2026-04-14 Justin Li , Daniel Ding , Asmita Yuki Pritha , Aryana Hou , Xin Wang , Shu Hu

We investigate performance disparities in deep classifiers. We find that the ability of classifiers to separate individuals into subgroups varies substantially across medical imaging modalities and protected characteristics; crucially, we…

Computer Vision and Pattern Recognition · Computer Science 2023-07-07 Charles Jones , Mélanie Roschewitz , Ben Glocker

Medical artificial intelligence (AI) systems, particularly multimodal vision-language models (VLM), often exhibit intersectional biases where models are systematically less confident in diagnosing marginalised patient subgroups. Such bias…

Computer Vision and Pattern Recognition · Computer Science 2025-12-25 Yupeng Zhang , Adam G. Dunn , Usman Naseem , Jinman Kim

Deep learning has led to state-of-the-art results for many medical imaging tasks, such as segmentation of different anatomical structures. With the increased numbers of deep learning publications and openly available code, the approach to…

Image and Video Processing · Electrical Eng. & Systems 2020-05-19 Tom van Sonsbeek , Veronika Cheplygina

Dataset distillation (DD) aims to compress large-scale datasets into compact synthetic counterparts for efficient model training. However, existing DD methods exhibit substantial performance degradation on long-tailed datasets. We identify…

Computer Vision and Pattern Recognition · Computer Science 2026-03-03 Ruixi Wu , Shaobo Wang , Jiahuan Chen , Zhiyuan Liu , Yicun Yang , Zhaorun Chen , Zekai Li , Kaixin Li , Xinming Wang , Hongzhu Yi , Kai Wang , Linfeng Zhang

Error slice discovery is crucial to diagnose and mitigate model errors. Current clustering or discrete attribute-based slice discovery methods face key limitations: 1) clustering results in incoherent slices, while assigning discrete…

Computation and Language · Computer Science 2025-06-02 Shantanu Ghosh , Rayan Syed , Chenyu Wang , Vaibhav Choudhary , Binxu Li , Clare B. Poynton , Shyam Visweswaran , Kayhan Batmanghelich

Fully convolutional neural networks have made promising progress in joint liver and liver tumor segmentation. Instead of following the debates over 2D versus 3D networks (for example, pursuing the balance between large-scale 2D pretraining…

Image and Video Processing · Electrical Eng. & Systems 2022-03-09 Shuxin Wang , Shilei Cao , Zhizhong Chai , Dong Wei , Kai Ma , Liansheng Wang , Yefeng Zheng

Despite advances in machine learning-based medical image classifiers, the safety and reliability of these systems remain major concerns in practical settings. Existing auditing approaches mainly rely on unimodal features or metadata-based…

Computer Vision and Pattern Recognition · Computer Science 2026-03-02 Yixuan Liu , Kanwal K. Bhatia , Ahmed E. Fetit

Deep learning models have shown promise in improving diagnostic accuracy from chest X-rays, but they also risk perpetuating healthcare disparities when performance varies across demographic groups. In this work, we present a comprehensive…

Computer Vision and Pattern Recognition · Computer Science 2025-10-14 Clemence Mottez , Louisa Fay , Maya Varma , Sophie Ostmeier , Curtis Langlotz

This article investigates the critical issue of dataset bias in medical imaging, with a particular emphasis on racial disparities caused by uneven population distribution in dataset collection. Our analysis reveals that medical segmentation…

Computer Vision and Pattern Recognition · Computer Science 2025-01-07 Yixiao Chen , Yue Yao , Ruining Yang , Md Zakir Hossain , Ashu Gupta , Tom Gedeon

As machine learning systems become democratized, it becomes increasingly important to help users easily debug their models. However, current data tools are still primitive when it comes to helping users trace model performance problems all…

Databases · Computer Science 2019-01-08 Yeounoh Chung , Tim Kraska , Neoklis Polyzotis , Ki Hyun Tae , Steven Euijong Whang

Despite the great performance of deep learning models in many areas, they still make mistakes and underperform on certain subsets of data, i.e. error slices. Given a trained model, it is important to identify its semantically coherent error…

Machine Learning · Computer Science 2025-12-23 Han Yu , Hao Zou , Jiashuo Liu , Renzhe Xu , Yue He , Xingxuan Zhang , Peng Cui

Segmentation is a fundamental task in medical image analysis. The clinical interest is often to measure the volume of a structure. To evaluate and compare segmentation methods, the similarity between a segmentation and a predefined ground…

Image and Video Processing · Electrical Eng. & Systems 2020-10-09 Jeroen Bertels , David Robben , Dirk Vandermeulen , Paul Suetens

Deep learning models have reached or surpassed human-level performance in the field of medical imaging, especially in disease diagnosis using chest x-rays. However, prior work has found that such classifiers can exhibit biases in the form…

Machine Learning · Computer Science 2022-03-24 Haoran Zhang , Natalie Dullerud , Karsten Roth , Lauren Oakden-Rayner , Stephen Robert Pfohl , Marzyeh Ghassemi

Accurate classification of lung diseases from chest CT scans plays an important role in computer-aided diagnosis systems. However, medical imaging datasets often suffer from severe class imbalance, which may significantly degrade the…

Image and Video Processing · Electrical Eng. & Systems 2026-03-18 Kejin Lu , Jianfa Bai , Qingqiu Li , Runtian Yuan , Jilan Xu , Junlin Hou , Yuejie Zhang , Rui Feng