English
Related papers

Related papers: Dataset Distribution Impacts Model Fairness: Singl…

200 papers

Skin color has historically been a focal point of discrimination, yet fairness research in machine learning for medical imaging often relies on coarse subgroup categories, overlooking individual-level variations. Such group-based approaches…

Computer Vision and Pattern Recognition · Computer Science 2025-12-10 Kuniko Paxton , Zeinab Dehghani , Koorosh Aslansefat , Dhavalkumar Thakker , Yiannis Papadopoulos

Human biases have been shown to influence the performance of models and algorithms in various fields, including Natural Language Processing. While the study of this phenomenon is garnering focus in recent years, the available resources are…

Computation and Language · Computer Science 2024-08-15 Ana Sofia Evans , Helena Moniz , Luísa Coheur

As interest in applying machine learning techniques for medical images continues to grow at a rapid pace, models are starting to be developed and deployed for clinical applications. In the clinical AI model development lifecycle (described…

Image and Video Processing · Electrical Eng. & Systems 2020-08-20 Giorgio Pietro Biondetti , Romane Gauriau , Christopher P. Bridge , Charles Lu , Katherine P. Andriole

In this paper, we describe our method for the ISIC 2019 Skin Lesion Classification Challenge. The challenge comes with two tasks. For task 1, skin lesions have to be classified based on dermoscopic images. For task 2, dermoscopic images and…

Computer Vision and Pattern Recognition · Computer Science 2019-10-10 Nils Gessert , Maximilian Nielsen , Mohsin Shaikh , René Werner , Alexander Schlaefer

In recent years, the rapid development of artificial intelligence (AI) systems has raised concerns about our ability to ensure their fairness, that is, how to avoid discrimination based on protected characteristics such as gender, race, or…

Computer Vision and Pattern Recognition · Computer Science 2025-03-06 Iris Dominguez-Catena , Daniel Paternain , Mikel Galar , MaryBeth Defrance , Maarten Buyl , Tijl De Bie

Data-driven predictive solutions predominant in commercial applications tend to suffer from biases and stereotypes, which raises equity concerns. Prediction models may discover, use, or amplify spurious correlations based on gender or other…

Computation and Language · Computer Science 2022-11-28 Abdelrahman Zayed , Prasanna Parthasarathi , Goncalo Mordido , Hamid Palangi , Samira Shabanian , Sarath Chandar

Deep learning methods have greatly increased the accuracy of face recognition, but an old problem still persists: accuracy is usually higher for men than women. It is often speculated that lower accuracy for women is caused by…

Computer Vision and Pattern Recognition · Computer Science 2020-04-08 Vítor Albiero , Kai Zhang , Kevin W. Bowyer

Recent advances in deep learning and on-device inference could transform routine screening for skin cancers. Along with the anticipated benefits of this technology, potential dangers arise from unforeseen and inherent biases. A significant…

Computer Vision and Pattern Recognition · Computer Science 2025-12-23 Ko Watanabe , Stanislav Frolov , Aya Hassan , David Dembinsky , Adriano Lucieri , Andreas Dengel

Automated gender classification has important applications in many domains, such as demographic research, law enforcement, online advertising, as well as human-computer interaction. Recent research has questioned the fairness of this…

Computer Vision and Pattern Recognition · Computer Science 2020-09-25 Anoop Krishnan , Ali Almadan , Ajita Rattani

Deep learning models have shown promise in improving diagnostic accuracy from chest X-rays, but they also risk perpetuating healthcare disparities when performance varies across demographic groups. In this work, we present a comprehensive…

Computer Vision and Pattern Recognition · Computer Science 2025-10-14 Clemence Mottez , Louisa Fay , Maya Varma , Sophie Ostmeier , Curtis Langlotz

Fairness in machine learning (ML) has garnered significant attention in recent years. While existing research has predominantly focused on the distributive fairness of ML models, there has been limited exploration of procedural fairness.…

Machine Learning · Computer Science 2025-01-14 Ziming Wang , Changwu Huang , Ke Tang , Xin Yao

Skin cancer detection is challenging since different types of skin lesions share high similarities. This paper proposes a computer-based deep learning approach that will accurately identify different kinds of skin lesions. Deep learning…

Computer Vision and Pattern Recognition · Computer Science 2023-03-15 Mst Shapna Akter , Hossain Shahriar , Sweta Sneha , Alfredo Cuzzocrea

The increasing amount of applications of Artificial Intelligence (AI) has led researchers to study the social impact of these technologies and evaluate their fairness. Unfortunately, current fairness metrics are hard to apply in multi-class…

Computer Vision and Pattern Recognition · Computer Science 2022-10-14 Iris Dominguez-Catena , Daniel Paternain , Mikel Galar

Bias and stereotypes in language models can cause harm, especially in sensitive areas like content moderation and decision-making. This paper addresses bias and stereotype detection by exploring how jointly learning these tasks enhances…

Computation and Language · Computer Science 2025-07-03 Aditya Tomar , Rudra Murthy , Pushpak Bhattacharyya

Fairness in deep learning models trained with high-dimensional inputs and subjective labels remains a complex and understudied area. Facial emotion recognition, a domain where datasets are often racially imbalanced, can lead to models that…

Computer Vision and Pattern Recognition · Computer Science 2023-08-10 Alex Fan , Xingshuo Xiao , Peter Washington

Deep learning has achieved impressive performance across various medical imaging tasks. However, its inherent bias against specific groups hinders its clinical applicability in equitable healthcare systems. A recently discovered phenomenon,…

Computer Vision and Pattern Recognition · Computer Science 2024-11-01 Kaouther Mouheb , Marawan Elbatel , Stefan Klein , Esther E. Bron

Recent developments in machine learning have shown that successful models do not rely only on huge amounts of data but the right kind of data. We show in this paper how this data-centric approach can be facilitated in a decentralized manner…

Computer Vision and Pattern Recognition · Computer Science 2022-10-31 M. R. Ahan , Robin Lehmann , Richard Blythman

Optimizing prediction accuracy can come at the expense of fairness. Towards minimizing discrimination against a group, fair machine learning algorithms strive to equalize the behavior of a model across different groups, by imposing a…

Machine Learning · Statistics 2020-06-17 Hongyan Chang , Ta Duy Nguyen , Sasi Kumar Murakonda , Ehsan Kazemi , Reza Shokri

This dissertation explores the impact of bias in deep neural networks and presents methods for reducing its influence on model performance. The first part begins by categorizing and describing potential sources of bias and errors in data…

Machine Learning · Computer Science 2023-08-21 Agnieszka Mikołajczyk-Bareła

One challenging property lurking in medical datasets is the imbalanced data distribution, where the frequency of the samples between the different classes is not balanced. Training a model on an imbalanced dataset can introduce unique…

Image and Video Processing · Electrical Eng. & Systems 2022-04-06 Ashkan Khakzar , Yawei Li , Yang Zhang , Mirac Sanisoglu , Seong Tae Kim , Mina Rezaei , Bernd Bischl , Nassir Navab