English
Related papers

Related papers: Achieve Fairness without Demographics for Dermatol…

200 papers

Learning a fair predictive model is crucial to mitigate biased decisions against minority groups in high-stakes applications. A common approach to learn such a model involves solving an optimization problem that maximizes the predictive…

Machine Learning · Computer Science 2023-06-08 Abhin Shah , Maohao Shen , Jongha Jon Ryu , Subhro Das , Prasanna Sattigeri , Yuheng Bu , Gregory W. Wornell

Although effective deepfake detection models have been developed in recent years, recent studies have revealed that these models can result in unfair performance disparities among demographic groups, such as race and gender. This can lead…

Computer Vision and Pattern Recognition · Computer Science 2024-03-03 Li Lin , Xinan He , Yan Ju , Xin Wang , Feng Ding , Shu Hu

Fair machine learning methods seek to train models that balance model performance across demographic subgroups defined over sensitive attributes like race and gender. Although sensitive attributes are typically assumed to be known during…

Machine Learning · Computer Science 2024-03-22 Akshaj Kumar Veldanda , Ivan Brugere , Sanghamitra Dutta , Alan Mishler , Siddharth Garg

One of the critical challenges in machine learning applications is to have fair predictions. There are numerous recent examples in various domains that convincingly show that algorithms trained with biased datasets can easily lead to…

Machine Learning · Computer Science 2020-06-18 Samaneh Abbasi-Sureshjani , Ralf Raumanns , Britt E. J. Michels , Gerard Schouten , Veronika Cheplygina

Artificial intelligence (AI) systems in healthcare have demonstrated remarkable potential to improve patient outcomes. However, if not designed with fairness in mind, they also carry the risks of perpetuating or exacerbating existing health…

Machine Learning · Computer Science 2025-01-24 Xiaoyang Wang , Christopher C. Yang

A multitude of work has shown that machine learning-based medical diagnosis systems can be biased against certain subgroups of people. This has motivated a growing number of bias mitigation algorithms that aim to address fairness issues in…

Machine Learning · Computer Science 2023-02-21 Yongshuo Zong , Yongxin Yang , Timothy Hospedales

In the rapidly advancing field of artificial intelligence, machine perception is becoming paramount to achieving increased performance. Image classification systems are becoming increasingly integral to various applications, ranging from…

Computer Vision and Pattern Recognition · Computer Science 2024-12-18 Javon Hickmon

Face gender classification models often reflect and amplify demographic biases present in their training data, leading to uneven performance across gender and racial subgroups. We introduce pseudo-balancing, a simple and effective strategy…

Computer Vision and Pattern Recognition · Computer Science 2025-10-14 Haohua Dong , Ana Manzano Rodríguez , Camille Guinaudeau , Shin'ichi Satoh

The subject of "fairness" in artificial intelligence (AI) refers to assessing AI algorithms for potential bias based on demographic characteristics such as race and gender, and the development of algorithms to address this bias. Most…

Computer Vision and Pattern Recognition · Computer Science 2021-07-02 Esther Puyol-Anton , Bram Ruijsink , Stefan K. Piechnik , Stefan Neubauer , Steffen E. Petersen , Reza Razavi , Andrew P. King

Machine learning models often inherit biases from historical data, raising critical concerns about fairness and accountability. Conventional fairness interventions typically require access to sensitive attributes like gender or race, but…

Machine Learning · Statistics 2026-04-21 Yixiao Lin , James Booth

Skin diseases, such as skin cancer, are a significant public health issue, and early diagnosis is crucial for effective treatment. Artificial intelligence (AI) algorithms have the potential to assist in triaging benign vs malignant skin…

Computer Vision and Pattern Recognition · Computer Science 2025-03-25 Nusrat Munia , Abdullah-Al-Zubaer Imran

Published research highlights the presence of demographic bias in automated facial attribute classification algorithms, particularly impacting women and individuals with darker skin tones. Existing bias mitigation techniques typically…

Computer Vision and Pattern Recognition · Computer Science 2024-09-02 Ayesha Manzoor , Ajita Rattani

Fairness is a core element in the trustworthy deployment of deepfake detection models, especially in the field of digital identity security. Biases in detection models toward different demographic groups, such as gender and race, may lead…

Computer Vision and Pattern Recognition · Computer Science 2026-03-09 Feng Ding , Wenhui Yi , Yunpeng Zhou , Xinan He , Hong Rao , Shu Hu

As artificial intelligence (AI) rapidly approaches human-level performance in medical imaging, it is crucial that it does not exacerbate or propagate healthcare disparities. Prior research has established AI's capacity to infer demographic…

Computers and Society · Computer Science 2023-12-19 Yuzhe Yang , Haoran Zhang , Judy W Gichoya , Dina Katabi , Marzyeh Ghassemi

Advances in artificial intelligence (AI) have achieved expert-level performance in medical imaging applications. Notably, self-supervised vision-language foundation models can detect a broad spectrum of pathologies without relying on…

Computers and Society · Computer Science 2024-02-23 Yuzhe Yang , Yujia Liu , Xin Liu , Avanti Gulhane , Domenico Mastrodicasa , Wei Wu , Edward J Wang , Dushyant W Sahani , Shwetak Patel

Training models with robust group fairness properties is crucial in ethically sensitive application areas such as medical diagnosis. Despite the growing body of work aiming to minimise demographic bias in AI, this problem remains…

Computer Vision and Pattern Recognition · Computer Science 2024-01-18 Raman Dutt , Ondrej Bohdal , Sotirios A. Tsaftaris , Timothy Hospedales

Unsupervised anomaly detection is a critical task in many high-social-impact applications such as finance, healthcare, social media, and cybersecurity, where demographics involving age, gender, race, disease, etc, are used frequently. In…

Machine Learning · Computer Science 2025-05-19 Feng Xiao , Xiaoying Tang , Jicong Fan

Face recognition systems (FRS) exhibit significant accuracy differences based on the user's gender. Since such a gender gap reduces the trustworthiness of FRS, more recent efforts have tried to find the causes. However, these studies make…

Computer Vision and Pattern Recognition · Computer Science 2025-01-22 Paul Jonas Kurz , Haiyu Wu , Kevin W. Bowyer , Philipp Terhörst

Artificial intelligence (AI) has shown remarkable promise in dermatology, offering accurate and non-invasive diagnosis of skin cancer. While extensive research has addressed skin tone-related bias, gender bias in dermatologic AI remains…

Image and Video Processing · Electrical Eng. & Systems 2025-12-01 Mingcheng Zhu , Mingxuan Liu , Han Yuan , Yilin Ning , Zhiyao Luo , Tingting Zhu , Nan Liu

Fairness is becoming a rising concern w.r.t. machine learning model performance. Especially for sensitive fields such as criminal justice and loan decision, eliminating the prediction discrimination towards a certain group of population…

Machine Learning · Computer Science 2019-09-09 Xiaoqian Wang , Heng Huang