English
Related papers

Related papers: Achieve Fairness without Demographics for Dermatol…

200 papers

Linear models are widely used in high-stakes decision-making due to their simplicity and interpretability. Yet when fairness constraints such as demographic parity are introduced, their effects on model coefficients, and thus on how…

Machine Learning · Statistics 2025-11-17 Bertille Tierny , Arthur Charpentier , François Hu

Artificial Intelligence (AI) has demonstrated success in computational pathology (CPath) for disease detection, biomarker classification, and prognosis prediction. However, its potential to learn unintended demographic biases, particularly…

Computer Vision and Pattern Recognition · Computer Science 2025-07-31 Shengjia Chen , Ruchika Verma , Kevin Clare , Jannes Jegminat , Eugenia Alleva , Kuan-lin Huang , Brandon Veremis , Thomas Fuchs , Gabriele Campanella

Fairness has been a critical issue that affects the adoption of deep learning models in real practice. To improve model fairness, many existing methods have been proposed and evaluated to be effective in their own contexts. However, there…

Machine Learning · Computer Science 2024-03-26 Junjie Yang , Jiajun Jiang , Zeyu Sun , Junjie Chen

Fairness through Unawareness (FtU) describes the idea that discrimination against demographic groups can be avoided by not considering group membership in the decisions or predictions. This idea has long been criticized in the machine…

Machine Learning · Computer Science 2025-08-26 Benedikt Höltgen , Nuria Oliver

The evaluation of fairness in machine learning systems has become a central concern in high-stakes applications, including biometric recognition, healthcare decision-making, and automated risk assessment. Existing approaches typically rely…

Machine Learning · Computer Science 2026-05-21 Khalid Adnan Alsayed

Training and evaluation of fair classifiers is a challenging problem. This is partly due to the fact that most fairness metrics of interest depend on both the sensitive attribute information and label information of the data points. In many…

Machine Learning · Computer Science 2021-02-18 Pranjal Awasthi , Alex Beutel , Matthaeus Kleindessner , Jamie Morgenstern , Xuezhi Wang

We study fairness in supervised few-shot meta-learning models that are sensitive to discrimination (or bias) in historical data. A machine learning model trained based on biased data tends to make unfair predictions for users from minority…

Machine Learning · Computer Science 2020-09-25 Chen Zhao , Feng Chen

Trustworthy deployment of deep learning medical imaging models into real-world clinical practice requires that they be calibrated. However, models that are well calibrated overall can still be poorly calibrated for a sub-population,…

Image and Video Processing · Electrical Eng. & Systems 2023-07-21 Changjian Shui , Justin Szeto , Raghav Mehta , Douglas L. Arnold , Tal Arbel

Cutaneous malignancies demand early detection for favorable outcomes, yet current diagnostics suffer from inter-observer variability and access disparities. While AI shows promise, existing dermatological systems are limited by homogeneous…

Computer Vision and Pattern Recognition · Computer Science 2025-10-09 Sher Khan , Raz Muhammad , Adil Hussain , Muhammad Sajjad , Muhammad Rashid

Despite the impressive prediction ability, machine learning models show discrimination towards certain demographics and suffer from unfair prediction behaviors. To alleviate the discrimination, extensive studies focus on eliminating the…

Machine Learning · Computer Science 2023-07-11 Chia-Yuan Chang , Yu-Neng Chuang , Kwei-Herng Lai , Xiaotian Han , Xia Hu , Na Zou

In the current development and deployment of many artificial intelligence (AI) systems in healthcare, algorithm fairness is a challenging problem in delivering equitable care. Recent evaluation of AI models stratified across race…

Computer Vision and Pattern Recognition · Computer Science 2022-03-25 Richard J. Chen , Tiffany Y. Chen , Jana Lipkova , Judy J. Wang , Drew F. K. Williamson , Ming Y. Lu , Sharifa Sahai , Faisal Mahmood

Machine learning models are widely adopted in scenarios that directly affect people. The development of software systems based on these models raises societal and legal concerns, as their decisions may lead to the unfair treatment of…

Machine Learning · Computer Science 2019-10-08 Inês Valentim , Nuno Lourenço , Nuno Antunes

Artificial intelligence (AI) algorithms using deep learning have advanced the classification of skin disease images; however these algorithms have been mostly applied "in silico" and not validated clinically. Most dermatology AI algorithms…

Computer Vision and Pattern Recognition · Computer Science 2021-05-24 Roxana Daneshjou , Carrie Kovarik , Justin M Ko

When it is ethical and legal to use a sensitive attribute (such as gender or race) in machine learning systems, the question remains how to do so. We show that the naive application of machine learning algorithms using sensitive features…

Machine Learning · Computer Science 2017-07-21 Cynthia Dwork , Nicole Immorlica , Adam Tauman Kalai , Max Leiserson

Common fairness definitions in machine learning focus on balancing notions of disparity and utility. In this work, we study fairness in the context of risk disparity among sub-populations. We are interested in learning models that minimize…

Machine Learning · Computer Science 2019-11-19 Natalia Martinez , Martin Bertran , Guillermo Sapiro

Machine learning models built on datasets containing discriminative instances attributed to various underlying factors result in biased and unfair outcomes. It's a well founded and intuitive fact that existing bias mitigation strategies…

Machine Learning · Computer Science 2022-10-25 Bhushan Chaudhari , Akash Agarwal , Tanmoy Bhowmik

Skin lesions can be an early indicator of a wide range of infectious and other diseases. The use of deep learning (DL) models to diagnose skin lesions has great potential in assisting clinicians with prescreening patients. However, these…

Computer Vision and Pattern Recognition · Computer Science 2022-03-01 Haolin Yuan , Armin Hadzic , William Paul , Daniella Villegas de Flores , Philip Mathew , John Aucott , Yinzhi Cao , Philippe Burlina

How can we control for latent discrimination in predictive models? How can we provably remove it? Such questions are at the heart of algorithmic fairness and its impacts on society. In this paper, we define a new operational fairness…

Machine Learning · Computer Science 2019-02-25 Soheil Ghili , Ehsan Kazemi , Amin Karbasi

There has been increasing awareness of ethical issues in machine learning, and fairness has become an important research topic. Most fairness efforts in computer vision have been focused on human sensing applications and preventing…

Computer Vision and Pattern Recognition · Computer Science 2022-06-06 Zu Kim , André Araujo , Bingyi Cao , Cam Askew , Jack Sim , Mike Green , N'Mah Fodiatu Yilla , Tobias Weyand

Fairness of deepfake detectors in the presence of anomalies are not well investigated, especially if those anomalies are more prominent in either male or female subjects. The primary motivation for this work is to evaluate how deepfake…

Computer Vision and Pattern Recognition · Computer Science 2022-03-15 Muxin Pu , Meng Yi Kuan , Nyee Thoang Lim , Chun Yong Chong , Mei Kuan Lim