English
Related papers

Related papers: Achieve Fairness without Demographics for Dermatol…

200 papers

A central goal of algorithmic fairness is to reduce bias in automated decision making. An unavoidable tension exists between accuracy gains obtained by using sensitive information (e.g., gender or ethnic group) as part of a statistical…

Machine Learning · Statistics 2020-02-03 Luca Oneto , Michele Donini , Amon Elders , Massimiliano Pontil

Deep learning models, particularly Convolutional Neural Networks (CNNs), have demonstrated exceptional performance in diagnosing skin diseases, often outperforming dermatologists. However, they have also unveiled biases linked to specific…

Computer Vision and Pattern Recognition · Computer Science 2024-05-17 Anshul Pundhir , Balasubramanian Raman , Pravendra Singh

Deep learning models have achieved great success in automating skin lesion diagnosis. However, the ethnic disparity in these models' predictions, where lesions on darker skin types are usually underrepresented and have lower diagnosis…

Computer Vision and Pattern Recognition · Computer Science 2022-08-23 Siyi Du , Ben Hers , Nourhan Bayasi , Ghassan Hamarneh , Rafeef Garbi

Deep learning has achieved remarkable success in image classification and segmentation tasks. However, fairness concerns persist, as models often exhibit biases that disproportionately affect demographic groups defined by sensitive…

Computer Vision and Pattern Recognition · Computer Science 2024-11-20 Milad Masroor , Tahir Hassan , Yu Tian , Kevin Wells , David Rosewarne , Thanh-Toan Do , Gustavo Carneiro

Fairness is crucial when training a deep-learning discriminative model, especially in the facial domain. Models tend to correlate specific characteristics (such as age and skin color) with unrelated attributes (downstream tasks), resulting…

Computer Vision and Pattern Recognition · Computer Science 2023-11-06 Moreno D'Incà , Christos Tzelepis , Ioannis Patras , Nicu Sebe

With the universal adoption of machine learning in healthcare, the potential for the automation of societal biases to further exacerbate health disparities poses a significant risk. We explore algorithmic fairness from the perspective of…

Machine Learning · Computer Science 2024-04-02 Md Rahat Shahriar Zawad , Peter Washington

Machine learning systems are notoriously prone to biased predictions about certain demographic groups, leading to algorithmic fairness issues. Due to privacy concerns and data quality problems, some demographic information may not be…

Machine Learning · Computer Science 2024-12-31 Yingtao Luo , Zhixun Li , Qiang Liu , Jun Zhu

Algorithms and models are increasingly deployed to inform decisions about people, inevitably affecting their lives. As a consequence, those in charge of developing these models must carefully evaluate their impact on different groups of…

Computers and Society · Computer Science 2023-04-27 Alessandro Fabris , Andrea Esuli , Alejandro Moreo , Fabrizio Sebastiani

Machine learning models have demonstrated promising performance in many areas. However, the concerns that they can be biased against specific demographic groups hinder their adoption in high-stake applications. Thus, it is essential to…

Machine Learning · Computer Science 2023-05-31 Canyu Chen , Yueqing Liang , Xiongxiao Xu , Shangyu Xie , Ashish Kundu , Ali Payani , Yuan Hong , Kai Shu

Recent work has explored how to train machine learning models which do not discriminate against any subgroup of the population as determined by sensitive attributes such as gender or race. To avoid disparate treatment, sensitive attributes…

Machine Learning · Statistics 2018-09-06 Niki Kilbertus , Adrià Gascón , Matt J. Kusner , Michael Veale , Krishna P. Gummadi , Adrian Weller

In today's society, AI systems are increasingly used to make critical decisions such as credit scoring and patient triage. However, great convenience brought by AI systems comes with troubling prevalence of bias against underrepresented…

Machine Learning · Computer Science 2021-05-11 Yan Zhou , Murat Kantarcioglu , Chris Clifton

Fairness is a fundamental requirement for trustworthy and human-centered Artificial Intelligence (AI) system. However, deep neural networks (DNNs) tend to make unfair predictions when the training data are collected from different…

Computer Vision and Pattern Recognition · Computer Science 2022-11-02 Ruichen Yao , Ziteng Cui , Xiaoxiao Li , Lin Gu

Fairness is a critical component of Trustworthy AI. In this paper, we focus on Machine Learning (ML) and the performance of model predictions when dealing with skin color. Unlike other sensitive attributes, the nature of skin color differs…

Computer Vision and Pattern Recognition · Computer Science 2025-06-16 Kuniko Paxton , Koorosh Aslansefat , Dhavalkumar Thakker , Yiannis Papadopoulos

Recent advances in deep learning and on-device inference could transform routine screening for skin cancers. Along with the anticipated benefits of this technology, potential dangers arise from unforeseen and inherent biases. A significant…

Computer Vision and Pattern Recognition · Computer Science 2025-12-23 Ko Watanabe , Stanislav Frolov , Aya Hassan , David Dembinsky , Adriano Lucieri , Andreas Dengel

Modern machine learning (ML) models are becoming increasingly popular and are widely used in decision-making systems. However, studies have shown critical issues of ML discrimination and unfairness, which hinder their adoption on high-stake…

Machine Learning · Computer Science 2023-06-01 Yueqing Liang , Canyu Chen , Tian Tian , Kai Shu

Within a legal framework, fairness in datasets and models is typically assessed by dividing observations into predefined groups and then computing fairness measures (e.g., Disparate Impact or Equality of Odds with respect to gender).…

Computer Vision and Pattern Recognition · Computer Science 2025-07-16 Veronika Shilova , Emmanuel Malherbe , Giovanni Palma , Laurent Risser , Jean-Michel Loubes

Deepfake detection models face two critical challenges: generalization to unseen manipulations and demographic fairness among population groups. However, existing approaches often demonstrate that these two objectives are inherently…

Machine Learning · Computer Science 2025-07-04 Harry Cheng , Ming-Hui Liu , Yangyang Guo , Tianyi Wang , Liqiang Nie , Mohan Kankanhalli

Most proposed algorithmic fairness techniques require access to data on a "sensitive attribute" or "protected category" (such as race, ethnicity, gender, or sexuality) in order to make performance comparisons and standardizations across…

Computers and Society · Computer Science 2022-05-05 McKane Andrus , Sarah Villeneuve

Demographic bias is one of the major challenges for face recognition systems. The majority of existing studies on demographic biases are heavily dependent on specific demographic groups or demographic classifier, making it difficult to…

Computer Vision and Pattern Recognition · Computer Science 2024-09-17 Tetsushi Ohki , Yuya Sato , Masakatsu Nishigaki , Koichi Ito

Mitigating the discrimination of machine learning models has gained increasing attention in medical image analysis. However, rare works focus on fair treatments for patients with multiple sensitive demographic ones, which is a crucial yet…

Computer Vision and Pattern Recognition · Computer Science 2023-03-10 Wenlong Deng , Yuan Zhong , Qi Dou , Xiaoxiao Li