English
Related papers

Related papers: Evaluating Fairness and Mitigating Bias in Machine…

200 papers

Group fairness metrics can detect when a deep learning model behaves differently for advantaged and disadvantaged groups, but even models that score well on these metrics can make blatantly unfair predictions. We present smooth prediction…

Machine Learning · Computer Science 2020-12-02 Ivoline C. Ngong , Krystal Maughan , Joseph P. Near

Machine learning (ML) algorithms have become integral to decision making in various domains, including healthcare, finance, education, and law enforcement. However, concerns about fairness and bias in these systems pose significant ethical…

Machine Learning · Computer Science 2024-12-18 Ahmed Rashed , Abdelkrim Kallich , Mohamed Eltayeb

Fairness-aware machine learning has attracted a surge of attention in many domains, such as online advertising, personalized recommendation, and social media analysis in web applications. Fairness-aware machine learning aims to eliminate…

Machine Learning · Computer Science 2023-07-18 Jing Ma , Ruocheng Guo , Aidong Zhang , Jundong Li

Fairness in machine learning is crucial when individuals are subject to automated decisions made by models in high-stake domains. Organizations that employ these models may also need to satisfy regulations that promote responsible and…

Machine Learning · Computer Science 2020-10-14 Shubham Sharma , Alan H. Gee , David Paydarfar , Joydeep Ghosh

In medical image analysis, model predictions can be affected by sensitive attributes, such as race and gender, leading to fairness concerns and potential biases in diagnostic outcomes. To mitigate this, we present a causal modeling…

Computer Vision and Pattern Recognition · Computer Science 2024-12-09 Bowei Tian , Yexiao He , Meng Liu , Yucong Dai , Ziyao Wang , Shwai He , Guoheng Sun , Zheyu Shen , Wanghao Ye , Yongkai Wu , Ang Li

How can we control for latent discrimination in predictive models? How can we provably remove it? Such questions are at the heart of algorithmic fairness and its impacts on society. In this paper, we define a new operational fairness…

Machine Learning · Computer Science 2019-02-25 Soheil Ghili , Ehsan Kazemi , Amin Karbasi

Ensuring that AI-based facial recognition systems produce fair predictions and work equally well across all demographic groups is crucial. Earlier systems often exhibited demographic bias, particularly in gender and racial classification,…

Computer Vision and Pattern Recognition · Computer Science 2024-10-16 Shweta Patel , Dakshina Ranjan Kisku

In this paper, we present an empirical study on image recognition fairness, i.e., extreme class accuracy disparity on balanced data like ImageNet. We experimentally demonstrate that classes are not equal and the fairness issue is prevalent…

Machine Learning · Computer Science 2024-03-14 Jiequan Cui , Beier Zhu , Xin Wen , Xiaojuan Qi , Bei Yu , Hanwang Zhang

Artificial intelligence (AI) systems increasingly inform medical decision-making, yet concerns about algorithmic bias and inequitable outcomes persist, particularly for historically marginalized populations. This paper introduces the…

Machine Learning · Computer Science 2025-07-22 Andrés Morales-Forero , Lili J. Rueda , Ronald Herrera , Samuel Bassetto , Eric Coatanea

Face recognition and verification are two computer vision tasks whose performance has progressed with the introduction of deep representations. However, ethical, legal, and technical challenges due to the sensitive character of face data…

Computer Vision and Pattern Recognition · Computer Science 2024-10-24 Alexandre Fournier-Montgieux , Michael Soumm , Adrian Popescu , Bertrand Luvison , Hervé Le Borgne

Naively trained AI models can be heavily biased. This can be particularly problematic when the biases involve legally or morally protected attributes such as ethnic background, age or gender. Existing solutions to this problem come at the…

Computer Vision and Pattern Recognition · Computer Science 2022-10-11 Nicholas Rosa , Tom Drummond , Mehrtash Harandi

Deep learning models have achieved great success in automating skin lesion diagnosis. However, the ethnic disparity in these models' predictions, where lesions on darker skin types are usually underrepresented and have lower diagnosis…

Computer Vision and Pattern Recognition · Computer Science 2022-08-23 Siyi Du , Ben Hers , Nourhan Bayasi , Ghassan Hamarneh , Rafeef Garbi

With the universal adoption of machine learning in healthcare, the potential for the automation of societal biases to further exacerbate health disparities poses a significant risk. We explore algorithmic fairness from the perspective of…

Machine Learning · Computer Science 2024-04-02 Md Rahat Shahriar Zawad , Peter Washington

In recent years the development of artificial intelligence (AI) systems for automated medical image analysis has gained enormous momentum. At the same time, a large body of work has shown that AI systems can systematically and unfairly…

Image and Video Processing · Electrical Eng. & Systems 2023-05-10 María Agustina Ricci Lara , Candelaria Mosquera , Enzo Ferrante , Rodrigo Echeveste

Research has shown that, machine learning models might inherit and propagate undesired social biases encoded in the data. To address this problem, fair training algorithms are developed. However, most algorithms assume we know…

Machine Learning · Computer Science 2022-04-12 Mustafa Safa Ozdayi , Murat Kantarcioglu , Rishabh Iyer

In today's society, AI systems are increasingly used to make critical decisions such as credit scoring and patient triage. However, great convenience brought by AI systems comes with troubling prevalence of bias against underrepresented…

Machine Learning · Computer Science 2021-05-11 Yan Zhou , Murat Kantarcioglu , Chris Clifton

Machine Learning (ML) models are widely employed to drive many modern data systems. While they are undeniably powerful tools, ML models often demonstrate imbalanced performance and unfair behaviors. The root of this problem often lies in…

Machine Learning · Computer Science 2023-08-10 Ke Yang , Alexandra Meliou

With fairness concerns gaining significant attention in Machine Learning (ML), several bias mitigation techniques have been proposed, often compared against each other to find the best method. These benchmarking efforts tend to use a common…

Machine Learning · Computer Science 2024-11-20 Prakhar Ganesh , Usman Gohar , Lu Cheng , Golnoosh Farnadi

The increasing amount of applications of Artificial Intelligence (AI) has led researchers to study the social impact of these technologies and evaluate their fairness. Unfortunately, current fairness metrics are hard to apply in multi-class…

Computer Vision and Pattern Recognition · Computer Science 2022-10-14 Iris Dominguez-Catena , Daniel Paternain , Mikel Galar

Presence of bias (in datasets or tasks) is inarguably one of the most critical challenges in machine learning applications that has alluded to pivotal debates in recent years. Such challenges range from spurious associations between…

Computer Vision and Pattern Recognition · Computer Science 2020-11-23 Ehsan Adeli , Qingyu Zhao , Adolf Pfefferbaum , Edith V. Sullivan , Li Fei-Fei , Juan Carlos Niebles , Kilian M. Pohl