English
Related papers

Related papers: Addressing Fairness Issues in Deep Learning-Based …

200 papers

The rise in the use of AI/ML applications across industries has sparked more discussions about the fairness of AI/ML in recent times. While prior research on the fairness of AI/ML exists, there is a lack of empirical studies focused on…

Computers and Society · Computer Science 2024-08-02 Aastha Pant , Rashina Hoda , Chakkrit Tantithamthavorn , Burak Turhan

The issue of group fairness in machine learning models, where certain sub-populations or groups are favored over others, has been recognized for some time. While many mitigation strategies have been proposed in centralized learning, many of…

Machine Learning · Computer Science 2023-05-18 Ganghua Wang , Ali Payani , Myungjin Lee , Ramana Kompella

The rise of general-purpose artificial intelligence (AI) systems, particularly large language models (LLMs), has raised pressing moral questions about how to reduce bias and ensure fairness at scale. Researchers have documented a sort of…

Computation and Language · Computer Science 2025-06-06 Jacy Anthis , Kristian Lum , Michael Ekstrand , Avi Feller , Chenhao Tan

A significant level of stigma and inequality exists in mental healthcare, especially in under-served populations. Inequalities are reflected in the data collected for scientific purposes. When not properly accounted for, machine learning…

Medical image analysis (MedIA) has become an essential tool in medicine and healthcare, aiding in disease diagnosis, prognosis, and treatment planning, and recent successes in deep learning (DL) have made significant contributions to its…

Image and Video Processing · Electrical Eng. & Systems 2024-12-10 Jee Seok Yoon , Kwanseok Oh , Yooseung Shin , Maciej A. Mazurowski , Heung-Il Suk

Problem statement: Standardisation of AI fairness rules and benchmarks is challenging because AI fairness and other ethical requirements depend on multiple factors such as context, use case, type of the AI system, and so on. In this paper,…

Artificial Intelligence · Computer Science 2022-12-22 Avinash Agarwal , Harsh Agarwal

The potential risk of AI systems unintentionally embedding and reproducing bias has attracted the attention of machine learning practitioners and society at large. As policy makers are willing to set the standards of algorithms and AI…

Artificial Intelligence · Computer Science 2020-03-17 Boris Ruf , Chaouki Boutharouite , Marcin Detyniecki

Equity of educational outcome and fairness of AI with respect to race have been topics of increasing importance in education. In this work, we address both with empirical evaluations of grade prediction in higher education, an important…

Computers and Society · Computer Science 2021-05-17 Weijie Jiang , Zachary A. Pardos

The growing capability and accessibility of machine learning has led to its application to many real-world domains and data about people. Despite the benefits algorithmic systems may bring, models can reflect, inject, or exacerbate implicit…

Machine Learning · Computer Science 2021-10-28 Ángel Alexander Cabrera , Will Epperson , Fred Hohman , Minsuk Kahng , Jamie Morgenstern , Duen Horng Chau

Much attention and concern has been raised recently about bias and the use of machine learning algorithms in healthcare, especially as it relates to perpetuating racial discrimination and health disparities. Following an initial system…

Machine Learning · Computer Science 2023-05-24 Jill A. Kuhlberg , Irene Headen , Ellis A. Ballard , Donald Martin

The performance of deep neural networks for image recognition tasks such as predicting a smiling face is known to degrade with under-represented classes of sensitive attributes. We address this problem by introducing fairness-aware…

Computer Vision and Pattern Recognition · Computer Science 2022-10-04 Tobias Hänel , Nishant Kumar , Dmitrij Schlesinger , Mengze Li , Erdem Ünal , Abouzar Eslami , Stefan Gumhold

Nowadays, the analysis of complex phenomena modeled by graphs plays a crucial role in many real-world application domains where decisions can have a strong societal impact. However, numerous studies and papers have recently revealed that…

Machine Learning · Computer Science 2024-02-23 Charlotte Laclau , Christine Largeron , Manvi Choudhary

Discrimination via algorithmic decision making has received considerable attention. Prior work largely focuses on defining conditions for fairness, but does not define satisfactory measures of algorithmic unfairness. In this paper, we focus…

We present a theoretical framework analyzing the relationship between data distributions and fairness guarantees in equitable deep learning. We establish novel bounds that account for distribution heterogeneity across demographic groups,…

Machine Learning · Computer Science 2026-03-03 Yan Luo , Congcong Wen , Min Shi , Hao Huang , Yi Fang , Mengyu Wang

The human voice conveys unique characteristics of an individual, making voice biometrics a key technology for verifying identities in various industries. Despite the impressive progress of speaker recognition systems in terms of accuracy, a…

Sound · Computer Science 2022-08-24 Gianni Fenu , Giacomo Medda , Mirko Marras , Giacomo Meloni

Differences in data distributions between demographic groups, known as the problem of infra-marginality, complicate how people evaluate fairness in machine learning models. We present a user study with 85 participants in a hypothetical…

Human-Computer Interaction · Computer Science 2026-03-09 Schrasing Tong , Minseok Jung , Ilaria Liccardi , Lalana Kagal

Understanding and removing bias from the decisions made by machine learning models is essential to avoid discrimination against unprivileged groups. Despite recent progress in algorithmic fairness, there is still no clear answer as to which…

Ensuring that machine learning (ML) models are safe, effective, and equitable across all patients is critical for clinical decision-making and for preventing the amplification of existing health disparities. In this work, we examine how…

Machine Learning · Computer Science 2025-05-28 Jianhui Gao , Benson Chou , Zachary R. McCaw , Hilary Thurston , Paul Varghese , Chuan Hong , Jessica Gronsbell

As Artificial Intelligence (AI) increasingly integrates into our daily lives, fairness has emerged as a critical concern, particularly in medical AI, where datasets often reflect inherent biases due to social factors like the…

Machine Learning · Computer Science 2024-07-22 Yi Sheng , Junhuan Yang , Jinyang Li , James Alaina , Xiaowei Xu , Yiyu Shi , Jingtong Hu , Weiwen Jiang , Lei Yang

The advent of AI and ML algorithms has led to opportunities as well as challenges. In this paper, we provide an overview of bias and fairness issues that arise with the use of ML algorithms. We describe the types and sources of data bias,…

Machine Learning · Statistics 2021-05-17 Nengfeng Zhou , Zach Zhang , Vijayan N. Nair , Harsh Singhal , Jie Chen , Agus Sudjianto