English
Related papers

Related papers: Evaluating and Mitigating Bias in AI-Based Medical…

200 papers

An increasing number of decisions regarding the daily lives of human beings are being controlled by artificial intelligence (AI) algorithms in spheres ranging from healthcare, transportation, and education to college admissions,…

Computers and Society · Computer Science 2020-01-28 Dana Pessach , Erez Shmueli

Mitigating algorithmic bias is a critical task in the development and deployment of machine learning models. While several toolkits exist to aid machine learning practitioners in addressing fairness issues, little is known about the…

Human-Computer Interaction · Computer Science 2023-03-02 Zahra Ashktorab , Benjamin Hoover , Mayank Agarwal , Casey Dugan , Werner Geyer , Hao Bang Yang , Mikhail Yurochkin

Recent advances in Generative Artificial Intelligence (GenAI) have transformed educational content creation, particularly in developing tutor training materials. However, biases embedded in AI-generated content--such as gender, racial, or…

Computation and Language · Computer Science 2025-05-20 Jingyang Peng , Wenyuan Shen , Jiarui Rao , Jionghao Lin

The adoption of diagnosis and prognostic algorithms in healthcare has led to concerns about the perpetuation of bias against disadvantaged groups of individuals. Deep learning methods to detect and mitigate bias have revolved around…

In a world of daily emerging scientific inquisition and discovery, the prolific launch of machine learning across industries comes to little surprise for those familiar with the potential of ML. Neither so should the congruent expansion of…

Artificial Intelligence · Computer Science 2021-12-13 Brianna Richardson , Juan E. Gilbert

The human voice conveys unique characteristics of an individual, making voice biometrics a key technology for verifying identities in various industries. Despite the impressive progress of speaker recognition systems in terms of accuracy, a…

Sound · Computer Science 2022-08-24 Gianni Fenu , Giacomo Medda , Mirko Marras , Giacomo Meloni

Developing AI tools that preserve fairness is of critical importance, specifically in high-stakes applications such as those in healthcare. However, health AI models' overall prediction performance is often prioritized over the possible…

Machine Learning · Computer Science 2023-05-22 Raphael Poulain , Mirza Farhan Bin Tarek , Rahmatollah Beheshti

The deployment of generative AI (GenAI) models raises significant fairness concerns, addressed in this paper through novel characterization and enforcement techniques specific to GenAI. Unlike standard AI performing specific tasks, GenAI's…

Machine Learning · Computer Science 2025-08-12 Chih-Hong Cheng , Changshun Wu , Xingyu Zhao , Saddek Bensalem , Harald Ruess

Disparities in the societal harms and impacts of Generative AI (GenAI) systems highlight the critical need for effective unfairness measurement approaches. While numerous benchmarks exist, designing valid measurements requires proper…

Computers and Society · Computer Science 2025-07-08 Kimberly Le Truong , Annette Zimmermann , Hoda Heidari

With the rising adoption of Machine Learning across the domains like banking, pharmaceutical, ed-tech, etc, it has become utmost important to adopt responsible AI methods to ensure models are not unfairly discriminating against any group.…

Machine Learning · Computer Science 2022-12-02 Bhushan Chaudhari , Himanshu Chaudhary , Aakash Agarwal , Kamna Meena , Tanmoy Bhowmik

Although deep learning has demonstrated astonishing performance in many applications, there are still concerns about its dependability. One desirable property of deep learning applications with societal impact is fairness (i.e.,…

Machine Learning · Computer Science 2021-07-30 Peixin Zhang , Jingyi Wang , Jun Sun , Xinyu Wang , Guoliang Dong , Xingen Wang , Ting Dai , Jin Song Dong

Despite being responsible for state-of-the-art results in several computer vision and natural language processing tasks, neural networks have faced harsh criticism due to some of their current shortcomings. One of them is that neural…

Fairness,the impartial treatment towards individuals or groups regardless of their inherent or acquired characteristics [20], is a critical challenge for the successful implementation of Artificial Intelligence (AI) in multiple fields like…

Neural and Evolutionary Computing · Computer Science 2025-05-19 Catalina M Jaramillo , Paul Squires , Julian Togelius

Recent advancements in deep learning have shown transformative potential in medical imaging, yet concerns about fairness persist due to performance disparities across demographic subgroups. Existing methods aim to address these biases by…

Computer Vision and Pattern Recognition · Computer Science 2025-05-27 Yicheng Gao , Jinkui Hao , Bo Zhou

Automated gender classification has important applications in many domains, such as demographic research, law enforcement, online advertising, as well as human-computer interaction. Recent research has questioned the fairness of this…

Computer Vision and Pattern Recognition · Computer Science 2020-09-25 Anoop Krishnan , Ali Almadan , Ajita Rattani

Successful deployment of artificial intelligence (AI) in various settings has led to numerous positive outcomes for individuals and society. However, AI systems have also been shown to harm parts of the population due to biased predictions.…

Computers and Society · Computer Science 2023-07-21 Ondrej Bohdal , Timothy Hospedales , Philip H. S. Torr , Fazl Barez

Deep learning models have reached or surpassed human-level performance in the field of medical imaging, especially in disease diagnosis using chest x-rays. However, prior work has found that such classifiers can exhibit biases in the form…

Machine Learning · Computer Science 2022-03-24 Haoran Zhang , Natalie Dullerud , Karsten Roth , Lauren Oakden-Rayner , Stephen Robert Pfohl , Marzyeh Ghassemi

We present a theoretical framework analyzing the relationship between data distributions and fairness guarantees in equitable deep learning. We establish novel bounds that account for distribution heterogeneity across demographic groups,…

Machine Learning · Computer Science 2026-03-03 Yan Luo , Congcong Wen , Min Shi , Hao Huang , Yi Fang , Mengyu Wang

Naively trained AI models can be heavily biased. This can be particularly problematic when the biases involve legally or morally protected attributes such as ethnic background, age or gender. Existing solutions to this problem come at the…

Computer Vision and Pattern Recognition · Computer Science 2022-10-11 Nicholas Rosa , Tom Drummond , Mehrtash Harandi

As machine learning (ML) algorithms are increasingly used in medical image analysis, concerns have emerged about their potential biases against certain social groups. Although many approaches have been proposed to ensure the fairness of ML…

Machine Learning · Computer Science 2025-10-13 Thai-Hoang Pham , Jiayuan Chen , Seungyeon Lee , Yuanlong Wang , Sayoko Moroi , Xueru Zhang , Ping Zhang