English
Related papers

Related papers: Detecting Dataset Bias in Medical AI: A Generalize…

200 papers

As machine learning (ML) systems become increasingly widespread, it is necessary to audit these systems for biases prior to their deployment. Recent research has developed algorithms for effectively identifying intersectional bias in the…

Human-Computer Interaction · Computer Science 2022-06-28 David Munechika , Zijie J. Wang , Jack Reidy , Josh Rubin , Krishna Gade , Krishnaram Kenthapadi , Duen Horng Chau

This paper addresses the often overlooked issue of fairness in the autonomous driving domain, particularly in vision-based perception and prediction systems, which play a pivotal role in the overall functioning of Autonomous Vehicles (AVs).…

Computer Vision and Pattern Recognition · Computer Science 2023-12-12 David Fernández Llorca , Pedro Frau , Ignacio Parra , Rubén Izquierdo , Emilia Gómez

The increasing deployment of artificial intelligence (AI) in clinical settings challenges foundational assumptions underlying traditional frameworks of medical evidence. Classical statistical approaches, centered on randomized controlled…

Methodology · Statistics 2026-01-07 Richik Chakraborty

Artificial intelligence (AI) systems have the potential to revolutionize clinical practices, including improving diagnostic accuracy and surgical decision-making, while also reducing costs and manpower. However, it is important to recognize…

Artificial Intelligence · Computer Science 2024-09-18 Yifan Yang , Mingquan Lin , Han Zhao , Yifan Peng , Furong Huang , Zhiyong Lu

A major bottleneck in characterizing the failure modes of generative AI systems is the cost and time of annotation and evaluation. Consequently, adaptive testing paradigms have gained popularity, where one opportunistically decides which…

Artificial Intelligence · Computer Science 2026-05-11 Siyu Zhou , Patrick Vossler , Venkatesh Sivaraman , Yifan Mai , Jean Feng

Generalization is an important attribute of machine learning models, particularly for those that are to be deployed in a medical context, where unreliable predictions can have real world consequences. While the failure of models to…

Computer Vision and Pattern Recognition · Computer Science 2022-12-14 Brennan Nichyporuk , Jillian Cardinell , Justin Szeto , Raghav Mehta , Jean-Pierre R. Falet , Douglas L. Arnold , Sotirios A. Tsaftaris , Tal Arbel

Recent advances in Natural Language Processing (NLP), and specifically automated Question Answering (QA) systems, have demonstrated both impressive linguistic fluency and a pernicious tendency to reflect social biases. In this study, we…

Computation and Language · Computer Science 2021-08-05 Cécile Logé , Emily Ross , David Yaw Amoah Dadey , Saahil Jain , Adriel Saporta , Andrew Y. Ng , Pranav Rajpurkar

The widespread application of Deep Learning across diverse domains hinges critically on the quality and composition of training datasets. However, the common lack of disclosure regarding their usage raises significant privacy and copyright…

Cryptography and Security · Computer Science 2025-12-16 Shuo Shao , Yiming Li , Mengren Zheng , Zhiyang Hu , Yukun Chen , Boheng Li , Yu He , Junfeng Guo , Dacheng Tao , Zhan Qin

AI-enhanced personality assessments are increasingly shaping hiring decisions, using affective computing to predict traits from the Big Five (OCEAN) model. However, integrating AI into these assessments raises ethical concerns, especially…

Human-Computer Interaction · Computer Science 2025-11-24 Dena F. Mujtaba , Nihar R. Mahapatra

With the growing utilization of machine learning in healthcare, there is increasing potential to enhance healthcare outcomes. However, this also brings the risk of perpetuating biases in data and model design that can harm certain…

Machine Learning · Computer Science 2023-08-15 Shaina Raza , Parisa Osivand Pour , Syed Raza Bashir

Artificial intelligence (AI) is increasingly intervening in our lives, raising widespread concern about its unintended and undeclared side effects. These developments have brought attention to the problem of AI auditing: the systematic…

Computers and Society · Computer Science 2024-10-08 Sarah H. Cen , Rohan Alur

As Artificial Intelligence (AI) increasingly integrates into our daily lives, fairness has emerged as a critical concern, particularly in medical AI, where datasets often reflect inherent biases due to social factors like the…

Machine Learning · Computer Science 2024-07-22 Yi Sheng , Junhuan Yang , Jinyang Li , James Alaina , Xiaowei Xu , Yiyu Shi , Jingtong Hu , Weiwen Jiang , Lei Yang

Medical imaging AI systems such as disease classification and segmentation are increasingly inspired and transformed from computer vision based AI systems. Although an array of adversarial training and/or loss function based defense…

Machine Learning · Computer Science 2020-06-25 Xin Li , Deng Pan , Dongxiao Zhu

Real-world data often exhibits bias, imbalance, and privacy risks. Synthetic datasets have emerged to address these issues. This paradigm relies on generative AI models to generate unbiased, privacy-preserving data while maintaining…

Artificial intelligence (AI) has significantly improved medical screening accuracy, particularly in cancer detection and risk assessment. However, traditional classification metrics often fail to account for imbalanced data, varying…

Machine Learning · Computer Science 2025-10-28 Longfei Wei , Fang Sheng , Jianfei Zhang

The increasing use of generative AI for resume screening is predicated on the assumption that it offers an unbiased alternative to biased human decision-making. However, this belief fails to address a critical question: are these AI systems…

Computers and Society · Computer Science 2025-07-18 Kevin T Webster

Artificial intelligence (AI) systems in healthcare have demonstrated remarkable potential to improve patient outcomes. However, if not designed with fairness in mind, they also carry the risks of perpetuating or exacerbating existing health…

Machine Learning · Computer Science 2025-01-24 Xiaoyang Wang , Christopher C. Yang

For safety, medical AI systems undergo thorough evaluations before deployment, validating their predictions against a ground truth which is assumed to be fixed and certain. However, this ground truth is often curated in the form of…

Biased data representation in AI marginalizes up to 75 million autistic people worldwide through medical applications viewing autism as a deficit of neurotypical social skills rather than an aspect of human diversity, and this perspective…

Human-Computer Interaction · Computer Science 2025-07-30 Naba Rizvi

Introduction: Healthcare AI models often inherit biases from their training data. While efforts have primarily targeted bias in structured data, mental health heavily depends on unstructured data. This study aims to detect and mitigate…