English
Related papers

Related papers: Detecting Shortcut Learning for Fair Medical AI us…

200 papers

Machine Learning (ML) algorithms are vital for supporting clinical decision-making in biomedical informatics. However, their predictive performance can vary across demographic groups, often due to the underrepresentation of historically…

Machine Learning · Computer Science 2025-03-04 Ioannis Bilionis , Ricardo C. Berrios , Luis Fernandez-Luque , Carlos Castillo

Data collected in the real world often encapsulates historical discrimination against disadvantaged groups and individuals. Existing fair machine learning (FairML) research has predominantly focused on mitigating discriminative bias in the…

Machine Learning · Computer Science 2024-06-19 Zhining Liu , Ruizhong Qiu , Zhichen Zeng , Yada Zhu , Hendrik Hamann , Hanghang Tong

In recent years fairness in machine learning (ML) has emerged as a highly active area of research and development. Most define fairness in simple terms, where fairness means reducing gaps in performance or outcomes between demographic…

Artificial Intelligence · Computer Science 2023-03-14 Brent Mittelstadt , Sandra Wachter , Chris Russell

Detection of easily missed hidden patterns with fast processing power makes machine learning (ML) indispensable to today's healthcare system. Though many ML applications have already been discovered and many are still under investigation,…

Machine Learning · Computer Science 2023-07-27 Mrinmoy Roy , Sarwar J. Minar , Porarthi Dhar , A T M Omor Faruq

Deep learning algorithms have demonstrated remarkable efficacy in various medical image analysis (MedIA) applications. However, recent research highlights a performance disparity in these algorithms when applied to specific subgroups, such…

Computer Vision and Pattern Recognition · Computer Science 2024-07-10 Zikang Xu , Jun Li , Qingsong Yao , Han Li , Mingyue Zhao , S. Kevin Zhou

In a world of daily emerging scientific inquisition and discovery, the prolific launch of machine learning across industries comes to little surprise for those familiar with the potential of ML. Neither so should the congruent expansion of…

Artificial Intelligence · Computer Science 2021-12-13 Brianna Richardson , Juan E. Gilbert

In medical image diagnosis, fairness has become increasingly crucial. Without bias mitigation, deploying unfair AI would harm the interests of the underprivileged population and potentially tear society apart. Recent research addresses…

Computer Vision and Pattern Recognition · Computer Science 2024-05-06 Ching-Hao Chiu , Yu-Jen Chen , Yawen Wu , Yiyu Shi , Tsung-Yi Ho

Artificial intelligence (AI) systems in healthcare have demonstrated remarkable potential to improve patient outcomes. However, if not designed with fairness in mind, they also carry the risks of perpetuating or exacerbating existing health…

Machine Learning · Computer Science 2025-01-24 Xiaoyang Wang , Christopher C. Yang

With the widespread use of AI systems and applications in our everyday lives, it is important to take fairness issues into consideration while designing and engineering these types of systems. Such systems can be used in many sensitive…

Machine Learning · Computer Science 2022-01-26 Ninareh Mehrabi , Fred Morstatter , Nripsuta Saxena , Kristina Lerman , Aram Galstyan

Data heterogeneity plays a pivotal role in determining the performance of machine learning (ML) systems. Traditional algorithms, which are typically designed to optimize average performance, often overlook the intrinsic diversity within…

Machine Learning · Computer Science 2025-06-03 Jiashuo Liu , Peng Cui

Recently, the research community of computerized medical imaging has started to discuss and address potential fairness issues that may emerge when developing and deploying AI systems for medical image analysis. This chapter covers some of…

Computer Vision and Pattern Recognition · Computer Science 2024-07-25 Enzo Ferrante , Rodrigo Echeveste

AI-driven decision-making systems are becoming instrumental in the public sector, with applications spanning areas like criminal justice, social welfare, financial fraud detection, and public health. While these systems offer great…

Machine Learning · Computer Science 2024-10-15 Unai Fischer-Abaigar , Christoph Kern , Noam Barda , Frauke Kreuter

Predictive machine learning (ML) models are computational innovations that can enhance medical decision-making, including aiding in determining optimal timing for discharging patients. However, societal biases can be encoded into such…

Computers and Society · Computer Science 2024-12-10 Ugur Kursuncu , Aaron Baird , Yusen Xia

Background: The rapid advancement of Machine Learning (ML) represents novel opportunities to enhance public health research, surveillance, and decision-making. However, there is a lack of comprehensive understanding of algorithmic bias,…

Machine Learning · Computer Science 2024-09-04 Shaina Raza , Arash Shaban-Nejad , Elham Dolatabadi , Hiroshi Mamiya

With fairness concerns gaining significant attention in Machine Learning (ML), several bias mitigation techniques have been proposed, often compared against each other to find the best method. These benchmarking efforts tend to use a common…

Machine Learning · Computer Science 2024-11-20 Prakhar Ganesh , Usman Gohar , Lu Cheng , Golnoosh Farnadi

The rise of algorithmic decision-making has spawned much research on fair machine learning (ML). Financial institutions use ML for building risk scorecards that support a range of credit-related decisions. Yet, the literature on fair ML in…

Machine Learning · Statistics 2022-06-20 Nikita Kozodoi , Johannes Jacob , Stefan Lessmann

Shortcut learning refers to the phenomenon where models employ simple, non-robust decision rules in practical tasks, which hinders their generalization and robustness. With the rapid development of large language models (LLMs) in recent…

Computation and Language · Computer Science 2024-12-02 Rui Song , Yingji Li , Lida Shi , Fausto Giunchiglia , Hao Xu

The subject of "fairness" in artificial intelligence (AI) refers to assessing AI algorithms for potential bias based on demographic characteristics such as race and gender, and the development of algorithms to address this bias. Most…

Computer Vision and Pattern Recognition · Computer Science 2021-07-02 Esther Puyol-Anton , Bram Ruijsink , Stefan K. Piechnik , Stefan Neubauer , Steffen E. Petersen , Reza Razavi , Andrew P. King

Machine Learning algorithms (ML) impact virtually every aspect of human lives and have found use across diverse sectors including healthcare, finance, and education. Often, ML algorithms have been found to exacerbate societal biases present…

Machine Learning · Computer Science 2025-06-02 Jonathan Vasquez , Carlotta Domeniconi , Huzefa Rangwala

Transparency in Machine Learning (ML), attempts to reveal the working mechanisms of complex models. Transparent ML promises to advance human factors engineering goals of human-centered AI in the target users. From a human-centered design…

Human-Computer Interaction · Computer Science 2022-10-03 Haomin Chen , Catalina Gomez , Chien-Ming Huang , Mathias Unberath