English
Related papers

Related papers: Worst-Group Equalized Odds Regularization for Mult…

200 papers

Artificial Intelligence (AI) models have demonstrated expert-level performance in melanoma detection, yet their clinical adoption is hindered by performance disparities across demographic subgroups such as gender, race, and age. Previous…

Machine Learning · Computer Science 2025-11-12 Brandon Dominique , Prudence Lam , Nicholas Kurtansky , Jochen Weber , Kivanc Kose , Veronica Rotemberg , Jennifer Dy

Statistical parity metrics have been widely studied and endorsed in the AI community as a means of achieving fairness, but they suffer from at least two weaknesses. They disregard the actual welfare consequences of decisions and may…

Artificial Intelligence · Computer Science 2024-05-21 Violet Chen , J. N. Hooker , Derek Leben

The subject of "fairness" in artificial intelligence (AI) refers to assessing AI algorithms for potential bias based on demographic characteristics such as race and gender, and the development of algorithms to address this bias. Most…

Computer Vision and Pattern Recognition · Computer Science 2021-07-02 Esther Puyol-Anton , Bram Ruijsink , Stefan K. Piechnik , Stefan Neubauer , Steffen E. Petersen , Reza Razavi , Andrew P. King

Deep anomaly detection (AD) is perhaps the most controversial of data analytic tasks as it identifies entities that are then specifically targeted for further investigation or exclusion. Also controversial is the application of AI to facial…

Artificial Intelligence · Computer Science 2024-07-30 Michael Livanos , Ian Davidson

Face gender classification models often reflect and amplify demographic biases present in their training data, leading to uneven performance across gender and racial subgroups. We introduce pseudo-balancing, a simple and effective strategy…

Computer Vision and Pattern Recognition · Computer Science 2025-10-14 Haohua Dong , Ana Manzano Rodríguez , Camille Guinaudeau , Shin'ichi Satoh

Optimal performance is critical for decision-making tasks from medicine to autonomous driving, however common performance measures may be too general or too specific. For binary classifiers, diagnostic tests or prognosis at a timepoint,…

Fairness and accountability are two essential pillars for trustworthy Artificial Intelligence (AI) in healthcare. However, the existing AI model may be biased in its decision marking. To tackle this issue, we propose an adversarial…

Computer Vision and Pattern Recognition · Computer Science 2021-05-12 Xiaoxiao Li , Ziteng Cui , Yifan Wu , Lin Gu , Tatsuya Harada

The rapid growth of healthcare data and advances in computational power have accelerated the adoption of artificial intelligence (AI) in medicine. However, AI systems deployed without explicit fairness considerations risk exacerbating…

Machine Learning · Computer Science 2025-04-22 Xiaoyang Wang , Christopher C. Yang

As machine learning (ML) algorithms are increasingly used in social domains to make predictions about humans, there is a growing concern that these algorithms may exhibit biases against certain social groups. Numerous notions of fairness…

Machine Learning · Computer Science 2025-09-30 Zhongteng Cai , Mohammad Mahdi Khalili , Xueru Zhang

In the current development and deployment of many artificial intelligence (AI) systems in healthcare, algorithm fairness is a challenging problem in delivering equitable care. Recent evaluation of AI models stratified across race…

Computer Vision and Pattern Recognition · Computer Science 2022-03-25 Richard J. Chen , Tiffany Y. Chen , Jana Lipkova , Judy J. Wang , Drew F. K. Williamson , Ming Y. Lu , Sharifa Sahai , Faisal Mahmood

Algorithmic fairness has become a central concern in modern machine learning and AI applications. However, two pressing challenges remain: (1) The fairness guarantees of existing methods often rely on specific data distributional…

Methodology · Statistics 2026-05-14 Xiaotian Hou , Linjun Zhang

While methods for measuring and correcting differential performance in risk prediction models have proliferated in recent years, most existing techniques can only be used to assess fairness across relatively large subgroups. The purpose of…

Methodology · Statistics 2024-01-30 Solvejg Wastvedt , Jared D Huling , Julian Wolfson

Machine Learning or Artificial Intelligence algorithms have gained considerable scrutiny in recent times owing to their propensity towards imitating and amplifying existing prejudices in society. This has led to a niche but growing body of…

Machine Learning · Computer Science 2022-05-06 Avijit Ghosh , Lea Genuit , Mary Reagan

With the universal adoption of machine learning in healthcare, the potential for the automation of societal biases to further exacerbate health disparities poses a significant risk. We explore algorithmic fairness from the perspective of…

Machine Learning · Computer Science 2024-04-02 Md Rahat Shahriar Zawad , Peter Washington

Medical image analysis models can exhibit performance disparities across patient subgroups, threatening clinical safety and fairness. Existing methods typically address this issue by optimizing accuracy and fairness metrics for visible…

Computer Vision and Pattern Recognition · Computer Science 2026-05-29 Milad Masroor , Cuong Nguyen , Kevin Wells , Gustavo Carneiro

In this work we formulate and formally characterize group fairness as a multi-objective optimization problem, where each sensitive group risk is a separate objective. We propose a fairness criterion where a classifier achieves minimax risk…

Machine Learning · Statistics 2020-11-04 Natalia Martinez , Martin Bertran , Guillermo Sapiro

Fair biometric algorithms have similar verification performance across different demographic groups given a single decision threshold. Unfortunately, for state-of-the-art face recognition networks, score distributions differ between…

Computer Vision and Pattern Recognition · Computer Science 2024-07-23 Yu Linghu , Tiago de Freitas Pereira , Christophe Ecabert , Sébastien Marcel , Manuel Günther

This study presents a machine learning (ML) pipeline for clinical data classification in the context of a 30-day readmission problem, along with a fairness audit on subgroups based on sensitive attributes. A range of ML models are used for…

Machine Learning · Computer Science 2023-04-13 Shaina Raza

The concern about hidden discrimination in machine learning models is growing, as their widespread real-world applications increasingly impact human lives. Various techniques, including commonly used group fairness measures and several…

Machine Learning · Computer Science 2026-03-12 Yijun Bian

Unsupervised anomaly detection is a critical task in many high-social-impact applications such as finance, healthcare, social media, and cybersecurity, where demographics involving age, gender, race, disease, etc, are used frequently. In…

Machine Learning · Computer Science 2025-05-19 Feng Xiao , Xiaoying Tang , Jicong Fan