English
Related papers

Related papers: Towards Auditability for Fairness in Deep Learning

200 papers

The remarkable performance of deep learning models and their applications in consequential domains (e.g., facial recognition) introduces important challenges at the intersection of equity and security. Fairness and robustness are two…

Machine Learning · Computer Science 2022-11-24 Cuong Tran , Keyu Zhu , Ferdinando Fioretto , Pascal Van Hentenryck

The issue of fairness in machine learning stems from the fact that historical data often displays biases against specific groups of people which have been underprivileged in the recent past, or still are. In this context, one of the…

Machine Learning · Computer Science 2022-01-19 Mattia Cerrato , Marius Köppel , Alexander Segner , Stefan Kramer

Various measures can be used to estimate bias or unfairness in a predictor. Previous work has already established that some of these measures are incompatible with each other. Here we show that, when groups differ in prevalence of the…

Applications · Statistics 2017-09-13 Thomas Miconi

Before deploying a black-box model in high-stakes problems, it is important to evaluate the model's performance on sensitive subpopulations. For example, in a recidivism prediction task, we may wish to identify demographic groups for which…

Methodology · Statistics 2023-06-09 John J. Cherian , Emmanuel J. Candès

Understanding and removing bias from the decisions made by machine learning models is essential to avoid discrimination against unprivileged groups. Despite recent progress in algorithmic fairness, there is still no clear answer as to which…

Recent research has identified discriminatory behavior of automated prediction algorithms towards groups identified on specific protected attributes (e.g., gender, ethnicity, age group, etc.). When deployed in real-world scenarios, such…

Machine Learning · Computer Science 2023-12-20 Anubha Pandey , Aditi Rai , Maneet Singh , Deepak Bhatt , Tanmoy Bhowmik

Optimizing prediction accuracy can come at the expense of fairness. Towards minimizing discrimination against a group, fair machine learning algorithms strive to equalize the behavior of a model across different groups, by imposing a…

Machine Learning · Statistics 2020-06-17 Hongyan Chang , Ta Duy Nguyen , Sasi Kumar Murakonda , Ehsan Kazemi , Reza Shokri

The most prevalent notions of fairness in machine learning are statistical definitions: they fix a small collection of pre-defined groups, and then ask for parity of some statistic of the classifier across these groups. Constraints of this…

Machine Learning · Computer Science 2018-12-04 Michael Kearns , Seth Neel , Aaron Roth , Zhiwei Steven Wu

While the field of algorithmic fairness has brought forth many ways to measure and improve the fairness of machine learning models, these findings are still not widely used in practice. We suspect that one reason for this is that the field…

Computers and Society · Computer Science 2022-03-16 Corinna Hertweck , Christoph Heitz

Machine learning models are central to people's lives and impact society in ways as fundamental as determining how people access information. The gravity of these models imparts a responsibility to model developers to ensure that they are…

Applications · Statistics 2020-07-13 Cyrus DiCiccio , Sriram Vasudevan , Kinjal Basu , Krishnaram Kenthapadi , Deepak Agarwal

Predictive process monitoring focuses on forecasting future states of ongoing process executions, such as predicting the outcome of a particular case. In recent years, the application of machine learning models in this domain has garnered…

Machine Learning · Computer Science 2025-04-29 Jari Peeperkorn , Simon De Vos

As the use of predictive machine learning algorithms increases in high-stakes decision-making, it is imperative that these algorithms are fair across sensitive groups. However, measuring and enforcing fairness in real-world applications can…

Machine Learning · Statistics 2025-07-14 Beepul Bharti , Mary Versa Clemens-Sewall , Paul H. Yi , Jeremias Sulam

Machine learning models are becoming pervasive in high-stakes applications. Despite their clear benefits in terms of performance, the models could show discrimination against minority groups and result in fairness issues in a…

Machine Learning · Computer Science 2022-04-12 Mingyang Wan , Daochen Zha , Ninghao Liu , Na Zou

Machine learning algorithms are increasingly deployed in critical domains such as finance, healthcare, and criminal justice [1]. The increasing popularity of algorithmic decision-making has stimulated interest in algorithmic fairness within…

Machine Learning · Computer Science 2025-11-18 Animesh Joshi

A central goal of algorithmic fairness is to reduce bias in automated decision making. An unavoidable tension exists between accuracy gains obtained by using sensitive information (e.g., gender or ethnic group) as part of a statistical…

Machine Learning · Statistics 2020-02-03 Luca Oneto , Michele Donini , Amon Elders , Massimiliano Pontil

As Large Language Models (LLMs) become increasingly powerful and accessible to human users, ensuring fairness across diverse demographic groups, i.e., group fairness, is a critical ethical concern. However, current fairness and bias…

Computation and Language · Computer Science 2025-03-12 Kefan Song , Jin Yao , Runnan Jiang , Rohan Chandra , Shangtong Zhang

The deep integration of foundation models (FM) with federated learning (FL) enhances personalization and scalability for diverse downstream tasks, making it crucial in sensitive domains like healthcare. Achieving group fairness has become…

Machine Learning · Computer Science 2025-06-24 Yuning Yang , Han Yu , Tianrun Gao , Xiaodong Xu , Guangyu Wang

We propose an analysis in fair learning that preserves the utility of the data while reducing prediction disparities under the criteria of group sufficiency. We focus on the scenario where the data contains multiple or even many subgroups,…

Machine Learning · Statistics 2022-11-30 Changjian Shui , Gezheng Xu , Qi Chen , Jiaqi Li , Charles Ling , Tal Arbel , Boyu Wang , Christian Gagné

The definition and implementation of fairness in automated decisions has been extensively studied by the research community. Yet, there hides fallacious reasoning, misleading assertions, and questionable practices at the foundations of the…

Computers and Society · Computer Science 2023-06-05 Robert Lee Poe , Soumia Zohra El Mestari

Machine learning systems are notoriously prone to biased predictions about certain demographic groups, leading to algorithmic fairness issues. Due to privacy concerns and data quality problems, some demographic information may not be…

Machine Learning · Computer Science 2024-12-31 Yingtao Luo , Zhixun Li , Qiang Liu , Jun Zhu