English
Related papers

Related papers: Fair Decisions from Calibrated Scores: Achieving O…

200 papers

Binary decision making classifiers are not fair by default. Fairness requirements are an additional element to the decision making rationale, which is typically driven by maximizing some utility function. In that sense, algorithmic fairness…

Computers and Society · Computer Science 2022-06-07 Joachim Baumann , Anikó Hannák , Christoph Heitz

Achieving the Bayes optimal binary classification rule subject to group fairness constraints is known to be reducible, in some cases, to learning a group-wise thresholding rule over the Bayes regressor. In this paper, we extend this result…

Machine Learning · Computer Science 2020-06-01 Ibrahim Alabdulmohsin

We study the problem of fair binary classification using the notion of Equal Opportunity. It requires the true positive rate to distribute equally across the sensitive groups. Within this setting we show that the fair optimal classifier is…

Statistics Theory · Mathematics 2020-02-05 Evgenii Chzhen , Christophe Denis , Mohamed Hebiri , Luca Oneto , Massimiliano Pontil

We study the problem of post-processing a supervised machine-learned regressor to maximize fair binary classification at all decision thresholds. By decreasing the statistical distance between each group's score distributions, we show that…

Machine Learning · Computer Science 2023-12-12 Kweku Kwegyir-Aggrey , A. Feder Cooper , Jessica Dai , John Dickerson , Keegan Hines , Suresh Venkatasubramanian

We clarify what fairness guarantees we can and cannot expect to follow from unconstrained machine learning. Specifically, we characterize when unconstrained learning on its own implies group calibration, that is, the outcome variable is…

Machine Learning · Computer Science 2019-01-28 Lydia T. Liu , Max Simchowitz , Moritz Hardt

This paper considers fair probabilistic binary classification where the outputs of primary interest are predicted probabilities, commonly referred to as scores. We formulate the problem of transforming scores to satisfy fairness constraints…

Machine Learning · Computer Science 2021-11-02 Dennis Wei , Karthikeyan Natesan Ramamurthy , Flavio du Pin Calmon

We consider a binary classification problem under group fairness constraints, which can be one of Demographic Parity (DP), Equalized Opportunity (EOp), or Equalized Odds (EO). We propose an explicit characterization of Bayes optimal…

Machine Learning · Statistics 2024-03-18 Wenlong Chen , Yegor Klochkov , Yang Liu

Algorithmic fairness has become a central concern in modern machine learning and AI applications. However, two pressing challenges remain: (1) The fairness guarantees of existing methods often rely on specific data distributional…

Methodology · Statistics 2026-05-14 Xiaotian Hou , Linjun Zhang

Increasing concerns about disparate effects of AI have motivated a great deal of work on fair machine learning. Existing works mainly focus on independence- and separation-based measures (e.g., demographic parity, equality of opportunity,…

Machine Learning · Statistics 2022-06-07 Xianli Zeng , Edgar Dobriban , Guang Cheng

Machine learning algorithms may have disparate impacts on protected groups. To address this, we develop methods for Bayes-optimal fair classification, aiming to minimize classification error subject to given group fairness constraints. We…

Machine Learning · Statistics 2025-08-28 Xianli Zeng , Kevin Jiang , Guang Cheng , Edgar Dobriban

Machine learning algorithms are becoming integrated into more and more high-stakes decision-making processes, such as in social welfare issues. Due to the need of mitigating the potentially disparate impacts from algorithmic predictions,…

Machine Learning · Statistics 2024-02-07 Xianli Zeng , Edgar Dobriban , Guang Cheng

Recent literature has seen a significant focus on building machine learning models with specific properties such as fairness, i.e., being non-biased with respect to a given set of attributes, calibration i.e., model confidence being aligned…

Machine Learning · Computer Science 2023-10-17 Anand Brahmbhatt , Vipul Rathore , Mausam , Parag Singla

To mitigate the bias exhibited by machine learning models, fairness criteria can be integrated into the training process to ensure fair treatment across all demographics, but it often comes at the expense of model performance. Understanding…

Machine Learning · Computer Science 2023-06-06 Ruicheng Xian , Lang Yin , Han Zhao

A popular methodology for building binary decision-making classifiers in the presence of imperfect information is to first construct a non-binary "scoring" classifier that is calibrated over all protected groups, and then to post-process…

Machine Learning · Computer Science 2019-01-23 Ran Canetti , Aloni Cohen , Nishanth Dikkala , Govind Ramnarayan , Sarah Scheffler , Adam Smith

The vast majority of statistical theory on binary classification characterizes performance in terms of accuracy. However, accuracy is known in many cases to poorly reflect the practical consequences of classification error, most famously in…

Statistics Theory · Mathematics 2022-09-27 Shashank Singh , Justin Khim

The machine learning community has become increasingly concerned with the potential for bias and discrimination in predictive models. This has motivated a growing line of work on what it means for a classification procedure to be "fair." In…

Machine Learning · Computer Science 2017-11-07 Geoff Pleiss , Manish Raghavan , Felix Wu , Jon Kleinberg , Kilian Q. Weinberger

In algorithmically fair prediction problems, a standard goal is to ensure the equality of fairness metrics across multiple overlapping groups simultaneously. We reconsider this standard fair classification problem using a probabilistic…

Machine Learning · Computer Science 2020-06-25 Forest Yang , Moustapha Cisse , Sanmi Koyejo

A set of probabilistic predictions is well calibrated if the events that are predicted to occur with probability p do in fact occur about p fraction of the time. Well calibrated predictions are particularly important when machine learning…

Machine Learning · Statistics 2014-01-14 Mahdi Pakdaman Naeini , Gregory F. Cooper , Milos Hauskrecht

We present a post-processing algorithm for fair classification that covers group fairness criteria including statistical parity, equal opportunity, and equalized odds under a single framework, and is applicable to multiclass problems in…

Machine Learning · Computer Science 2024-12-24 Ruicheng Xian , Han Zhao

Algorithmic fairness plays an increasingly critical role in machine learning research. Several group fairness notions and algorithms have been proposed. However, the fairness guarantee of existing fair classification methods mainly depends…

Machine Learning · Statistics 2025-03-13 Puheng Li , James Zou , Linjun Zhang
‹ Prev 1 2 3 10 Next ›