English
Related papers

Related papers: FROC: Building Fair ROC from a Trained Classifier

200 papers

To mitigate the bias exhibited by machine learning models, fairness criteria can be integrated into the training process to ensure fair treatment across all demographics, but it often comes at the expense of model performance. Understanding…

Machine Learning · Computer Science 2023-06-06 Ruicheng Xian , Lang Yin , Han Zhao

This work examines how to train fair classifiers in settings where training labels are corrupted with random noise, and where the error rates of corruption depend both on the label class and on the membership function for a protected…

Machine Learning · Computer Science 2021-02-18 Jialu Wang , Yang Liu , Caleb Levy

Standard approaches to group-based notions of fairness, such as \emph{parity} and \emph{equalized odds}, try to equalize absolute measures of performance across known groups (based on race, gender, etc.). Consequently, a group that is…

Machine Learning · Computer Science 2021-02-25 Anilesh K. Krishnaswamy , Zhihao Jiang , Kangning Wang , Yu Cheng , Kamesh Munagala

In this work, we investigate binary classification under the constraints of both differential privacy and fairness. We first propose an algorithm based on the decoupling technique for learning a classifier with only fairness guarantee. This…

Machine Learning · Computer Science 2024-05-21 Hrad Ghoukasian , Shahab Asoodeh

We consider the problem of whether a given decision model, working with structured data, has individual fairness. Following the work of Dwork, a model is individually biased (or unfair) if there is a pair of valid inputs which are close to…

Machine Learning · Computer Science 2020-06-23 Philips George John , Deepak Vijaykeerthy , Diptikalyan Saha

In analysis of binary outcomes, the receiver operator characteristic (ROC) curve is heavily used to show the performance of a model or algorithm. The ROC curve is informative about the performance over a series of thresholds and can be…

Computation · Statistics 2020-08-10 John Muschelli

We present a systematic approach for achieving fairness in a binary classification setting. While we focus on two well-known quantitative definitions of fairness, our approach encompasses many other previously studied definitions as special…

Machine Learning · Computer Science 2018-07-17 Alekh Agarwal , Alina Beygelzimer , Miroslav Dudík , John Langford , Hanna Wallach

Group fairness, a class of fairness notions that measure how different groups of individuals are treated differently according to their protected attributes, has been shown to conflict with one another, often with a necessary cost in loss…

Machine Learning · Computer Science 2020-07-08 Joon Sik Kim , Jiahao Chen , Ameet Talwalkar

Many existing fairness criteria for machine learning involve equalizing some metric across protected groups such as race or gender. However, practitioners trying to audit or enforce such group-based criteria can easily face the problem of…

Machine Learning · Computer Science 2020-11-11 Serena Wang , Wenshuo Guo , Harikrishna Narasimhan , Andrew Cotter , Maya Gupta , Michael I. Jordan

Model fairness is an essential element for Trustworthy AI. While many techniques for model fairness have been proposed, most of them assume that the training and deployment data distributions are identical, which is often not true in…

Machine Learning · Computer Science 2023-02-07 Yuji Roh , Kangwook Lee , Steven Euijong Whang , Changho Suh

In algorithmically fair prediction problems, a standard goal is to ensure the equality of fairness metrics across multiple overlapping groups simultaneously. We reconsider this standard fair classification problem using a probabilistic…

Machine Learning · Computer Science 2020-06-25 Forest Yang , Moustapha Cisse , Sanmi Koyejo

The Receiver Operating Characteristic (ROC) is a well-established representation of the tradeoff between detection and false alarm probabilities in binary hypothesis testing. In many practical contexts ROC's are generated by thresholding a…

Statistics Theory · Mathematics 2020-12-16 Catherine Medlock , Alan Oppenheim

Effective machine learning models can automatically learn useful information from a large quantity of data and provide decisions in a high accuracy. These models may, however, lead to unfair predictions in certain sense among the population…

Machine Learning · Computer Science 2020-06-19 Mingliang Chen , Min Wu

Predictive models such as decision trees and neural networks may produce discrimination in their predictions. This paper proposes a method to post-process the predictions of a predictive model to make the processed predictions…

Artificial Intelligence · Computer Science 2018-11-06 Jixue Liu , Jiuyong Li , Lin Liu , Thuc Duy Le , Feiyue Ye , Gefei Li

In many situations, the choice of an adequate similarity measure or metric on the feature space dramatically determines the performance of machine learning methods. Building automatically such measures is the specific purpose of…

Machine Learning · Statistics 2020-02-24 Stéphan Clémençon , Robin Vogel

Receiver Operating Characteristic (ROC) and Precision-Recall (PR) curves are fundamental tools for evaluating machine learning classifiers, offering detailed insights into the trade-offs between true positive rate vs. false positive rate…

Machine Learning · Computer Science 2025-10-07 Xuefeng Xu , Graham Cormode

Machine learning actively impacts our everyday life in almost all endeavors and domains such as healthcare, finance, and energy. As our dependence on the machine learning increases, it is inevitable that these algorithms will be used to…

Machine Learning · Computer Science 2021-02-23 Ankit Kulshrestha , Ilya Safro

In this paper, we study the prediction of a real-valued target, such as a risk score or recidivism rate, while guaranteeing a quantitative notion of fairness with respect to a protected attribute such as gender or race. We call this class…

Machine Learning · Computer Science 2019-05-31 Alekh Agarwal , Miroslav Dudík , Zhiwei Steven Wu

Fair ranking problems arise in many decision-making processes that often necessitate a trade-off between accuracy and fairness. Many existing studies have proposed correction methods such as adding fairness constraints to a ranking model's…

Machine Learning · Computer Science 2022-04-26 Ryosuke Sonoda

Developing classification algorithms that are fair with respect to sensitive attributes of the data has become an important problem due to the growing deployment of classification algorithms in various social contexts. Several recent works…

Machine Learning · Computer Science 2020-04-16 L. Elisa Celis , Lingxiao Huang , Vijay Keswani , Nisheeth K. Vishnoi