English
Related papers

Related papers: Disparate Conditional Prediction in Multiclass Cla…

200 papers

Standard conformal prediction methods provide a marginal coverage guarantee, which means that for a random test point, the conformal prediction set contains the true label with a user-specified probability. In many classification problems,…

Discrimination via algorithmic decision making has received considerable attention. Prior work largely focuses on defining conditions for fairness, but does not define satisfactory measures of algorithmic unfairness. In this paper, we focus…

Since the rise of fair machine learning as a critical field of inquiry, many different notions on how to quantify and measure discrimination have been proposed in the literature. Some of these notions, however, were shown to be mutually…

Computers and Society · Computer Science 2023-12-25 Drago Plecko , Elias Bareinboim

Motivated by settings in which predictive models may be required to be non-discriminatory with respect to certain attributes (such as race), but even collecting the sensitive attribute may be forbidden or restricted, we initiate the study…

Machine Learning · Computer Science 2019-06-04 Matthew Jagielski , Michael Kearns , Jieming Mao , Alina Oprea , Aaron Roth , Saeed Sharifi-Malvajerdi , Jonathan Ullman

Applying standard machine learning approaches for classification can produce unequal results across different demographic groups. When then used in real-world settings, these inequities can have negative societal impacts. This has motivated…

Machine Learning · Computer Science 2022-01-13 Preston Putzel , Scott Lee

Nowadays fairness issues have raised great concerns in decision-making systems. Various fairness notions have been proposed to measure the degree to which an algorithm is unfair. In practice, there frequently exist a certain set of…

Machine Learning · Computer Science 2021-07-20 Renzhe Xu , Peng Cui , Kun Kuang , Bo Li , Linjun Zhou , Zheyan Shen , Wei Cui

We mathematically compare four competing definitions of group-level nondiscrimination: demographic parity, equalized odds, predictive parity, and calibration. Using the theoretical framework of Friedler et al., we study the properties of…

Machine Learning · Computer Science 2021-03-10 Samuel Yeom , Michael Carl Tschantz

Conformal Prediction is a framework that produces prediction intervals based on the output from a machine learning algorithm. In this paper we explore the case when training data is made up of multiple parts available in different sources…

Machine Learning · Statistics 2019-08-16 Ola Spjuth , Robin Carrión Brännström , Lars Carlsson , Niharika Gauraha

A multitude of classifiers can be trained on the same data to achieve similar performances during test time, while having learned significantly different classification patterns. This phenomenon, which we call prediction discrepancies, is…

Machine Learning · Computer Science 2024-08-01 Xavier Renard , Thibault Laugel , Marcin Detyniecki

Semi-supervised learning has emerged as an appealing strategy to train deep models with limited supervision. Most prior literature under this learning paradigm resorts to dual-based architectures, typically composed of a teacher-student…

Computer Vision and Pattern Recognition · Computer Science 2022-03-08 Martin Van Waerebeke , Gregory Lodygensky , Jose Dolz

Assessing the fairness of a decision making system with respect to a protected class, such as gender or race, is challenging when class membership labels are unavailable. Probabilistic models for predicting the protected class based on…

Applications · Statistics 2018-11-28 Jiahao Chen , Nathan Kallus , Xiaojie Mao , Geoffry Svacha , Madeleine Udell

Fair clustering under the disparate impact doctrine requires that population of each protected group should be approximately equal in every cluster. Previous work investigated a difficult-to-scale pre-processing step for $k$-center and…

Machine Learning · Computer Science 2019-01-30 Bokun Wang , Ian Davidson

Model Predictive Control (MPC) is effective at generating safe control strategies in constrained scenarios, at the cost of computational complexity. This is especially the case in robots that require high sampling rates and have limited…

We develop new classifiers under group fairness in the attribute-aware setting for binary classification with multiple group fairness constraints (e.g., demographic parity (DP), equalized odds (EO), and predictive parity (PP)). We propose a…

Machine Learning · Statistics 2025-10-01 Kevin Jiang , Edgar Dobriban

As AI-based systems increasingly impact many areas of our lives, auditing these systems for fairness is an increasingly high-stakes problem. Traditional group fairness metrics can miss discrimination against individuals and are difficult to…

Machine Learning · Computer Science 2022-02-10 Krystal Maughan , Ivoline C. Ngong , Joseph P. Near

Recent years have witnessed increasing concerns towards unfair decisions made by machine learning algorithms. To improve fairness in model decisions, various fairness notions have been proposed and many fairness-aware methods are developed.…

Machine Learning · Computer Science 2023-02-23 Tianci Liu , Haoyu Wang , Yaqing Wang , Xiaoqian Wang , Lu Su , Jing Gao

Policymakers often use recursive binary split rules to partition populations based on binary outcomes and target subpopulations whose probability of the binary event exceeds a threshold. We call such problems Latent Probability…

Machine Learning · Statistics 2025-10-03 Lei Bill Wang , Zhenbang Jiao , Fangyi Wang

Standard conformal prediction offers a marginal guarantee on coverage, but for prediction sets to be truly useful, they should ideally ensure coverage conditional on each test point. Unfortunately, it is impossible to achieve exact,…

Machine Learning · Computer Science 2025-02-11 Jivat Neet Kaur , Michael I. Jordan , Ahmed Alaa

We explore fairness from a statistical perspective by selectively utilizing either conditional distance covariance or distance covariance statistics as measures to assess the independence between predictions and sensitive attributes. We…

Machine Learning · Computer Science 2025-12-22 Ruifan Huang , Haixia Liu

Introduced as a notion of algorithmic fairness, multicalibration has proved to be a powerful and versatile concept with implications far beyond its original intent. This stringent notion -- that predictions be well-calibrated across a rich…

Machine Learning · Computer Science 2022-06-17 Parikshit Gopalan , Michael P. Kim , Mihir Singhal , Shengjia Zhao