English
Related papers

Related papers: Multicalibrated Regression for Downstream Fairness

200 papers

To mitigate the bias exhibited by machine learning models, fairness criteria can be integrated into the training process to ensure fair treatment across all demographics, but it often comes at the expense of model performance. Understanding…

Machine Learning · Computer Science 2023-06-06 Ruicheng Xian , Lang Yin , Han Zhao

We establish a new model-agnostic optimization framework for out-of-distribution generalization via multicalibration, a criterion that ensures a predictor is calibrated across a family of overlapping groups. Multicalibration is shown to be…

Machine Learning · Computer Science 2024-06-04 Jiayun Wu , Jiashuo Liu , Peng Cui , Zhiwei Steven Wu

Despite achieving promising fairness-error trade-offs, in-processing mitigation techniques for group fairness cannot be employed in numerous practical applications with limited computation resources or no access to the training pipeline of…

Machine Learning · Computer Science 2024-06-21 Alexandru Tifrea , Preethi Lahoti , Ben Packer , Yoni Halpern , Ahmad Beirami , Flavien Prost

Loss minimization is a dominant paradigm in machine learning, where a predictor is trained to minimize some loss function that depends on an uncertain event (e.g., "will it rain tomorrow?''). Different loss functions imply different…

Machine Learning · Computer Science 2021-09-14 Parikshit Gopalan , Adam Tauman Kalai , Omer Reingold , Vatsal Sharan , Udi Wieder

The machine learning community has become increasingly concerned with the potential for bias and discrimination in predictive models. This has motivated a growing line of work on what it means for a classification procedure to be "fair." In…

Machine Learning · Computer Science 2017-11-07 Geoff Pleiss , Manish Raghavan , Felix Wu , Jon Kleinberg , Kilian Q. Weinberger

Previous post-processing bias mitigation algorithms on both group and individual fairness don't work on regression models and datasets with multi-class numerical labels. We propose a priority-based post-processing bias mitigation on both…

Artificial Intelligence · Computer Science 2021-02-02 Pranay Lohia

We consider the problem of producing fair probabilistic classifiers for multi-class classification tasks. We formulate this problem in terms of "projecting" a pre-trained (and potentially unfair) classifier onto the set of models that…

Machine Learning · Computer Science 2022-06-17 Wael Alghamdi , Hsiang Hsu , Haewon Jeong , Hao Wang , P. Winston Michalak , Shahab Asoodeh , Flavio P. Calmon

We propose a unified framework for fair regression tasks formulated as risk minimization problems subject to a demographic parity constraint. Unlike many existing approaches that are limited to specific loss functions or rely on challenging…

Methodology · Statistics 2026-01-16 Yongzhen Feng , Weiwei Wang , Raymond K. W. Wong , Xianyang Zhang

Multi-calibration is a powerful and evolving concept originating in the field of algorithmic fairness. For a predictor $f$ that estimates the outcome $y$ given covariates $x$, and for a function class $\mathcal{C}$, multi-calibration…

Machine Learning · Computer Science 2023-03-09 Zhun Deng , Cynthia Dwork , Linjun Zhang

Machine learning classifiers often produce probabilistic predictions that are critical for accurate and interpretable decision-making in various domains. The quality of these predictions is generally evaluated with proper losses, such as…

Machine Learning · Computer Science 2025-06-26 Eugène Berta , David Holzmüller , Michael I. Jordan , Francis Bach

Striking an optimal balance between predictive performance and fairness continues to be a fundamental challenge in machine learning. In this work, we propose a post-processing framework that facilitates fairness-aware prediction by…

Machine Learning · Computer Science 2026-03-20 Zhouting Zhao , Tin Lok James Ng

Federated Learning (FL) allows collaborative model training among distributed parties without pooling local datasets at a central server. However, the distributed nature of FL poses challenges in training fair federated learning models. The…

Machine Learning · Computer Science 2025-01-28 Yi Zhou , Naman Goel

Calibration ensures that predicted uncertainties align with observed uncertainties. While there is an extensive literature on recalibration methods for univariate probabilistic forecasts, work on calibration for multivariate forecasts is…

Methodology · Statistics 2026-04-02 Lucas Kock , G. S. Rodrigues , Scott A. Sisson , Nadja Klein , David J. Nott

We develop a novel bias mitigation framework with distribution-based fairness constraints suitable for producing demographically blind and explainable machine-learning models across a wide range of fairness levels. This is accomplished…

Machine Learning · Computer Science 2025-10-31 Ryan Franks , Alexey Miroshnikov , Konstandinos Kotsiopoulos

We are concerned with obtaining well-calibrated output distributions from regression models. Such distributions allow us to quantify the uncertainty that the model has regarding the predicted target value. We introduce the novel concept of…

Machine Learning · Statistics 2019-05-16 Hao Song , Tom Diethe , Meelis Kull , Peter Flach

Algorithmic fairness has become a central topic in machine learning, and mitigating disparities across different subpopulations has emerged as a rapidly growing research area. In this paper, we systematically study the classification of…

Machine Learning · Statistics 2025-05-15 Xiaoyu Hu , Gengyu Xue , Zhenhua Lin , Yi Yu

As machine learning models are increasingly deployed in high-stakes environments, ensuring both probabilistic reliability and prediction stability has become critical. This paper examines the interplay between classification calibration and…

Machine Learning · Computer Science 2026-03-17 Mustafa Cavus

In this paper, we introduce a novel post-processing algorithm that is both model-agnostic and does not require the sensitive attribute at test time. In addition, our algorithm is explicitly designed to enforce minimal changes between biased…

Machine Learning · Computer Science 2024-08-30 Federico Di Gennaro , Thibault Laugel , Vincent Grari , Xavier Renard , Marcin Detyniecki

Fairness in machine learning has received considerable attention. However, most studies on fair learning focus on either supervised learning or unsupervised learning. Very few consider semi-supervised settings. Yet, in reality, most machine…

Machine Learning · Computer Science 2020-09-15 Tao Zhang , Tianqing Zhu , Mengde Han , Jing Li , Wanlei Zhou , Philip S. Yu

Artificial intelligence nowadays plays an increasingly prominent role in our life since decisions that were once made by humans are now delegated to automated systems. A machine learning algorithm trained based on biased data, however,…

Machine Learning · Computer Science 2020-09-29 Chen Zhao , Changbin Li , Jincheng Li , Feng Chen