English
Related papers

Related papers: Multiaccurate Proxies for Downstream Fairness

200 papers

Artificial intelligence (AI) systems in high-stakes domains raise concerns about proxy discrimination, unfairness, and explainability. Existing audits often fail to reveal why unfairness arises, particularly when rooted in structural bias.…

Artificial Intelligence · Computer Science 2025-11-25 Belona Sonna , Alban Grastien

Ensuring fairness in machine learning is a critical and challenging task, as biased data representations often lead to unfair predictions. To address this, we propose Deep Fair Learning, a framework that integrates nonlinear sufficient…

Machine Learning · Statistics 2025-04-10 Enze Shi , Linglong Kong , Bei Jiang

Public models offer predictions to a variety of downstream tasks and have played a crucial role in various AI applications, showcasing their proficiency in accurate predictions. However, the exclusive emphasis on prediction accuracy may not…

Machine Learning · Computer Science 2024-06-06 Yejia Liu , Jianyi Yang , Pengfei Li , Tongxin Li , Shaolei Ren

Machine learning algorithms often struggle to eliminate inherent data biases, particularly those arising from unreliable labels, which poses a significant challenge in ensuring fairness. Existing fairness techniques that address label bias…

Machine Learning · Computer Science 2024-12-17 Yixuan Zhang , Zhidong Li , Yang Wang , Fang Chen , Xuhui Fan , Feng Zhou

Fair machine learning aims to mitigate the biases of model predictions against certain subpopulations regarding sensitive attributes such as race and gender. Among the many existing fairness notions, counterfactual fairness measures the…

Machine Learning · Computer Science 2022-01-12 Jing Ma , Ruocheng Guo , Mengting Wan , Longqi Yang , Aidong Zhang , Jundong Li

When it is ethical and legal to use a sensitive attribute (such as gender or race) in machine learning systems, the question remains how to do so. We show that the naive application of machine learning algorithms using sensitive features…

Machine Learning · Computer Science 2017-07-21 Cynthia Dwork , Nicole Immorlica , Adam Tauman Kalai , Max Leiserson

A commonly accepted hypothesis is that models with higher accuracy on Imagenet perform better on other downstream tasks, leading to much research dedicated to optimizing Imagenet accuracy. Recently this hypothesis has been challenged by…

Computer Vision and Pattern Recognition · Computer Science 2022-04-21 Niv Nayman , Avram Golbert , Asaf Noy , Tan Ping , Lihi Zelnik-Manor

How can we control for latent discrimination in predictive models? How can we provably remove it? Such questions are at the heart of algorithmic fairness and its impacts on society. In this paper, we define a new operational fairness…

Machine Learning · Computer Science 2019-02-25 Soheil Ghili , Ehsan Kazemi , Amin Karbasi

Machine Learning (ML) decision-making algorithms are now widely used in predictive decision-making, for example, to determine who to admit and give a loan. Their wide usage and consequential effects on individuals led the ML community to…

Computers and Society · Computer Science 2022-05-03 Keziah Naggita , J. Ceasar Aguma

Deep learning has produced big advances in artificial intelligence, but trained neural networks often reflect and amplify bias in their training data, and thus produce unfair predictions. We propose a novel measure of individual fairness,…

Artificial Intelligence · Computer Science 2020-09-30 Krystal Maughan , Joseph P. Near

This paper is dedicated to a cautious learning methodology for predicting preferences between alternatives characterized by binary attributes (formally, each alternative is seen as a subset of attributes). By "cautious", we mean that the…

Artificial Intelligence · Computer Science 2022-06-16 Hugo Gilbert , Mohamed Ouaguenouni , Meltem Ozturk , Olivier Spanjaard

This work facilitates ensuring fairness of machine learning in the real world by decoupling fairness considerations in compound decisions. In particular, this work studies how fairness propagates through a compound decision-making…

Computers and Society · Computer Science 2017-07-04 Amanda Bower , Sarah N. Kitchen , Laura Niss , Martin J. Strauss , Alexander Vargas , Suresh Venkatasubramanian

In machine learning, training data often capture the behaviour of multiple subgroups of some underlying human population. This behaviour can often be modelled as observations of an unknown dynamical system with an unobserved state. When the…

Machine Learning · Computer Science 2023-05-17 Quan Zhou , Jakub Marecek , Robert N. Shorten

Fairness-aware learning aims at constructing classifiers that not only make accurate predictions, but also do not discriminate against specific groups. It is a fast-growing area of machine learning with far-reaching societal impact.…

Machine Learning · Computer Science 2023-01-12 Eugenia Iofinova , Nikola Konstantinov , Christoph H. Lampert

Representation learning is increasingly employed to generate representations that are predictive across multiple downstream tasks. The development of representation learning algorithms that provide strong fairness guarantees is thus…

Machine Learning · Computer Science 2023-10-25 Yuhong Luo , Austin Hoag , Philip S. Thomas

Naively trained AI models can be heavily biased. This can be particularly problematic when the biases involve legally or morally protected attributes such as ethnic background, age or gender. Existing solutions to this problem come at the…

Computer Vision and Pattern Recognition · Computer Science 2022-10-11 Nicholas Rosa , Tom Drummond , Mehrtash Harandi

We study the problem of collecting a cohort or set that is balanced with respect to sensitive groups when group membership is unavailable or prohibited from use at deployment time. Specifically, our deployment-time collection mechanism does…

Machine Learning · Computer Science 2024-06-19 Siqi Deng , Emily Diana , Michael Kearns , Aaron Roth

Fairness in machine learning seeks to mitigate model bias against individuals based on sensitive features such as sex or age, often caused by an uneven representation of the population in the training data due to selection bias. Notably,…

Machine Learning · Computer Science 2024-10-10 Yasin I. Tepeli , Joana P. Gonçalves

Fairness-aware classification models have gained increasing attention in recent years as concerns grow on discrimination against some demographic groups. Most existing models require full knowledge of the sensitive features, which can be…

Machine Learning · Computer Science 2025-05-02 Kaiqi Jiang , Wenzhe Fan , Mao Li , Xinhua Zhang

Machine learnt systems inherit biases against protected classes, historically disparaged groups, from training data. Usually, these biases are not explicit, they rely on subtle correlations discovered by training algorithms, and are…

Computers and Society · Computer Science 2018-03-22 Anupam Datta , Matt Fredrikson , Gihyuk Ko , Piotr Mardziel , Shayak Sen