English
Related papers

Related papers: Fair When Trained, Unfair When Deployed: Observabl…

200 papers

With the increase in adoption of machine learning tools by organizations risks of unfairness abound, especially when human decision processes in outcomes of socio-economic importance such as hiring, housing, lending, and admissions are…

Computers and Society · Computer Science 2020-09-11 Lily Morse , Mike H. M. Teodorescu , Yazeed Awwad , Gerald Kane

To ensure unbiased and ethical automated predictions, fairness must be a core principle in machine learning applications. Fairness in machine learning aims to mitigate biases present in the training data and model imperfections that could…

Machine Learning · Computer Science 2024-12-03 Jan Pablo Burgard , João Vitor Pamplona

Training datasets for machine learning often have some form of missingness. For example, to learn a model for deciding whom to give a loan, the available training data includes individuals who were given a loan in the past, but not those…

Machine Learning · Computer Science 2020-12-22 Naman Goel , Alfonso Amayuelas , Amit Deshpande , Amit Sharma

As more researchers have become aware of and passionate about algorithmic fairness, there has been an explosion in papers laying out new metrics, suggesting algorithms to address issues, and calling attention to issues in existing…

Machine Learning · Computer Science 2019-01-16 Alex Beutel , Jilin Chen , Tulsee Doshi , Hai Qian , Allison Woodruff , Christine Luu , Pierre Kreitmann , Jonathan Bischof , Ed H. Chi

Distribution shift is a common situation in machine learning tasks, where the data used for training a model is different from the data the model is applied to in the real world. This issue arises across multiple technical settings: from…

Machine Learning · Computer Science 2024-05-24 Nicolas Acevedo , Carmen Cortez , Chris Brooks , Rene Kizilcec , Renzhe Yu

Assessing the fairness of a decision making system with respect to a protected class, such as gender or race, is challenging when class membership labels are unavailable. Probabilistic models for predicting the protected class based on…

Applications · Statistics 2018-11-28 Jiahao Chen , Nathan Kallus , Xiaojie Mao , Geoffry Svacha , Madeleine Udell

We study fairness in decision-making when the data may encode systematic bias. Existing approaches typically impose fairness constraints while predicting the observed decision, which may itself be unfair. We propose a novel framework for…

Methodology · Statistics 2026-03-31 Ping Zhang , Naiwen Ying , Wang Miao

In order to build reliable and trustworthy NLP applications, models need to be both fair across different demographics and explainable. Usually these two objectives, fairness and explainability, are optimized and/or examined independently…

Computation and Language · Computer Science 2023-11-14 Stephanie Brandl , Emanuele Bugliarello , Ilias Chalkidis

In recent years, machine learning techniques have been increasingly applied in sensitive decision making processes, raising fairness concerns. Past research has shown that machine learning may reproduce and even exacerbate human bias due to…

Machine Learning · Computer Science 2019-05-16 Benjamin Paaßen , Astrid Bunge , Carolin Hainke , Leon Sindelar , Matthias Vogelsang

Long-term fairness algorithms aim to satisfy fairness beyond static and short-term notions by accounting for the dynamics between decision-making policies and population behavior. Most previous approaches evaluate performance and fairness…

Machine Learning · Computer Science 2026-05-22 Giovani Valdrighi , Isabel Valera , Marcos Medeiros Raimundo

Traditional approaches to learning fair machine learning models often require rebuilding models from scratch, typically without considering potentially existing models. In a context where models need to be retrained frequently, this can…

Machine Learning · Computer Science 2025-07-22 Federico Di Gennaro , Thibault Laugel , Vincent Grari , Marcin Detyniecki

Recent interest in the external validity of prediction models (i.e., the problem of different train and test distributions, known as dataset shift) has produced many methods for finding predictive distributions that are invariant to dataset…

Machine Learning · Statistics 2022-07-20 Adarsh Subbaswamy , Bryant Chen , Suchi Saria

Fairness in machine learning has predominantly been studied in static classification settings without concern for how decisions change the underlying population over time. Conventional wisdom suggests that fairness criteria promote the…

Machine Learning · Computer Science 2018-08-10 Lydia T. Liu , Sarah Dean , Esther Rolf , Max Simchowitz , Moritz Hardt

With the growing awareness to fairness in machine learning and the realization of the central role that data representation has in data processing tasks, there is an obvious interest in notions of fair data representations. The goal of such…

Machine Learning · Computer Science 2021-07-09 Tosca Lechner , Shai Ben-David , Sushant Agarwal , Nivasini Ananthakrishnan

We propose a distributionally robust logistic regression model with an unfairness penalty that prevents discrimination with respect to sensitive attributes such as gender or ethnicity. This model is equivalent to a tractable convex…

Machine Learning · Computer Science 2020-07-21 Bahar Taskesen , Viet Anh Nguyen , Daniel Kuhn , Jose Blanchet

We introduce a fine-grained framework for uncertainty quantification of predictive models under distributional shifts. This framework distinguishes the shift in covariate distributions from that in the conditional relationship between the…

Methodology · Statistics 2025-05-20 Jiahao Ai , Zhimei Ren

As machine learning algorithms have been widely deployed across applications, many concerns have been raised over the fairness of their predictions, especially in high stakes settings (such as facial recognition and medical imaging). To…

Machine Learning · Computer Science 2021-02-16 Valeriia Cherepanova , Vedant Nanda , Micah Goldblum , John P. Dickerson , Tom Goldstein

Identifying the causes of a model's unfairness is an important yet relatively unexplored task. We look into this problem through the lens of training data - the major source of unfairness. We ask the following questions: How would the…

Machine Learning · Computer Science 2024-02-20 Yuanshun Yao , Yang Liu

Proposition. Let $f$ be a predictor trained on a distribution $P$ and evaluated on a shifted distribution $Q$. Under verifiable regularity and complexity constraints, the excess risk under shift admits an explicit upper bound determined by…

Machine Learning · Computer Science 2026-02-23 Chandrasekhar Gokavarapu , Sudhakar Gadde , Y. Rajasekhar , S. R. Bhargava

Fairness researchers in machine learning (ML) have coalesced around several fairness criteria which provide formal definitions of what it means for an ML model to be fair. However, these criteria have some serious limitations. We identify…

Machine Learning · Computer Science 2022-07-14 Liam Peet-Pare , Nidhi Hegde , Alona Fyshe