English
Related papers

Related papers: A statistical framework for fair predictive algori…

200 papers

Traditional approaches to ensure group fairness in algorithmic decision making aim to equalize ``total'' error rates for different subgroups in the population. In contrast, we argue that the fairness approaches should instead focus only on…

Machine Learning · Computer Science 2021-05-11 Junaid Ali , Preethi Lahoti , Krishna P. Gummadi

Currently, there is uncertainty surrounding the merits of open-source versus proprietary algorithm development. Though justification in favor of each exists, we argue that open-source algorithm development should be the standard in highly…

Applications · Statistics 2020-11-13 Philip D. Waggoner , Alec Macmillen

When using machine learning for automated prediction, it is important to account for fairness in the prediction. Fairness in machine learning aims to ensure that biases in the data and model inaccuracies do not lead to discriminatory…

Machine Learning · Computer Science 2024-12-10 Jan Pablo Burgard , João Vitor Pamplona

What does it mean for an algorithm to be biased? In U.S. law, unintentional bias is encoded via disparate impact, which occurs when a selection process has widely different outcomes for different groups, even as it appears to be neutral.…

Due to the recent cases of algorithmic bias in data-driven decision-making, machine learning methods are being put under the microscope in order to understand the root cause of these biases and how to correct them. Here, we consider a basic…

Machine Learning · Computer Science 2016-10-25 L. Elisa Celis , Amit Deshpande , Tarun Kathuria , Nisheeth K. Vishnoi

Systematic discriminatory biases present in our society influence the way data is collected and stored, the way variables are defined, and the way scientific findings are put into practice as policy. Automated decision procedures and…

Machine Learning · Computer Science 2019-05-29 Razieh Nabi , Daniel Malinsky , Ilya Shpitser

With the current ongoing debate about fairness, explainability and transparency of machine learning models, their application in high-impact clinical decision-making systems must be scrutinized. We consider a real-life example of risk…

Machine Learning · Computer Science 2020-11-13 Sandhya Tripathi , Bradley A. Fritz , Mohamed Abdelhack , Michael S. Avidan , Yixin Chen , Christopher R. King

An increasing number of decisions regarding the daily lives of human beings are being controlled by artificial intelligence (AI) algorithms in spheres ranging from healthcare, transportation, and education to college admissions,…

Computers and Society · Computer Science 2020-01-28 Dana Pessach , Erez Shmueli

Risk assessment tools are widely used around the country to inform decision making within the criminal justice system. Recently, considerable attention has been devoted to the question of whether such tools may suffer from racial bias. In…

Methodology · Statistics 2020-04-01 Riccardo Fogliato , Max G'Sell , Alexandra Chouldechova

In credit markets, screening algorithms aim to discriminate between good-type and bad-type borrowers. However, when doing so, they can also discriminate between individuals sharing a protected attribute (e.g. gender, age, racial origin) and…

Machine Learning · Statistics 2024-02-09 Christophe Hurlin , Christophe Pérignon , Sébastien Saurin

Machine learning models often make predictions based on biased features such as gender, race, and other social attributes, posing significant fairness risks, especially in societal applications, such as hiring, banking, and criminal…

Machine Learning · Computer Science 2024-08-28 Yi Zhang , Dongyuan Lu , Jitao Sang

There has been a prevalence of applying AI software in both high-stakes public-sector and industrial contexts. However, the lack of transparency has raised concerns about whether these data-informed AI software decisions secure fairness…

Machine Learning · Computer Science 2025-11-17 Xiaoyin Xi , Zhe Yu

Discussions of algorithmic bias tend to focus on examples where either the data or the people building the algorithms are biased. This gives the impression that clean data and good intentions could eliminate bias. The neutrality of the…

Computers and Society · Computer Science 2021-05-04 Catherine Stinson

Understanding and removing bias from the decisions made by machine learning models is essential to avoid discrimination against unprivileged groups. Despite recent progress in algorithmic fairness, there is still no clear answer as to which…

Non-discrimination is a recognized objective in algorithmic decision making. In this paper, we introduce a novel probabilistic formulation of data pre-processing for reducing discrimination. We propose a convex optimization for learning a…

Machine Learning · Statistics 2017-04-12 Flavio P. Calmon , Dennis Wei , Karthikeyan Natesan Ramamurthy , Kush R. Varshney

Using the concept of principal stratification from the causal inference literature, we introduce a new notion of fairness, called principal fairness, for human and algorithmic decision-making. The key idea is that one should not…

Computers and Society · Computer Science 2022-03-28 Kosuke Imai , Zhichao Jiang

Biases in existing datasets used to train algorithmic decision rules can raise ethical and economic concerns due to the resulting disparate treatment of different groups. We propose an algorithm for sequentially debiasing such datasets…

Machine Learning · Computer Science 2023-01-11 Yifan Yang , Yang Liu , Parinaz Naghizadeh

Why do biased predictions arise? What interventions can prevent them? We evaluate 8.2 million algorithmic predictions of math performance from $\approx$400 AI engineers, each of whom developed an algorithm under a randomly assigned…

General Economics · Economics 2020-12-07 Bo Cowgill , Fabrizio Dell'Acqua , Samuel Deng , Daniel Hsu , Nakul Verma , Augustin Chaintreau

Predictive parity (PP), also known as sufficiency, is a core definition of algorithmic fairness essentially stating that model outputs must have the same interpretation of expected outcomes regardless of group. Testing and satisfying PP is…

Methodology · Statistics 2023-06-01 Cyrus DiCiccio , Brian Hsu , YinYin Yu , Preetam Nandy , Kinjal Basu

Machine-learned systems are in widespread use for making decisions about humans, and it is important that they are fair, i.e., not biased against individuals based on sensitive attributes. We present a general framework of runtime…

Machine Learning · Computer Science 2025-07-08 Thomas A. Henzinger , Mahyar Karimi , Konstantin Kueffner , Kaushik Mallik