English
Related papers

Related papers: Unintended Selection: Persistent Qualification Rat…

200 papers

Fairness-aware classification models have gained increasing attention in recent years as concerns grow on discrimination against some demographic groups. Most existing models require full knowledge of the sensitive features, which can be…

Machine Learning · Computer Science 2025-05-02 Kaiqi Jiang , Wenzhe Fan , Mao Li , Xinhua Zhang

We consider a setting where agents take action by following their role models in a social network, and study strategies for a social planner to help agents by revealing whether the role models are positive or negative. Specifically, agents…

Artificial Intelligence · Computer Science 2026-03-04 Avrim Blum , Keziah Naggita , Matthew R. Walter , Jingyan Wang

In this paper, we present an empirical study on image recognition fairness, i.e., extreme class accuracy disparity on balanced data like ImageNet. We experimentally demonstrate that classes are not equal and the fairness issue is prevalent…

Machine Learning · Computer Science 2024-03-14 Jiequan Cui , Beier Zhu , Xin Wen , Xiaojuan Qi , Bei Yu , Hanwang Zhang

Algorithmic predictions are inherently uncertain: even models with similar aggregate accuracy can produce different predictions for the same individual, raising concerns that high-stakes decisions may become sensitive to arbitrary modeling…

Human-Computer Interaction · Computer Science 2026-05-13 Hansol Lee , AJ Alvero , René F. Kizilcec , Thorsten Joachims

Quota-based fairness mechanisms like the so-called Rooney rule or four-fifths rule are used in selection problems such as hiring or college admission to reduce inequalities based on sensitive demographic attributes. These mechanisms are…

Computers and Society · Computer Science 2020-06-25 Vitalii Emelianov , Nicolas Gast , Krishna P. Gummadi , Patrick Loiseau

Machine Learning (ML) algorithms shape our lives. Banks use them to determine if we are good borrowers; IT companies delegate them recruitment decisions; police apply ML for crime-prediction, and judges base their verdicts on ML. However,…

Computer Science and Game Theory · Computer Science 2021-01-05 Omer Ben-Porat , Fedor Sandomirskiy , Moshe Tennenholtz

We initiate the study of the effects of non-transparency in decision rules on individuals' ability to improve in strategic learning settings. Inspired by real-life settings, such as loan approvals and college admissions, we remove the…

Computer Science and Game Theory · Computer Science 2022-02-11 Yahav Bechavod , Chara Podimata , Zhiwei Steven Wu , Juba Ziani

Implicit bias is the unconscious attribution of particular qualities (or lack thereof) to a member from a particular social group (e.g., defined by gender or race). Studies on implicit bias have shown that these unconscious stereotypes can…

Computers and Society · Computer Science 2020-01-27 L. Elisa Celis , Anay Mehrotra , Nisheeth K. Vishnoi

The study of fairness in intelligent decision systems has mostly ignored long-term influence on the underlying population. Yet fairness considerations (e.g. affirmative action) have often the implicit goal of achieving balance among groups…

Machine Learning · Computer Science 2020-03-02 Hussein Mozannar , Mesrob I. Ohannessian , Nathan Srebro

In the context of machine learning, disparate impact refers to a form of systematic discrimination whereby the output distribution of a model depends on the value of a sensitive attribute (e.g., race or gender). In this paper, we propose an…

Information Theory · Computer Science 2018-05-14 Hao Wang , Berk Ustun , Flavio P. Calmon

This work examines how to train fair classifiers in settings where training labels are corrupted with random noise, and where the error rates of corruption depend both on the label class and on the membership function for a protected…

Machine Learning · Computer Science 2021-02-18 Jialu Wang , Yang Liu , Caleb Levy

Although many fairness criteria have been proposed to ensure that machine learning algorithms do not exhibit or amplify our existing social biases, these algorithms are trained on datasets that can themselves be statistically biased. In…

Machine Learning · Computer Science 2023-05-04 Yiqiao Liao , Parinaz Naghizadeh

Algorithmic fairness in lending today relies on group fairness metrics for monitoring statistical parity across protected groups. This approach is vulnerable to subgroup discrimination by proxy, carrying significant risks of legal and…

Computers and Society · Computer Science 2020-12-03 Mark Weber , Mikhail Yurochkin , Sherif Botros , Vanio Markov

With AI systems widely applied to assist humans in decision-making processes such as talent hiring, school admission, and loan approval; there is an increasing need to ensure that the decisions made are fair. One major challenge for…

Machine Learning · Computer Science 2026-05-05 Zhe Yu , Xiaoyin Xi , Pranam Prakash Shetty

There is increasing regulatory interest in whether machine learning algorithms deployed in consequential domains (e.g. in criminal justice) treat different demographic groups "fairly." However, there are several proposed notions of…

Theoretical Economics · Economics 2020-02-19 Christopher Jung , Sampath Kannan , Changhwa Lee , Mallesh M. Pai , Aaron Roth , Rakesh Vohra

The machine learning community has become increasingly concerned with the potential for bias and discrimination in predictive models. This has motivated a growing line of work on what it means for a classification procedure to be "fair." In…

Machine Learning · Computer Science 2017-11-07 Geoff Pleiss , Manish Raghavan , Felix Wu , Jon Kleinberg , Kilian Q. Weinberger

This paper investigates the application of machine learning when training a credit decision model over real, publicly available data whilst accounting for "bias objectives". We use the term "bias objective" to describe the requirement that…

Machine Learning · Computer Science 2021-10-26 Nigel Kingsman

Research on fairness in machine learning has been recently extended to recommender systems. One of the factors that may impact fairness is bias disparity, the degree to which a group's preferences on various item categories fail to be…

Information Retrieval · Computer Science 2019-08-05 Masoud Mansoury , Bamshad Mobasher , Robin Burke , Mykola Pechenizkiy

We propose an analysis in fair learning that preserves the utility of the data while reducing prediction disparities under the criteria of group sufficiency. We focus on the scenario where the data contains multiple or even many subgroups,…

Machine Learning · Statistics 2022-11-30 Changjian Shui , Gezheng Xu , Qi Chen , Jiaqi Li , Charles Ling , Tal Arbel , Boyu Wang , Christian Gagné

Unequal representation of demographic groups in training data poses challenges to model generalisation across populations. Standard practice assumes that balancing subgroup representation optimises performance. However, recent empirical…

Machine Learning · Computer Science 2025-12-11 Anissa Alloula , Charles Jones , Zuzanna Wakefield-Skorniewska , Francesco Quinzan , Bartłomiej Papież