English
Related papers

Related papers: Why Is My Classifier Discriminatory?

200 papers

In this paper, we consider a theoretical model for injecting data bias, namely, under-representation and label bias (Blum & Stangl, 2019). We empirically study the effect of varying data biases on the accuracy and fairness of fair…

Machine Learning · Computer Science 2023-12-12 Mohit Sharma , Amit Deshpande , Rajiv Ratn Shah

In this paper, we present an empirical study on image recognition fairness, i.e., extreme class accuracy disparity on balanced data like ImageNet. We experimentally demonstrate that classes are not equal and the fairness issue is prevalent…

Machine Learning · Computer Science 2024-03-14 Jiequan Cui , Beier Zhu , Xin Wen , Xiaojuan Qi , Bei Yu , Hanwang Zhang

Recent work in fairness in machine learning has proposed adjusting for fairness by equalizing accuracy metrics across groups and has also studied how datasets affected by historical prejudices may lead to unfair decision policies. We…

Machine Learning · Statistics 2018-06-11 Nathan Kallus , Angela Zhou

Optimizing prediction accuracy can come at the expense of fairness. Towards minimizing discrimination against a group, fair machine learning algorithms strive to equalize the behavior of a model across different groups, by imposing a…

Machine Learning · Statistics 2020-06-17 Hongyan Chang , Ta Duy Nguyen , Sasi Kumar Murakonda , Ehsan Kazemi , Reza Shokri

Predictive algorithms are now used to help distribute a large share of our society's resources and sanctions, such as healthcare, loans, criminal detentions, and tax audits. Under the right circumstances, these algorithms can improve the…

Machine Learning · Computer Science 2023-02-21 Alex Chohlas-Wood , Madison Coots , Sharad Goel , Julian Nyarko

The digitalization of credit scoring has become essential for financial institutions and commercial banks, especially in the era of digital transformation. Machine learning techniques are commonly used to evaluate customers'…

Machine Learning · Computer Science 2026-03-06 Huyen Giang Thi Thu , Thang Viet Doan , Ha-Bang Ban , Tai Le Quy

Many popular algorithmic fairness measures depend on the joint distribution of predictions, outcomes, and a sensitive feature like race or gender. These measures are sensitive to distribution shift: a predictor which is trained to satisfy…

Machine Learning · Statistics 2022-02-11 Alan Mishler , Niccolò Dalmasso

Machine learning models often inherit biases from historical data, raising critical concerns about fairness and accountability. Conventional fairness interventions typically require access to sensitive attributes like gender or race, but…

Machine Learning · Statistics 2026-04-21 Yixiao Lin , James Booth

The use of algorithmic decision making systems in domains which impact the financial, social, and political well-being of people has created a demand for these decision making systems to be "fair" under some accepted notion of equity. This…

Multiagent Systems · Computer Science 2021-12-07 Andrew Estornell , Sanmay Das , Yang Liu , Yevgeniy Vorobeychik

Computers are increasingly used to make decisions that have significant impact in people's lives. Often, these predictions can affect different population subgroups disproportionately. As a result, the issue of fairness has received much…

Fairness emerged as an important requirement to guarantee that Machine Learning (ML) predictive systems do not discriminate against specific individuals or entire sub-populations, in particular, minorities. Given the inherent subjectivity…

Machine Learning · Computer Science 2022-06-08 Karima Makhlouf , Sami Zhioua , Catuscia Palamidessi

Understanding and removing bias from the decisions made by machine learning models is essential to avoid discrimination against unprivileged groups. Despite recent progress in algorithmic fairness, there is still no clear answer as to which…

How can we control for latent discrimination in predictive models? How can we provably remove it? Such questions are at the heart of algorithmic fairness and its impacts on society. In this paper, we define a new operational fairness…

Machine Learning · Computer Science 2019-02-25 Soheil Ghili , Ehsan Kazemi , Amin Karbasi

Fairness-aware learning involves designing algorithms that do not discriminate with respect to some sensitive feature (e.g., race or gender). Existing work on the problem operates under the assumption that the sensitive feature available in…

Machine Learning · Computer Science 2020-01-10 Alexandre Louis Lamy , Ziyuan Zhong , Aditya Krishna Menon , Nakul Verma

Causal machine learning methods which flexibly generate heterogeneous treatment effect estimates could be very useful tools for governments trying to make and implement policy. However, as the critical artificial intelligence literature has…

Econometrics · Economics 2023-09-06 Patrick Rehill , Nicholas Biddle

Our society collects data on people for a wide range of applications, from building a census for policy evaluation to running meaningful clinical trials. To collect data, we typically sample individuals with the goal of accurately…

Machine Learning · Computer Science 2024-07-02 Victor Borza , Andrew Estornell , Chien-Ju Ho , Bradley Malin , Yevgeniy Vorobeychik

Algorithmic fairness is typically studied from the perspective of predictions. Instead, here we investigate fairness from the perspective of recourse actions suggested to individuals to remedy an unfavourable classification. We propose two…

Machine Learning · Computer Science 2022-03-08 Julius von Kügelgen , Amir-Hossein Karimi , Umang Bhatt , Isabel Valera , Adrian Weller , Bernhard Schölkopf

The advent of powerful prediction algorithms led to increased automation of high-stake decisions regarding the allocation of scarce resources such as government spending and welfare support. This automation bears the risk of perpetuating…

Machine Learning · Statistics 2021-05-07 Matthias Kuppler , Christoph Kern , Ruben L. Bach , Frauke Kreuter

Failures of fairness or robustness in machine learning predictive settings can be due to undesired dependencies between covariates, outcomes and auxiliary factors of variation. A common strategy to mitigate these failures is data balancing,…

With the rapid growth in language processing applications, fairness has emerged as an important consideration in data-driven solutions. Although various fairness definitions have been explored in the recent literature, there is lack of…

Machine Learning · Computer Science 2022-03-17 Satyapriya Krishna , Rahul Gupta , Apurv Verma , Jwala Dhamala , Yada Pruksachatkun , Kai-Wei Chang