English
Related papers

Related papers: Certifying and removing disparate impact

200 papers

Algorithmic decision making process now affects many aspects of our lives. Standard tools for machine learning, such as classification and regression, are subject to the bias in data, and thus direct application of such off-the-shelf tools…

Machine Learning · Statistics 2017-10-16 Junpei Komiyama , Hajime Shimao

With the widespread and pervasive use of Artificial Intelligence (AI) for automated decision-making systems, AI bias is becoming more apparent and problematic. One of its negative consequences is discrimination: the unfair, or unequal…

Computers and Society · Computer Science 2021-06-07 Xavier Ferrer , Tom van Nuenen , Jose M. Such , Mark Coté , Natalia Criado

Classification with abstention has gained a lot of attention in recent years as it allows to incorporate human decision-makers in the process. Yet, abstention can potentially amplify disparities and lead to discriminatory predictions. The…

Machine Learning · Statistics 2021-02-25 Nicolas Schreuder , Evgenii Chzhen

Abstaining classifiers have the option to refrain from providing a prediction for instances that are difficult to classify. The abstention mechanism is designed to trade off the classifier's performance on the accepted data while ensuring a…

Machine Learning · Computer Science 2025-04-15 Daphne Lenders , Andrea Pugnana , Roberto Pellungrini , Toon Calders , Dino Pedreschi , Fosca Giannotti

Machine learning algorithms that aid human decision-making may inadvertently discriminate against certain protected groups. We formalize direct discrimination as a direct causal effect of the protected attributes on the decisions, while…

Machine Learning · Computer Science 2023-04-24 Przemyslaw Grabowicz , Nicholas Perello , Aarshee Mishra

Understanding and removing bias from the decisions made by machine learning models is essential to avoid discrimination against unprivileged groups. Despite recent progress in algorithmic fairness, there is still no clear answer as to which…

Deep learning is increasingly being used in high-stake decision making applications that affect individual lives. However, deep learning models might exhibit algorithmic discrimination behaviors with respect to protected groups, potentially…

Machine Learning · Computer Science 2020-03-20 Mengnan Du , Fan Yang , Na Zou , Xia Hu

There has been rapidly growing interest in the use of algorithms in hiring, especially as a means to address or mitigate bias. Yet, to date, little is known about how these methods are used in practice. How are algorithmic assessments…

Computers and Society · Computer Science 2019-12-10 Manish Raghavan , Solon Barocas , Jon Kleinberg , Karen Levy

The debate around bias in AI systems is central to discussions on algorithmic fairness. However, the term bias often lacks a clear definition, despite frequently being contrasted with fairness, implying that an unbiased model is inherently…

Artificial Intelligence · Computer Science 2025-02-26 Chiara Lindloff , Ingo Siegert

We investigate the level of success a firm achieves depending on which of two common scoring algorithms is used to screen qualified applicants belonging to a disadvantaged group. Both algorithms are trained on data generated by a prejudiced…

Theoretical Economics · Economics 2023-07-18 David J. Jin

Datasets can be biased due to societal inequities, human biases, under-representation of minorities, etc. Our goal is to certify that models produced by a learning algorithm are pointwise-robust to potential dataset biases. This is a…

Machine Learning · Computer Science 2021-10-12 Anna P. Meyer , Aws Albarghouthi , Loris D'Antoni

With the increased use of machine learning systems for decision making, questions about the fairness properties of such systems start to take center stage. Most existing work on algorithmic fairness assume complete observation of features…

Machine Learning · Computer Science 2022-12-06 Nikil Roashan Selvam , Guy Van den Broeck , YooJung Choi

As algorithmic decision-making systems become more prevalent in society, ensuring the fairness of these systems is becoming increasingly important. Whilst there has been substantial research in building fair algorithmic decision-making…

Machine Learning · Computer Science 2023-10-30 Madeleine Waller , Odinaldo Rodrigues , Oana Cocarascu

Most approaches in algorithmic fairness constrain machine learning methods so the resulting predictions satisfy one of several intuitive notions of fairness. While this may help private companies comply with non-discrimination laws or avoid…

Machine Learning · Statistics 2018-06-08 Matt J. Kusner , Chris Russell , Joshua R. Loftus , Ricardo Silva

While data-driven predictive models are a strictly technological construct, they may operate within a social context in which benign engineering choices entail implicit, indirect and unexpected real-life consequences. Fairness of such…

Machine Learning · Computer Science 2024-07-11 Kacper Sokol , Meelis Kull , Jeffrey Chan , Flora Salim

Emerging scholarship suggests that the EU legal concept of direct discrimination - where a person is given different treatment on grounds of a protected characteristic - may apply to various algorithmic decision-making contexts. This has…

Artificial Intelligence · Computer Science 2024-04-23 Hilde Weerts , Aislinn Kelly-Lyth , Reuben Binns , Jeremias Adams-Prassl

Data-driven algorithms play a large role in decision making across a variety of industries. Increasingly, these algorithms are being used to make decisions that have significant ramifications for people's social and economic well-being,…

Machine Learning · Computer Science 2018-09-26 J. Henry Hinnefeld , Peter Cooman , Nat Mammo , Rupert Deese

Machine learning algorithms are increasingly used for consequential decision making regarding individuals based on their relevant features. Features that are relevant for accurate decisions may however lead to either explicit or implicit…

Machine Learning · Computer Science 2021-06-09 Sajad Khodadadian , Mohamed Nafea , AmirEmad Ghassami , Negar Kiyavash

As society transitions towards an AI-based decision-making infrastructure, an ever-increasing number of decisions once under control of humans are now delegated to automated systems. Even though such developments make various parts of…

Artificial Intelligence · Computer Science 2023-06-09 Drago Plecko , Elias Bareinboim

Algorithmic decision-making and similar types of artificial intelligence (AI) may lead to improvements in all sectors of society, but can also have discriminatory effects. While current non-discrimination law offers people some protection,…

Computers and Society · Computer Science 2025-09-12 Janneke Gerards , Frederik Zuiderveen Borgesius