English
Related papers

Related papers: Paradoxes in Fair Computer-Aided Decision Making

200 papers

Automated decision systems (ADS) have become ubiquitous in many high-stakes domains. Those systems typically involve sophisticated yet opaque artificial intelligence (AI) techniques that seldom allow for full comprehension of their inner…

Human-Computer Interaction · Computer Science 2021-09-14 Jakob Schoeffer , Yvette Machowski , Niklas Kuehl

Risk assessment algorithms in criminal justice put people's lives at the discretion of a simple statistical tool. This thesis explores how algorithmic decision-making in criminal policy can exhibit feedback effects, where disadvantage…

Computers and Society · Computer Science 2020-05-28 Benjamin Laufer

Efforts to promote equitable public policy with algorithms appear to be fundamentally constrained by the "impossibility of fairness" (an incompatibility between mathematical definitions of fairness). This technical limitation raises a…

Computers and Society · Computer Science 2023-02-28 Ben Green

Algorithmic discrimination is a condition that arises when data-driven software unfairly treats users based on attributes like ethnicity, race, gender, sexual orientation, religion, age, disability, or other personal characteristics.…

Software Engineering · Computer Science 2024-01-18 Ramandeep Singh Dehal , Mehak Sharma , Ronnie de Souza Santos

The advent of powerful prediction algorithms led to increased automation of high-stake decisions regarding the allocation of scarce resources such as government spending and welfare support. This automation bears the risk of perpetuating…

Machine Learning · Statistics 2021-05-07 Matthias Kuppler , Christoph Kern , Ruben L. Bach , Frauke Kreuter

Machine learning based predictions are increasingly used in sensitive decision-making applications that directly affect our lives. This has led to extensive research into ensuring the fairness of classifiers. Beyond just fair…

Machine Learning · Computer Science 2025-11-19 Ainhize Barrainkua , Giovanni De Toni , Jose Antonio Lozano , Novi Quadrianto

This paper argues that the principal difference between decision aids and most other types of information systems is the greater reliance of decision aids on fallible algorithms--algorithms that sometimes generate incorrect advice. It is…

Artificial Intelligence · Computer Science 2013-04-08 Paul E. Lehner , Theresa M. Mullin , Marvin S. Cohen

With the rapid advancement of AI, there is a growing trend to integrate AI into decision-making processes. However, AI systems may exhibit biases that lead decision-makers to draw unfair conclusions. Notably, the COMPAS system used in the…

Computers and Society · Computer Science 2024-09-12 Chih-Cheng Rex Yuan , Bow-Yaw Wang

While there has been a flurry of research in algorithmic fairness, what is less recognized is that modern antidiscrimination law may prohibit the adoption of such techniques. We make three contributions. First, we discuss how such…

Computers and Society · Computer Science 2020-12-29 Daniel E. Ho , Alice Xiang

When an algorithm provides risk assessments, we typically think of them as helpful inputs to human decisions, such as when risk scores are presented to judges or doctors. However, a decision-maker may react not only to the information…

Machine Learning · Computer Science 2025-11-04 Bryce McLaughlin , Jann Spiess

Fairness concerns about algorithmic decision-making systems have been mainly focused on the outputs (e.g., the accuracy of a classifier across individuals or groups). However, one may additionally be concerned with fairness in the inputs.…

Machine Learning · Computer Science 2020-05-26 Bashir Rastegarpanah , Mark Crovella , Krishna P. Gummadi

Algorithmic fairness is typically studied from the perspective of predictions. Instead, here we investigate fairness from the perspective of recourse actions suggested to individuals to remedy an unfavourable classification. We propose two…

Machine Learning · Computer Science 2022-03-08 Julius von Kügelgen , Amir-Hossein Karimi , Umang Bhatt , Isabel Valera , Adrian Weller , Bernhard Schölkopf

As virtually all aspects of our lives are increasingly impacted by algorithmic decision making systems, it is incumbent upon us as a society to ensure such systems do not become instruments of unfair discrimination on the basis of gender,…

Machine Learning · Computer Science 2019-03-29 Aria Khademi , Sanghack Lee , David Foley , Vasant Honavar

AI systems increasingly support human decision-making. In many cases, despite the algorithm's superior performance, the final decision remains in human hands. For example, an AI may assist doctors in determining which diagnostic tests to…

Artificial Intelligence · Computer Science 2026-02-20 Gali Noti , Kate Donahue , Jon Kleinberg , Sigal Oren

In recent years, machine learning techniques have been increasingly applied in sensitive decision making processes, raising fairness concerns. Past research has shown that machine learning may reproduce and even exacerbate human bias due to…

Machine Learning · Computer Science 2019-05-16 Benjamin Paaßen , Astrid Bunge , Carolin Hainke , Leon Sindelar , Matthias Vogelsang

Despite rapid technological progress, effective human-machine cooperation remains a significant challenge. Humans tend to cooperate less with machines than with fellow humans, a phenomenon known as the machine penalty. Here, we show that…

Human-Computer Interaction · Computer Science 2025-05-29 Zhen Wang , Ruiqi Song , Chen Shen , Shiya Yin , Zhao Song , Balaraju Battu , Lei Shi , Danyang Jia , Talal Rahwan , Shuyue Hu

As algorithmic decision-making systems become more prevalent in society, ensuring the fairness of these systems is becoming increasingly important. Whilst there has been substantial research in building fair algorithmic decision-making…

Machine Learning · Computer Science 2023-10-30 Madeleine Waller , Odinaldo Rodrigues , Oana Cocarascu

Due to the importance of artificial intelligence (AI) in a variety of high-stakes decisions, such as loan approval, job hiring, and criminal bail, researchers in Explainable AI (XAI) have developed algorithms to provide users with recourse…

Computer Science and Game Theory · Computer Science 2023-01-31 Matthew Olckers , Toby Walsh

Many machine learning systems make extensive use of large amounts of data regarding human behaviors. Several researchers have found various discriminatory practices related to the use of human-related machine learning systems, for example…

Machine Learning · Computer Science 2019-03-25 Elena Beretta , Antonio Santangelo , Bruno Lepri , Antonio Vetrò , Juan Carlos De Martin

Data-driven predictive algorithms are widely used to automate and guide high-stake decision making such as bail and parole recommendation, medical resource distribution, and mortgage allocation. Nevertheless, harmful outcomes biased against…

Computers and Society · Computer Science 2022-06-03 Atoosa Kasirzadeh