English
Related papers

Related papers: It's COMPASlicated: The Messy Relationship between…

200 papers

Machine learning algorithms are increasingly used to make or support decisions in a wide range of settings. With such expansive use there is also growing concern about the fairness of such methods. Prior literature on algorithmic fairness…

Machine Learning · Computer Science 2023-04-17 Arindam Ray , Balaji Padmanabhan , Lina Bouayad

Automated decision systems are increasingly used for consequential decision making -- for a variety of reasons. These systems often rely on sophisticated yet opaque models, which do not (or hardly) allow for understanding how or why a given…

Artificial Intelligence · Computer Science 2021-03-09 Jakob Schoeffer , Yvette Machowski , Niklas Kuehl

There are several algorithms for measuring fairness of ML models. A fundamental assumption in these approaches is that the ground truth is fair or unbiased. In real-world datasets, however, the ground truth often contains data that is a…

Machine Learning · Computer Science 2023-11-02 Srinivasan H Sengamedu , Hien Pham

In our current society, secret algorithms make important decisions about individuals. There has been substantial discussion about whether these algorithms are unfair to groups of individuals. While noble, this pursuit is complex and…

Applications · Statistics 2020-04-20 Cynthia Rudin , Caroline Wang , Beau Coker

The fair-ranking problem, which asks to rank a given set of items to maximize utility subject to group fairness constraints, has received attention in the fairness, information retrieval, and machine learning literature. Recent works,…

Machine Learning · Computer Science 2022-12-01 Anay Mehrotra , Nisheeth K. Vishnoi

Libraries are increasingly relying on computational methods, including methods from Artificial Intelligence (AI). This increasing usage raises concerns about the risks of AI that are currently broadly discussed in scientific literature, the…

Computers and Society · Computer Science 2023-03-14 Bettina Berendt , Özgür Karadeniz , Sercan Kıyak , Stefan Mertens , Leen d'Haenens

The evaluation of fairness in machine learning systems has become a central concern in high-stakes applications, including biometric recognition, healthcare decision-making, and automated risk assessment. Existing approaches typically rely…

Machine Learning · Computer Science 2026-05-21 Khalid Adnan Alsayed

Machine Learning (ML) decision-making algorithms are now widely used in predictive decision-making, for example, to determine who to admit and give a loan. Their wide usage and consequential effects on individuals led the ML community to…

Computers and Society · Computer Science 2022-05-03 Keziah Naggita , J. Ceasar Aguma

AI-based systems are widely employed nowadays to make decisions that have far-reaching impacts on individuals and society. Their decisions might affect everyone, everywhere and anytime, entailing concerns about potential human rights…

Differences in data distributions between demographic groups, known as the problem of infra-marginality, complicate how people evaluate fairness in machine learning models. We present a user study with 85 participants in a hypothetical…

Human-Computer Interaction · Computer Science 2026-03-09 Schrasing Tong , Minseok Jung , Ilaria Liccardi , Lalana Kagal

With the growing adoption of AI and machine learning systems in real-world applications, ensuring their fairness has become increasingly critical. The majority of the work in algorithmic fairness focus on assessing and improving the…

Machine Learning · Computer Science 2025-11-12 Eunice Chan , Hanghang Tong

As AI-based systems increasingly impact many areas of our lives, auditing these systems for fairness is an increasingly high-stakes problem. Traditional group fairness metrics can miss discrimination against individuals and are difficult to…

Machine Learning · Computer Science 2022-02-10 Krystal Maughan , Ivoline C. Ngong , Joseph P. Near

Algorithmic decision-making systems are increasingly used throughout the public and private sectors to make important decisions or assist humans in making these decisions with real social consequences. While there has been substantial…

Human-Computer Interaction · Computer Science 2020-01-28 Ruotong Wang , F. Maxwell Harper , Haiyi Zhu

Algorithmic fairness is a new interdisciplinary field of study focused on how to measure whether a process, or algorithm, may unintentionally produce unfair outcomes, as well as whether or how the potential unfairness of such processes can…

Theoretical Economics · Economics 2022-08-18 John W. Patty , Elizabeth Maggie Penn

Risk Assessment Instruments (RAIs) are widely used to forecast adverse outcomes in domains such as healthcare and criminal justice. RAIs are commonly trained on observational data and are optimized to predict observable outcomes rather than…

Methodology · Statistics 2021-04-06 Alan Mishler , Niccolò Dalmasso

As automated decision making and decision assistance systems become common in everyday life, research on the prevention or mitigation of potential harms that arise from decisions made by these systems has proliferated. However, various…

Computers and Society · Computer Science 2023-01-18 Samer B. Nashed , Justin Svegliato , Su Lin Blodgett

In machine learning research, it is common to evaluate algorithms via their performance on standard benchmark datasets. While a growing body of work establishes guidelines for -- and levies criticisms at -- data and benchmarking practices…

Machine Learning · Computer Science 2024-11-01 Rachel Longjohn , Markelle Kelly , Sameer Singh , Padhraic Smyth

There has been a prevalence of applying AI software in both high-stakes public-sector and industrial contexts. However, the lack of transparency has raised concerns about whether these data-informed AI software decisions secure fairness…

Machine Learning · Computer Science 2025-11-17 Xiaoyin Xi , Zhe Yu

In the United States and elsewhere, risk assessment algorithms are being used to help inform criminal justice decision-makers. A common intent is to forecast an offender's ``future dangerousness.'' Such algorithms have been correctly…

Applications · Statistics 2022-08-10 Richard A. Berk , Arun Kumar Kuchibhotla , Eric Tchetgen Tchetgen

The increasing use of Artificial Intelligence (AI) in critical societal domains has amplified concerns about fairness, particularly regarding unequal treatment across sensitive attributes such as race, gender, and socioeconomic status.…

Machine Learning · Computer Science 2025-12-09 Munshi Mahbubur Rahman , Shimei Pan , James R. Foulds