English
Related papers

Related papers: Unfair items detection in educational measurement

200 papers

With the growing adoption of machine learning (ML) systems in areas like law enforcement, criminal justice, finance, hiring, and admissions, it is increasingly critical to guarantee the fairness of decisions assisted by ML. In this paper,…

Machine Learning · Computer Science 2024-05-17 Meiyu Zhong , Ravi Tandon

The task of item recommendation requires ranking a large catalogue of items given a context. Item recommendation algorithms are evaluated using ranking metrics that depend on the positions of relevant items. To speed up the computation of…

Information Retrieval · Computer Science 2019-12-06 Steffen Rendle

It is well understood that classification algorithms, for example, for deciding on loan applications, cannot be evaluated for fairness without taking context into account. We examine what can be learned from a fairness oracle equipped with…

Machine Learning · Computer Science 2020-04-07 Cynthia Dwork , Christina Ilvento , Guy N. Rothblum , Pragya Sur

What does it mean for a machine learning model to be `fair', in terms which can be operationalised? Should fairness consist of ensuring everyone has an equal probability of obtaining some benefit, or should we aim instead to minimise the…

Computers and Society · Computer Science 2021-03-24 Reuben Binns

The seminal work of Dwork {\em et al.} [ITCS 2012] introduced a metric-based notion of individual fairness. Given a task-specific similarity metric, their notion required that every pair of similar individuals should be treated similarly.…

Machine Learning · Computer Science 2018-07-03 Guy N. Rothblum , Gal Yona

We study fairness in classification, where individuals are classified, e.g., admitted to a university, and the goal is to prevent discrimination against individuals based on their membership in some group, while maintaining utility for the…

Computational Complexity · Computer Science 2011-11-30 Cynthia Dwork , Moritz Hardt , Toniann Pitassi , Omer Reingold , Rich Zemel

We propose a new framework that unifies different fairness measures into a general, parameterized class of convex fairness measures suitable for optimization contexts. First, we propose a new class of order-based fairness measures, discuss…

Optimization and Control · Mathematics 2025-01-30 Man Yiu Tsang , Karmel S. Shehadeh

Fair machine learning works have been focusing on the development of equitable algorithms that address discrimination of certain groups. Yet, many of these fairness-aware approaches aim to obtain a unique solution to the problem, which…

Machine Learning · Computer Science 2021-12-14 Ana Valdivia , Javier Sánchez-Monedero , Jorge Casillas

We present a new approach for mitigating unfairness in learned classifiers. In particular, we focus on binary classification tasks over individuals from two populations, where, as our criterion for fairness, we wish to achieve similar false…

Machine Learning · Computer Science 2018-03-09 Yahav Bechavod , Katrina Ligett

Automated data-driven decision making systems are increasingly being used to assist, or even replace humans in many settings. These systems function by learning from historical decisions, often taken by humans. In order to maximize the…

Machine Learning · Statistics 2017-03-10 Muhammad Bilal Zafar , Isabel Valera , Manuel Gomez Rodriguez , Krishna P. Gummadi

In the allocation of resources to a set of agents, how do fairness guarantees impact the social welfare? A quantitative measure of this impact is the price of fairness, which measures the worst-case loss of social welfare due to fairness…

Computer Science and Game Theory · Computer Science 2020-11-03 Siddharth Barman , Umang Bhaskar , Nisarg Shah

A review of the main fairness definitions and fair learning methodologies proposed in the literature over the last years is presented from a mathematical point of view. Following our independence-based approach, we consider how to build…

Machine Learning · Statistics 2020-05-29 Eustasio del Barrio , Paula Gordaliza , Jean-Michel Loubes

Fairness in decision-making processes is often quantified using probabilistic metrics. However, these metrics may not fully capture the real-world consequences of unfairness. In this article, we adopt a utility-based approach to more…

Machine Learning · Computer Science 2024-06-19 Tolulope Fadina , Thorsten Schmidt

We consider a novel setting where a set of items are matched to the same set of agents repeatedly over multiple rounds. Each agent gets exactly one item per round, which brings interesting challenges to finding efficient and/or fair {\em…

Computer Science and Game Theory · Computer Science 2022-07-05 Ioannis Caragiannis , Shivika Narang

Individual fairness is an intuitive definition of algorithmic fairness that addresses some of the drawbacks of group fairness. Despite its benefits, it depends on a task specific fair metric that encodes our intuition of what is fair and…

Machine Learning · Statistics 2020-06-23 Debarghya Mukherjee , Mikhail Yurochkin , Moulinath Banerjee , Yuekai Sun

Algorithmic fairness is typically studied from the perspective of predictions. Instead, here we investigate fairness from the perspective of recourse actions suggested to individuals to remedy an unfavourable classification. We propose two…

Machine Learning · Computer Science 2022-03-08 Julius von Kügelgen , Amir-Hossein Karimi , Umang Bhatt , Isabel Valera , Adrian Weller , Bernhard Schölkopf

We consider the problem of fairly dividing a set of items. Much of the fair division literature assumes that the items are `goods' i.e., they yield positive utility for the agents. There is also some work where the items are `chores' that…

Computer Science and Game Theory · Computer Science 2021-03-18 Haris Aziz , Ioannis Caragiannis , Ayumi Igarashi , Toby Walsh

An increasing number of decisions regarding the daily lives of human beings are being controlled by artificial intelligence (AI) algorithms in spheres ranging from healthcare, transportation, and education to college admissions,…

Computers and Society · Computer Science 2020-01-28 Dana Pessach , Erez Shmueli

Cake-cutting is a playful name for the fair division of a heterogeneous, divisible good among agents, a well-studied problem at the intersection of mathematics, economics, and artificial intelligence. The cake-cutting literature is rich and…

Computer Science and Game Theory · Computer Science 2023-11-23 Peter Kern , Daniel Neugebauer , Jörg Rothe , René L. Schilling , Dietrich Stoyan , Robin Weishaupt

Group fairness metrics can detect when a deep learning model behaves differently for advantaged and disadvantaged groups, but even models that score well on these metrics can make blatantly unfair predictions. We present smooth prediction…

Machine Learning · Computer Science 2020-12-02 Ivoline C. Ngong , Krystal Maughan , Joseph P. Near