English
Related papers

Related papers: Inter-Rater Reliability is Individual Fairness

200 papers

Counterfactual fairness requires that a person would have been classified in the same way by an AI or other algorithmic system if they had a different protected class, such as a different race or gender. This is an intuitive standard, as…

Machine Learning · Computer Science 2023-10-31 Jacy Reese Anthis , Victor Veitch

Deep learning has produced big advances in artificial intelligence, but trained neural networks often reflect and amplify bias in their training data, and thus produce unfair predictions. We propose a novel measure of individual fairness,…

Artificial Intelligence · Computer Science 2020-09-30 Krystal Maughan , Joseph P. Near

One of the many fairness definitions pursued in recent recommender system research targets mitigating demographic information encoded in model representations. Models optimized for this definition are typically evaluated on how well…

Information Retrieval · Computer Science 2026-03-26 Bjørnar Vassøy , Benjamin Kille , Helge Langseth

In multi-stakeholder recommender systems (RS), users and providers operate as two crucial and interdependent roles, whose interests must be well-balanced. Prior research, including our work BankFair, has demonstrated the importance of…

Information Retrieval · Computer Science 2025-04-22 Xiaopeng Ye , Chen Xu , Jun Xu , Xuyang Xie , Gang Wang , Zhenhua Dong

We study the fair division of a continuous resource, such as a land-estate or a time-interval, among pre-specified groups of agents, such as families. Each family is given a piece of the resource and this piece is used simultaneously by all…

Computer Science and Game Theory · Computer Science 2020-10-26 Erel Segal-Halevi , Shmuel Nitzan

Machine learning can impact people with legal or ethical consequences when it is used to automate decisions in areas such as insurance, lending, hiring, and predictive policing. In many of these scenarios, previous decisions have been made…

Machine Learning · Statistics 2018-03-09 Matt J. Kusner , Joshua R. Loftus , Chris Russell , Ricardo Silva

Group fairness metrics are an established way of assessing the fairness of prediction-based decision-making systems. However, these metrics are still insufficiently linked to philosophical theories, and their moral meaning is often unclear.…

Computers and Society · Computer Science 2023-05-03 Joachim Baumann , Corinna Hertweck , Michele Loi , Christoph Heitz

There is a growing body of work on learning from human feedback to align various aspects of machine learning systems with human values and preferences. We consider the setting of fairness in content moderation, in which human feedback is…

Machine Learning · Computer Science 2024-06-11 Emilia Agis Lerner , Florian E. Dorner , Elliott Ash , Naman Goel

Research on fairness in machine learning has been recently extended to recommender systems. One of the factors that may impact fairness is bias disparity, the degree to which a group's preferences on various item categories fail to be…

Information Retrieval · Computer Science 2019-08-05 Masoud Mansoury , Bamshad Mobasher , Robin Burke , Mykola Pechenizkiy

We study critical systems that allocate scarce resources to satisfy basic needs, such as homeless services that provide housing. These systems often support communities disproportionately affected by systemic racial, gender, or other…

Computers and Society · Computer Science 2022-12-06 Nathanael Jo , Bill Tang , Kathryn Dullerud , Sina Aghaei , Eric Rice , Phebe Vayanos

In this work, we consider the problem of intersectional group fairness in the classification setting, where the objective is to learn discrimination-free models in the presence of several intersecting sensitive groups. First, we illustrate…

Machine Learning · Computer Science 2023-11-09 Gaurav Maheshwari , Aurélien Bellet , Pascal Denis , Mikaela Keller

Previous research has shown how indirect reciprocity can promote cooperation through evolutionary game theoretic models. Most work in this field assumes a separation of time-scales: individuals' reputations equilibrate at a fast time scale…

Populations and Evolution · Quantitative Biology 2024-12-23 Bryce Morsky , Joshua B. Plotkin , Erol Akçay

Despite conflicting definitions and conceptions of fairness, AI fairness researchers broadly agree that fairness is context-specific. However, when faced with general-purpose AI, which by definition serves a range of contexts, how should we…

Computers and Society · Computer Science 2025-10-08 Vyoma Raman , Judy Hanwen Shen , Andy K. Zhang , Lindsey Gailmard , Rishi Bommasani , Daniel E. Ho , Angelina Wang

Algorithmic fairness in recommender systems requires close attention to the needs of a diverse set of stakeholders that may have competing interests. Previous work in this area has often been limited by fixed, single-objective definitions…

Information Retrieval · Computer Science 2024-10-08 Amanda Aird , Elena Štefancová , Cassidy All , Amy Voida , Martin Homola , Nicholas Mattei , Robin Burke

What does it mean for an algorithm to be fair? Different papers use different notions of algorithmic fairness, and although these appear internally consistent, they also seem mutually incompatible. We present a mathematical setting in which…

Computers and Society · Computer Science 2016-09-26 Sorelle A. Friedler , Carlos Scheidegger , Suresh Venkatasubramanian

Clustering is a fundamental problem in unsupervised machine learning, and fair variants of it have recently received significant attention due to its societal implications. In this work we introduce a novel definition of individual fairness…

Machine Learning · Computer Science 2022-02-15 Darshan Chakrabarti , John P. Dickerson , Seyed A. Esmaeili , Aravind Srinivasan , Leonidas Tsepenekas

There is increasing regulatory interest in whether machine learning algorithms deployed in consequential domains (e.g. in criminal justice) treat different demographic groups "fairly." However, there are several proposed notions of…

Theoretical Economics · Economics 2020-02-19 Christopher Jung , Sampath Kannan , Changhwa Lee , Mallesh M. Pai , Aaron Roth , Rakesh Vohra

We initiate the study of fairness for ordinal regression. We adapt two fairness notions previously considered in fair ranking and propose a strategy for training a predictor that is approximately fair according to either notion. Our…

Ranking plays a central role in connecting users and providers in Information Retrieval (IR) systems, making provider-side fairness an important challenge. While recent research has begun to address fairness in ranking, most existing…

Information Retrieval · Computer Science 2026-02-03 Yiteng Tu , Weihang Su , Shuguang Han , Yiqun Liu , Qingyao Ai

Fairness and privacy are two important concerns in social decision-making processes such as resource allocation. We study privacy in the fair allocation of indivisible resources using the well-established framework of differential privacy.…

Computer Science and Game Theory · Computer Science 2025-06-17 Pasin Manurangsi , Warut Suksompong