English
Related papers

Related papers: FlipTest: Fairness Testing via Optimal Transport

200 papers

Machine learning models in safety-critical settings like healthcare are often blackboxes: they contain a large number of parameters which are not transparent to users. Post-hoc explainability methods where a simple, human-interpretable…

Machine Learning · Computer Science 2022-06-03 Aparna Balagopalan , Haoran Zhang , Kimia Hamidieh , Thomas Hartvigsen , Frank Rudzicz , Marzyeh Ghassemi

Machine learning systems are increasingly being used to make impactful decisions such as loan applications and criminal justice risk assessments, and as such, ensuring fairness of these systems is critical. This is often challenging as the…

Machine Learning · Computer Science 2020-12-18 YooJung Choi , Meihua Dang , Guy Van den Broeck

We develop an algorithm to train individually fair learning-to-rank (LTR) models. The proposed approach ensures items from minority groups appear alongside similar items from majority groups. This notion of fair ranking is based on the…

Machine Learning · Statistics 2021-03-23 Amanda Bower , Hamid Eftekhari , Mikhail Yurochkin , Yuekai Sun

A central goal of algorithmic fairness is to reduce bias in automated decision making. An unavoidable tension exists between accuracy gains obtained by using sensitive information (e.g., gender or ethnic group) as part of a statistical…

Machine Learning · Statistics 2020-02-03 Luca Oneto , Michele Donini , Amon Elders , Massimiliano Pontil

Before deploying a black-box model in high-stakes problems, it is important to evaluate the model's performance on sensitive subpopulations. For example, in a recidivism prediction task, we may wish to identify demographic groups for which…

Methodology · Statistics 2023-06-09 John J. Cherian , Emmanuel J. Candès

Fairness holds a pivotal role in the realm of machine learning, particularly when it comes to addressing groups categorised by protected attributes, e.g., gender, race. Prevailing algorithms in fair learning predominantly hinge on…

Machine Learning · Computer Science 2024-11-11 Quan Zhou , Jakub Marecek

In the evolving field of machine learning, ensuring group fairness has become a critical concern, prompting the development of algorithms designed to mitigate bias in decision-making processes. Group fairness refers to the principle that a…

Machine Learning · Computer Science 2025-09-15 Teresa Salazar , João Gama , Helder Araújo , Pedro Henriques Abreu

To mitigate the effects of undesired biases in models, several approaches propose to pre-process the input dataset to reduce the risks of discrimination by preventing the inference of sensitive attributes. Unfortunately, most of these…

Machine Learning · Computer Science 2023-02-21 Sébastien Gambs , Rosin Claude Ngueveu

We propose a method to identify and characterize distribution shifts in classification datasets based on optimal transport. It allows the user to identify the extent to which each class is affected by the shift, and retrieves corresponding…

Machine Learning · Computer Science 2022-08-08 Neha Hulkund , Nicolo Fusi , Jennifer Wortman Vaughan , David Alvarez-Melis

Deep learning has achieved remarkable success in image classification and segmentation tasks. However, fairness concerns persist, as models often exhibit biases that disproportionately affect demographic groups defined by sensitive…

Computer Vision and Pattern Recognition · Computer Science 2024-11-20 Milad Masroor , Tahir Hassan , Yu Tian , Kevin Wells , David Rosewarne , Thanh-Toan Do , Gustavo Carneiro

Assessing the fairness of a decision making system with respect to a protected class, such as gender or race, is challenging when class membership labels are unavailable. Probabilistic models for predicting the protected class based on…

Applications · Statistics 2018-11-28 Jiahao Chen , Nathan Kallus , Xiaojie Mao , Geoffry Svacha , Madeleine Udell

We study fairness in classification, where individuals are classified, e.g., admitted to a university, and the goal is to prevent discrimination against individuals based on their membership in some group, while maintaining utility for the…

Computational Complexity · Computer Science 2011-11-30 Cynthia Dwork , Moritz Hardt , Toniann Pitassi , Omer Reingold , Rich Zemel

Machine learning models are central to people's lives and impact society in ways as fundamental as determining how people access information. The gravity of these models imparts a responsibility to model developers to ensure that they are…

Applications · Statistics 2020-07-13 Cyrus DiCiccio , Sriram Vasudevan , Kinjal Basu , Krishnaram Kenthapadi , Deepak Agarwal

Group fairness, a class of fairness notions that measure how different groups of individuals are treated differently according to their protected attributes, has been shown to conflict with one another, often with a necessary cost in loss…

Machine Learning · Computer Science 2020-07-08 Joon Sik Kim , Jiahao Chen , Ameet Talwalkar

Automated data-driven decision making systems are increasingly being used to assist, or even replace humans in many settings. These systems function by learning from historical decisions, often taken by humans. In order to maximize the…

Machine Learning · Statistics 2017-03-10 Muhammad Bilal Zafar , Isabel Valera , Manuel Gomez Rodriguez , Krishna P. Gummadi

In real world datasets, particular groups are under-represented, much rarer than others, and machine learning classifiers will often preform worse on under-represented populations. This problem is aggravated across many domains where…

Machine Learning · Computer Science 2023-02-10 Arghya Datta , S. Joshua Swamidass

We consider the problem of evaluating black-box multi-class classifiers. In the standard setup, we observe class labels $Y\in \{0,1,\ldots,M-1\}$ generated according to the conditional distribution $ Y|X \sim \text{…

Methodology · Statistics 2026-04-08 Yuchen Chen , Jing Lei

Ensuring fairness in matching algorithms is a key challenge in allocating scarce resources and positions. Focusing on Optimal Transport (OT), we introduce a novel notion of group fairness requiring that the probability of matching two…

Machine Learning · Statistics 2026-02-02 Linus Bleistein , Mathieu Dagréou , Francisco Andrade , Thomas Boudou , Aurélien Bellet

The evaluation of machine learning models typically relies mainly on performance metrics based on loss functions, which risk to overlook changes in performance in relevant subgroups. Auditing tools such as SliceFinder and SliceLine were…

Machine Learning · Computer Science 2026-04-22 Rudolf Debelak

We study fairness in social influence maximization, whereby one seeks to select seeds that spread a given information throughout a network, ensuring balanced outreach among different communities (e.g. demographic groups). In the literature,…

Social and Information Networks · Computer Science 2025-01-31 Shubham Chowdhary , Giulia De Pasquale , Nicolas Lanzetti , Ana-Andreea Stoica , Florian Dorfler