English
Related papers

Related papers: Measuring Fairness in Ranked Outputs

200 papers

Many studies have shown automatic speech processing (ASR) systems have unequal performance across speakergroups (SG's). However, the manner in which such studies arrive at this conclusion is inconsistent. To pave the wayfor more reliable…

Computation and Language · Computer Science 2026-05-12 Felix Herron , Ange Richard , François Portet , Alexandre Allauzen , Solange Rossato

Many machine learning systems make extensive use of large amounts of data regarding human behaviors. Several researchers have found various discriminatory practices related to the use of human-related machine learning systems, for example…

Machine Learning · Computer Science 2019-03-25 Elena Beretta , Antonio Santangelo , Bruno Lepri , Antonio Vetrò , Juan Carlos De Martin

Fairness is one of the most desirable societal principles in collective decision-making. It has been extensively studied in the past decades for its axiomatic properties and has received substantial attention from the multiagent systems…

Artificial Intelligence · Computer Science 2023-12-25 Hadi Hosseini

Fairness research in machine learning often centers on ensuring equitable performance of individual models. However, real-world recommendation systems are built on multiple models and even multiple stages, from candidate retrieval to…

Artificial Intelligence · Computer Science 2025-01-03 Brian Hsu , Cyrus DiCiccio , Natesh Sivasubramoniapillai , Hongseok Namkoong

Algorithmic fairness, and in particular the fairness of scoring and classification algorithms, has become a topic of increasing social concern and has recently witnessed an explosion of research in theoretical computer science, machine…

Machine Learning · Computer Science 2019-09-10 Cynthia Dwork , Christina Ilvento

It is widely accepted that biased data leads to biased and thus potentially unfair models. Therefore, several measures for bias in data and model predictions have been proposed, as well as bias mitigation techniques whose aim is to learn…

Machine Learning · Computer Science 2024-03-26 Marco Favier , Toon Calders , Sam Pinxteren , Jonathan Meyer

Traditional ranking systems are expected to sort items in the order of their relevance and thereby maximize their utility. In fair ranking, utility is complemented with fairness as an optimization goal. Recent work on fair ranking focuses…

Information Retrieval · Computer Science 2022-01-05 Fatemeh Sarvi , Maria Heuss , Mohammad Aliannejadi , Sebastian Schelter , Maarten de Rijke

What is a fair performance metric? We consider the choice of fairness metrics through the lens of metric elicitation -- a principled framework for selecting performance metrics that best reflect implicit preferences. The use of metric…

Machine Learning · Statistics 2020-11-04 Gaurush Hiranandani , Harikrishna Narasimhan , Oluwasanmi Koyejo

Fair consensus building combines the preferences of multiple rankers into a single consensus ranking, while ensuring any group defined by a protected attribute (such as race or gender) is not disadvantaged compared to other groups. Manually…

Human-Computer Interaction · Computer Science 2022-08-03 Hilson Shrestha , Kathleen Cachel , Mallak Alkhathlan , Elke Rundensteiner , Lane Harrison

As recommender systems are being designed and deployed for an increasing number of socially-consequential applications, it has become important to consider what properties of fairness these systems exhibit. There has been considerable…

Information Retrieval · Computer Science 2020-09-08 Nasim Sonboli , Robin Burke , Nicholas Mattei , Farzad Eskandanian , Tian Gao

Individual fairness, proposed by Dwork et al., is a fairness measure that is supposed to prevent the unfair treatment of individuals on the subgroup level, and to overcome the problem that group fairness measures are susceptible to…

Computers and Society · Computer Science 2023-11-06 Tim Räz

While data-driven predictive models are a strictly technological construct, they may operate within a social context in which benign engineering choices entail implicit, indirect and unexpected real-life consequences. Fairness of such…

Machine Learning · Computer Science 2024-07-11 Kacper Sokol , Meelis Kull , Jeffrey Chan , Flora Salim

Developing learning methods which do not discriminate subgroups in the population is a central goal of algorithmic fairness. One way to reach this goal is by modifying the data representation in order to meet certain fairness constraints.…

Machine Learning · Statistics 2020-02-03 Luca Oneto , Michele Donini , Andreas Maurer , Massimiliano Pontil

The use of machine learning to guide clinical decision making has the potential to worsen existing health disparities. Several recent works frame the problem as that of algorithmic fairness, a framework that has attracted considerable…

Machine Learning · Statistics 2021-06-16 Stephen R. Pfohl , Agata Foryciarz , Nigam H. Shah

Numerous algorithms have been produced for the fundamental problem of clustering under many different notions of fairness. Perhaps the most common family of notions currently studied is group fairness, in which proportional group…

Machine Learning · Computer Science 2023-06-06 Seyed A. Esmaeili , Sharmila Duppala , John P. Dickerson , Brian Brubach

Recent attempts to achieve fairness in predictive models focus on the balance between fairness and accuracy. In sensitive applications such as healthcare or criminal justice, this trade-off is often undesirable as any increase in prediction…

Machine Learning · Statistics 2018-12-12 Irene Chen , Fredrik D. Johansson , David Sontag

Fairness-aware learning aims to mitigate discrimination against specific protected social groups (e.g., those categorized by gender, ethnicity, age) while minimizing predictive performance loss. Despite efforts to improve fairness in…

Machine Learning · Computer Science 2025-05-02 Kewen Peng , Yicheng Yang , Hao Zhuo

Recommendation systems are now an integral part of our daily lives. We rely on them for tasks such as discovering new movies, finding friends on social media, and connecting job seekers with relevant opportunities. Given their vital role,…

Artificial Intelligence · Computer Science 2025-02-26 Tahsin Alamgir Kheya , Mohamed Reda Bouadjenek , Sunil Aryal

Machine Learning or Artificial Intelligence algorithms have gained considerable scrutiny in recent times owing to their propensity towards imitating and amplifying existing prejudices in society. This has led to a niche but growing body of…

Machine Learning · Computer Science 2022-05-06 Avijit Ghosh , Lea Genuit , Mary Reagan

The rise of algorithmic decision-making has spawned much research on fair machine learning (ML). Financial institutions use ML for building risk scorecards that support a range of credit-related decisions. Yet, the literature on fair ML in…

Machine Learning · Statistics 2022-06-20 Nikita Kozodoi , Johannes Jacob , Stefan Lessmann