English
Related papers

Related papers: Optimizing Group-Fair Plackett-Luce Ranking Models…

200 papers

Post-processing in algorithmic fairness is a versatile approach for correcting bias in ML systems that are already used in production. The main appeal of post-processing is that it avoids expensive retraining. In this work, we propose…

Machine Learning · Statistics 2021-10-27 Felix Petersen , Debarghya Mukherjee , Yuekai Sun , Mikhail Yurochkin

Ranking systems are the key components of modern Information Retrieval (IR) applications, such as search engines and recommender systems. Besides the ranking relevance to users, the exposure fairness to item providers has also been…

Information Retrieval · Computer Science 2023-08-22 Tao Yang , Zhichao Xu , Zhenduo Wang , Qingyao Ai

There has been great interest in fairness in machine learning, especially in relation to classification problems. In ranking-related problems, such as in online advertising, recommender systems, and HR automation, much work on fairness…

Machine Learning · Computer Science 2025-04-21 Andrii Kliachkin , Eleni Psaroudaki , Jakub Marecek , Dimitris Fotakis

We study the probabilistic assignment of items to platforms that satisfies both group and individual fairness constraints. Each item belongs to specific groups and has a preference ordering over platforms. Each platform enforces group…

Artificial Intelligence · Computer Science 2024-05-13 Atasi Panda , Anand Louis , Prajakta Nimbhorkar

Settings such as lending and policing can be modeled by a centralized agent allocating a resource (loans or police officers) amongst several groups, in order to maximize some objective (loans given that are repaid or criminals that are…

Machine Learning · Computer Science 2018-11-16 Hadi Elzayn , Shahin Jabbari , Christopher Jung , Michael Kearns , Seth Neel , Aaron Roth , Zachary Schutzman

The issue of fairness in machine learning stems from the fact that historical data often displays biases against specific groups of people which have been underprivileged in the recent past, or still are. In this context, one of the…

Machine Learning · Computer Science 2022-01-19 Mattia Cerrato , Marius Köppel , Alexander Segner , Stefan Kramer

Large language models (LLMs) have been shown to be effective on tabular prediction tasks in the low-data regime, leveraging their internal knowledge and ability to learn from instructions and examples. However, LLMs can fail to generate…

In an attempt to make algorithms fair, the machine learning literature has largely focused on equalizing decisions, outcomes, or error rates across race or gender groups. To illustrate, consider a hypothetical government rideshare program…

Machine Learning · Computer Science 2024-02-14 Alex Chohlas-Wood , Madison Coots , Henry Zhu , Emma Brunskill , Sharad Goel

We propose a simple yet effective solution to tackle the often-competing goals of fairness and utility in classification tasks. While fairness ensures that the model's predictions are unbiased and do not discriminate against any particular…

Machine Learning · Computer Science 2023-08-16 Anique Tahir , Lu Cheng , Huan Liu

Ranking data arises in a wide variety of application areas but remains difficult to model, learn from, and predict. Datasets often exhibit multimodality, intransitivity, or incomplete rankings---particularly when generated by humans---yet…

Machine Learning · Computer Science 2019-01-29 Stephen Ragain , Johan Ugander

Recently, pre-trained language models such as BERT have been applied to document ranking for information retrieval, which first pre-train a general language model on an unlabeled large corpus and then conduct ranking-specific fine-tuning on…

Information Retrieval · Computer Science 2021-08-13 Lin Bo , Liang Pang , Gang Wang , Jun Xu , XiuQiang He , Ji-Rong Wen

This paper studies the problem of inferring a global preference based on the partial rankings provided by many users over different subsets of items according to the Plackett-Luce model. A question of particular interest is how to optimally…

Machine Learning · Statistics 2014-06-24 Bruce Hajek , Sewoong Oh , Jiaming Xu

Learning-to-Rank (LTR) models trained from implicit feedback (e.g. clicks) suffer from inherent biases. A well-known one is the position bias -- documents in top positions are more likely to receive clicks due in part to their position…

Information Retrieval · Computer Science 2020-07-21 Mucun Tian , Chun Guo , Vito Ostuni , Zhen Zhu

Click-based learning to rank (LTR) tackles the mismatch between click frequencies on items and their actual relevance. The approach of previous work has been to assume a model of click behavior and to subsequently introduce a method for…

Information Retrieval · Computer Science 2022-06-27 Harrie Oosterhuis

Recommendation algorithms typically build models based on historical user-item interactions (e.g., clicks, likes, or ratings) to provide a personalized ranked list of items. These interactions are often distributed unevenly over different…

Information Retrieval · Computer Science 2021-03-16 Ziwei Zhu , Jianling Wang , James Caverlee

Recent research has shown that seemingly fair machine learning models, when used to inform decisions that have an impact on peoples' lives or well-being (e.g., applications involving education, employment, and lending), can inadvertently…

Machine Learning · Computer Science 2022-08-26 Aline Weber , Blossom Metevier , Yuriy Brun , Philip S. Thomas , Bruno Castro da Silva

Traditional ranking systems are expected to sort items in the order of their relevance and thereby maximize their utility. In fair ranking, utility is complemented with fairness as an optimization goal. Recent work on fair ranking focuses…

Information Retrieval · Computer Science 2022-01-05 Fatemeh Sarvi , Maria Heuss , Mohammad Aliannejadi , Sebastian Schelter , Maarten de Rijke

In order to create machine learning systems that serve a variety of users well, it is vital to not only achieve high average performance but also ensure equitable outcomes across diverse groups. However, most machine learning methods are…

Machine Learning · Computer Science 2024-03-01 Atharva Kulkarni , Lucio Dery , Amrith Setlur , Aditi Raghunathan , Ameet Talwalkar , Graham Neubig

Bipartite ranking, which aims to learn a scoring function that ranks positive individuals higher than negative ones from labeled data, is widely adopted in various applications where sample prioritization is needed. Recently, there have…

Machine Learning · Computer Science 2021-06-08 Sen Cui , Weishen Pan , Changshui Zhang , Fei Wang

We consider a recently introduced framework in which fairness is measured by worst-case outcomes across groups, rather than by the more standard differences between group outcomes. In this framework we provide provably convergent…

Machine Learning · Computer Science 2021-03-09 Emily Diana , Wesley Gill , Michael Kearns , Krishnaram Kenthapadi , Aaron Roth