English
Related papers

Related papers: Comparing Fair Ranking Metrics

200 papers

Fairness in ranking models is crucial, as disparities in exposure can disproportionately affect protected groups. Most fairness-aware ranking systems focus on ensuring comparable average exposure for groups across the entire ranked list,…

Machine Learning · Computer Science 2025-09-23 Boyang Zhang , Quanqi Hu , Mingxuan Sun , Qihang Lin , Tianbao Yang

Information retrieval systems such as open web search and recommendation systems are ubiquitous and significantly impact how people receive and consume online information. Previous research has shown the importance of fairness in…

Information Retrieval · Computer Science 2025-03-28 Fumian Chen , Hui Fang

The evaluation of recommender system fairness has become increasingly important, especially with recent legislation that emphasises the development of fair and responsible artificial intelligence. This has led to the emergence of various…

Information Retrieval · Computer Science 2026-04-29 Theresia Veronika Rampisela

How can we build recommender systems to take into account fairness? Real-world recommender systems are often composed of multiple models, built by multiple teams. However, most research on fairness focuses on improving fairness in a single…

Machine Learning · Computer Science 2021-01-27 Xuezhi Wang , Nithum Thain , Anu Sinha , Flavien Prost , Ed H. Chi , Jilin Chen , Alex Beutel

Fairness of exposure is a commonly used notion of fairness for ranking systems. It is based on the idea that all items or item groups should get exposure proportional to the merit of the item or the collective merit of the items in the…

Information Retrieval · Computer Science 2022-05-26 Maria Heuss , Fatemeh Sarvi , Maarten de Rijke

People are rated and ranked, towards algorithmic decision making in an increasing number of applications, typically based on machine learning. Research on how to incorporate fairness into such tasks has prevalently pursued the paradigm of…

Machine Learning · Computer Science 2019-02-07 Preethi Lahoti , Krishna P. Gummadi , Gerhard Weikum

Though recommender systems are defined by personalization, recent work has shown the importance of additional, beyond-accuracy objectives, such as fairness. Because users often expect their recommendations to be purely personalized, these…

Information Retrieval · Computer Science 2021-03-17 Nasim Sonboli , Jessie J. Smith , Florencia Cabral Berenfus , Robin Burke , Casey Fiesler

We propose a test of fairness in score-based ranking systems called matched pair calibration. Our approach constructs a set of matched item pairs with minimal confounding differences between subgroups before computing an appropriate measure…

Despite the central role of retrieval in retrieval-augmented generation (RAG) systems, much of the existing research on RAG overlooks the well-established field of fair ranking and fails to account for the interests of all stakeholders…

Information Retrieval · Computer Science 2025-07-08 To Eun Kim , Fernando Diaz

For applications where multiple stakeholders provide recommendations, a fair consensus ranking must not only ensure that the preferences of rankers are well represented, but must also mitigate disadvantages among socio-demographic groups in…

Human-Computer Interaction · Computer Science 2023-08-14 Hilson Shrestha , Kathleen Cachel , Mallak Alkhathlan , Elke Rundensteiner , Lane Harrison

Recommender systems can be found everywhere today, shaping our everyday experience whenever we're consuming content, ordering food, buying groceries online, or even just reading the news. Let's imagine we're in the process of building a…

Information Retrieval · Computer Science 2025-07-17 Cécile Logé

Fairness is an important performance criterion in all resource allocation schemes, including those in distributed computer systems. However, it is often specified only qualitatively. The quantitative measures proposed in the literature are…

Networking and Internet Architecture · Computer Science 2007-05-23 R. Jain , D. Chiu , W. Hawe

Existing fair ranking systems, especially those designed to be demographically fair, assume that accurate demographic information about individuals is available to the ranking algorithm. In practice, however, this assumption may not hold --…

Information Retrieval · Computer Science 2026-02-09 Avijit Ghosh , Ritam Dutt , Christo Wilson

Algorithmic fairness has attracted significant attention in the past years. Surprisingly, there is little work on fairness in networks. In this work, we consider fairness for link analysis algorithms and in particular for the celebrated…

Social and Information Networks · Computer Science 2021-03-25 Sotiris Tsioutsiouliklis , Evaggelia Pitoura , Panayiotis Tsaparas , Ilias Kleftakis , Nikos Mamoulis

Users worldwide access massive amounts of curated data in the form of rankings on a daily basis. The societal impact of this ease of access has been studied and work has been done to propose and enforce various notions of fairness in…

Information Retrieval · Computer Science 2023-03-07 Jia Ao Sun , Sikha Pentyala , Martine De Cock , Golnoosh Farnadi

We address the critical issue of biased algorithms and unfair rankings, which have permeated various sectors, including search engines, recommendation systems, and workforce management. These biases can lead to discriminatory outcomes in a…

Computers and Society · Computer Science 2025-02-11 Chiara Criscuolo , Davide Martinenghi , Giuseppe Piccirillo

Recommendation systems are now an integral part of our daily lives. We rely on them for tasks such as discovering new movies, finding friends on social media, and connecting job seekers with relevant opportunities. Given their vital role,…

Artificial Intelligence · Computer Science 2025-02-26 Tahsin Alamgir Kheya , Mohamed Reda Bouadjenek , Sunil Aryal

Recent works in recommendation systems have focused on diversity in recommendations as an important aspect of recommendation quality. In this work we argue that the post-processing algorithms aimed at only improving diversity among…

Computers and Society · Computer Science 2018-07-18 Jurek Leonhardt , Avishek Anand , Megha Khosla

Existing commercial search engines often struggle to represent different perspectives of a search query. Argument retrieval systems address this limitation of search engines and provide both positive (PRO) and negative (CON) perspectives…

Information Retrieval · Computer Science 2021-09-21 Sachin Pathiyan Cherumanal , Damiano Spina , Falk Scholer , W. Bruce Croft

Recent work in recommender systems mainly focuses on fairness in recommendations as an important aspect of measuring recommendations quality. A fairness-aware recommender system aims to treat different user groups similarly. Relevant work…

Information Retrieval · Computer Science 2022-05-18 Hossein A. Rahmani , Mohammadmehdi Naghiaei , Mahdi Dehghan , Mohammad Aliannejadi