English
Related papers

Related papers: Comparing Fair Ranking Metrics

200 papers

As one of the most pervasive applications of machine learning, recommender systems are playing an important role on assisting human decision making. The satisfaction of users and the interests of platforms are closely related to the quality…

Information Retrieval · Computer Science 2023-08-04 Yunqi Li , Hanxiong Chen , Shuyuan Xu , Yingqiang Ge , Juntao Tan , Shuchang Liu , Yongfeng Zhang

Rankings, especially those in search and recommendation systems, often determine how people access information and how information is exposed to people. Therefore, how to balance the relevance and fairness of information exposure is…

Information Retrieval · Computer Science 2021-02-22 Tao Yang , Qingyao Ai

Information retrieval (IR) systems often leverage query data to suggest relevant items to users. This introduces the possibility of unfairness if the query (i.e., input) and the resulting recommendations unintentionally correlate with…

Machine Learning · Statistics 2019-09-17 Rinat Khaziev , Bryce Casavant , Pearce Washabaugh , Amy A. Winecoff , Matthew Graham

Recommendation, information retrieval, and other information access systems pose unique challenges for investigating and applying the fairness and non-discrimination concepts that have been developed for studying other machine learning…

Information Retrieval · Computer Science 2022-07-14 Michael D. Ekstrand , Anubrata Das , Robin Burke , Fernando Diaz

Relevance and fairness are two major objectives of recommender systems (RSs). Recent work proposes measures of RS fairness that are either independent from relevance (fairness-only) or conditioned on relevance (joint measures). While…

Information Retrieval · Computer Science 2024-05-29 Theresia Veronika Rampisela , Tuukka Ruotsalo , Maria Maistro , Christina Lioma

Ranking is a fundamental operation in information access systems, to filter information and direct user attention towards items deemed most relevant to them. Due to position bias, items of similar relevance may receive significantly…

Computers and Society · Computer Science 2021-11-01 Giorgio Maria Di Nunzio , Alessandro Fabris , Gianmaria Silvello , Gian Antonio Susto

Recommender systems are effective tools for mitigating information overload and have seen extensive applications across various domains. However, the single focus on utility goals proves to be inadequate in addressing real-world concerns,…

Information Retrieval · Computer Science 2024-03-05 Yuying Zhao , Yu Wang , Yunchao Liu , Xueqi Cheng , Charu Aggarwal , Tyler Derr

Several recent works have highlighted how search and recommender systems exhibit bias along different dimensions. Counteracting this bias and bringing a certain amount of fairness in search is crucial to not only creating a more balanced…

Information Retrieval · Computer Science 2020-08-05 Sahil Verma , Ruoyuan Gao , Chirag Shah

In this work, we introduce a novel metric for auditing group fairness in ranked lists. Our approach offers two benefits compared to the state of the art. First, we offer a blueprint for modeling of user attention. Rather than assuming a…

Computers and Society · Computer Science 2019-05-14 Piotr Sapiezynski , Wesley Zeng , Ronald E. Robertson , Alan Mislove , Christo Wilson

Rankings on online platforms help their end-users find the relevant information -- people, news, media, and products -- quickly. Fair ranking tasks, which ask to rank a set of items to maximize utility subject to satisfying group-fairness…

Computers and Society · Computer Science 2023-06-22 Sruthi Gorantla , Anay Mehrotra , Amit Deshpande , Anand Louis

In recent years, recommendation and ranking systems have become increasingly popular on digital platforms. However, previous work has highlighted how personalized systems might lead to unintentional harms for users. Practitioners require…

Human-Computer Interaction · Computer Science 2022-09-12 Jessie J. Smith , Lex Beattie

Ranking is at the core of Information Retrieval. Classic ranking optimization studies often treat ranking as a sorting problem with the assumption that the best performance of ranking would be achieved if we rank items according to their…

Information Retrieval · Computer Science 2023-04-18 Qingyao Ai , Xuanhui Wang , Michael Bendersky

We study fairness in collaborative-filtering recommender systems, which are sensitive to discrimination that exists in historical data. Biased data can lead collaborative filtering methods to make unfair predictions against minority groups…

Computers and Society · Computer Science 2017-12-15 Sirui Yao , Bert Huang

Online platforms mediate access to opportunity: relevance-based rankings create and constrain options by allocating exposure to job openings and job candidates in hiring platforms, or sellers in a marketplace. In order to do so responsibly,…

Information Retrieval · Computer Science 2023-06-07 Aparna Balagopalan , Abigail Z. Jacobs , Asia Biega

Fairness in recommender systems (RSs) is commonly categorised into group fairness and individual fairness. However, there is no established scientific understanding of the relationship between the two fairness types, as prior work on both…

Information Retrieval · Computer Science 2025-09-01 Theresia Veronika Rampisela , Maria Maistro , Tuukka Ruotsalo , Falk Scholer , Christina Lioma

There has been significant research in the last five years on ensuring the providers of items in a recommender system are treated fairly, particularly in terms of the exposure the system provides to their work through its results. However,…

Information Retrieval · Computer Science 2023-09-20 Amifa Raj , Michael D. Ekstrand

Ranking algorithms are deployed widely to order a set of items in applications such as search engines, news feeds, and recommendation systems. Recent studies, however, have shown that, left unchecked, the output of ranking algorithms can…

Data Structures and Algorithms · Computer Science 2018-07-31 L. Elisa Celis , Damian Straszak , Nisheeth K. Vishnoi

Algorithmic decision systems are increasingly used in areas such as hiring, school admission, or loan approval. Typically, these systems rely on labeled data for training a classification model. However, in many scenarios, ground-truth…

Machine Learning · Computer Science 2021-07-19 Jakob Schoeffer , Niklas Kuehl , Isabel Valera

In the current landscape of ever-increasing levels of digitalization, we are facing major challenges pertaining to scalability. Recommender systems have become irreplaceable both for helping users navigate the increasing amounts of data…

Information Retrieval · Computer Science 2024-04-03 Bjørnar Vassøy , Helge Langseth

Machine learning-driven rankings, where individuals (or items) are ranked in response to a query, mediate search exposure or attention in a variety of safety-critical settings. Thus, it is important to ensure that such rankings are fair.…

Machine Learning · Computer Science 2025-02-18 Aparna Balagopalan , Kai Wang , Olawale Salaudeen , Asia Biega , Marzyeh Ghassemi