English
Related papers

Related papers: Measuring Fairness in Ranked Outputs

200 papers

Traditionally, recommender systems operate by returning a user a set of items, ranked in order of estimated relevance to that user. In recent years, methods relying on stochastic ordering have been developed to create "fairer" rankings that…

Information Retrieval · Computer Science 2022-09-13 Amanda Bower , Kristian Lum , Tomo Lazovich , Kyra Yee , Luca Belli

In the current landscape of ever-increasing levels of digitalization, we are facing major challenges pertaining to scalability. Recommender systems have become irreplaceable both for helping users navigate the increasing amounts of data…

Information Retrieval · Computer Science 2024-04-03 Bjørnar Vassøy , Helge Langseth

Rankings, especially those in search and recommendation systems, often determine how people access information and how information is exposed to people. Therefore, how to balance the relevance and fairness of information exposure is…

Information Retrieval · Computer Science 2021-02-22 Tao Yang , Qingyao Ai

With growing applications of Machine Learning (ML) techniques in the real world, it is highly important to ensure that these models work in an equitable manner. One main step in ensuring fairness is to effectively measure fairness, and to…

Machine Learning · Computer Science 2024-06-21 Abdalwahab Almajed , Maryam Tabar , Peyman Najafirad

Recommender systems are an essential tool to relieve the information overload challenge and play an important role in people's daily lives. Since recommendations involve allocations of social resources (e.g., job recommendation), an…

Information Retrieval · Computer Science 2022-07-12 Yifan Wang , Weizhi Ma , Min Zhang , Yiqun Liu , Shaoping Ma

Search and recommendation systems, such as search engines, recruiting tools, online marketplaces, news, and social media, output ranked lists of content, products, and sometimes, people. Credit ratings, standardized tests, risk assessments…

Information Retrieval · Computer Science 2021-02-19 Sruthi Gorantla , Amit Deshpande , Anand Louis

The issue of fairness in machine learning models has recently attracted a lot of attention as ensuring it will ensure continued confidence of the general public in the deployment of machine learning systems. We focus on mitigating the harm…

Machine Learning · Statistics 2021-02-24 Thomas Kehrenberg , Zexun Chen , Novi Quadrianto

We present a framework for quantifying and mitigating algorithmic bias in mechanisms designed for ranking individuals, typically used as part of web-scale search and recommendation systems. We first propose complementary measures to…

Information Retrieval · Computer Science 2019-09-04 Sahin Cem Geyik , Stuart Ambler , Krishnaram Kenthapadi

Fairness in AI-driven decision-making systems has become a critical concern, especially when these systems directly affect human lives. This paper explores the public's comprehension of fairness in healthcare recommendations. We conducted a…

Machine Learning · Computer Science 2024-09-10 Veronica Kecki , Alan Said

While conventional ranking systems focus solely on maximizing the utility of the ranked items to users, fairness-aware ranking systems additionally try to balance the exposure for different protected attributes such as gender or race. To…

Machine Learning · Computer Science 2021-12-14 Omid Memarrast , Ashkan Rezaei , Rizal Fathony , Brian Ziebart

We study fairness in collaborative-filtering recommender systems, which are sensitive to discrimination that exists in historical data. Biased data can lead collaborative filtering methods to make unfair predictions against minority groups…

Computers and Society · Computer Science 2017-12-15 Sirui Yao , Bert Huang

The way pages are ranked in search results influences whether the users of search engines are exposed to more homogeneous, or rather to more diverse viewpoints. However, this viewpoint diversity is not trivial to assess. In this paper we…

Information Retrieval · Computer Science 2021-07-06 Tim Draws , Nava Tintarev , Ujwal Gadiraju , Alessandro Bozzon , Benjamin Timmermans

We present a new data-driven model of fairness that, unlike existing static definitions of individual or group fairness is guided by the unfairness complaints received by the system. Our model supports multiple fairness criteria and takes…

Machine Learning · Computer Science 2020-08-24 Pranjal Awasthi , Corinna Cortes , Yishay Mansour , Mehryar Mohri

Recently, there has been a rising awareness that when machine learning (ML) algorithms are used to automate choices, they may treat/affect individuals unfairly, with legal, ethical, or economic consequences. Recommender systems are…

Information Retrieval · Computer Science 2022-04-19 Mohammadmehdi Naghiaei , Hossein A. Rahmani , Yashar Deldjoo

The treatment of fairness in decision-making literature usually involves quantifying fairness using objective measures. This work takes a critical stance to highlight the limitations of these approaches (group fairness and individual…

Computers and Society · Computer Science 2024-07-03 Sarra Tajouri , Alexis Tsoukiàs

Equity of educational outcome and fairness of AI with respect to race have been topics of increasing importance in education. In this work, we address both with empirical evaluations of grade prediction in higher education, an important…

Computers and Society · Computer Science 2021-05-17 Weijie Jiang , Zachary A. Pardos

Fairness concerns about algorithmic decision-making systems have been mainly focused on the outputs (e.g., the accuracy of a classifier across individuals or groups). However, one may additionally be concerned with fairness in the inputs.…

Machine Learning · Computer Science 2020-05-26 Bashir Rastegarpanah , Mark Crovella , Krishna P. Gummadi

Disparities in the societal harms and impacts of Generative AI (GenAI) systems highlight the critical need for effective unfairness measurement approaches. While numerous benchmarks exist, designing valid measurements requires proper…

Computers and Society · Computer Science 2025-07-08 Kimberly Le Truong , Annette Zimmermann , Hoda Heidari

Existing work on fairness typically focuses on making known machine learning algorithms fairer. Fair variants of classification, clustering, outlier detection and other styles of algorithms exist. However, an understudied area is the topic…

Artificial Intelligence · Computer Science 2022-09-27 Ian Davidson , S. S. Ravi

Algorithmic fairness has attracted significant attention in the past years. Surprisingly, there is little work on fairness in networks. In this work, we consider fairness for link analysis algorithms and in particular for the celebrated…

Social and Information Networks · Computer Science 2021-03-25 Sotiris Tsioutsiouliklis , Evaggelia Pitoura , Panayiotis Tsaparas , Ilias Kleftakis , Nikos Mamoulis