English
Related papers

Related papers: FAIR: Fairness-Aware Information Retrieval Evaluat…

200 papers

In the past few years, there has been much work on incorporating fairness requirements into algorithmic rankers, with contributions coming from the data management, algorithms, information retrieval, and recommender systems communities. In…

Information Retrieval · Computer Science 2022-08-15 Meike Zehlike , Ke Yang , Julia Stoyanovich

As one of the most pervasive applications of machine learning, recommender systems are playing an important role on assisting human decision making. The satisfaction of users and the interests of platforms are closely related to the quality…

Information Retrieval · Computer Science 2023-08-04 Yunqi Li , Hanxiong Chen , Shuyuan Xu , Yingqiang Ge , Juntao Tan , Shuchang Liu , Yongfeng Zhang

We study the problem of fair classification within the versatile framework of Dwork et al. [ITCS '12], which assumes the existence of a metric that measures similarity between pairs of individuals. Unlike earlier work, we do not assume that…

Machine Learning · Computer Science 2018-11-29 Michael P. Kim , Omer Reingold , Guy N. Rothblum

The prosperity and lifestyle of our society are very much governed by achievements in condensed matter physics, chemistry and materials science, because new products for sectors such as energy, the environment, health, mobility and…

Fairness-aware classification is receiving increasing attention in the machine learning fields. Recently research proposes to formulate the fairness-aware classification as constrained optimization problems. However, several limitations…

Machine Learning · Computer Science 2018-09-14 Yongkai Wu , Lu Zhang , Xintao Wu

Fairness is an important performance criterion in all resource allocation schemes, including those in distributed computer systems. However, it is often specified only qualitatively. The quantitative measures proposed in the literature are…

Networking and Internet Architecture · Computer Science 2007-05-23 R. Jain , D. Chiu , W. Hawe

With the rapid advancements of large language models (LLMs), information retrieval (IR) systems, such as search engines and recommender systems, have undergone a significant paradigm shift. This evolution, while heralding new opportunities,…

Information Retrieval · Computer Science 2024-08-22 Sunhao Dai , Chen Xu , Shicheng Xu , Liang Pang , Zhenhua Dong , Jun Xu

Ranked search results and recommendations have become the main mechanism by which we find content, products, places, and people online. With hiring, selecting, purchasing, and dating being increasingly mediated by algorithms, rankings may…

Information Retrieval · Computer Science 2020-04-24 Meike Zehlike , Tom Sühr , Carlos Castillo , Ivan Kitanovski

The explosive growth of data fuels data-driven research, facilitating progress across diverse domains. The FAIR principles emerge as a guiding standard, aiming to enhance the findability, accessibility, interoperability, and reusability of…

Computation and Language · Computer Science 2024-08-12 Tingyan Ma , Wei Liu , Bin Lu , Xiaoying Gan , Yunqiang Zhu , Luoyi Fu , Chenghu Zhou

In evaluation campaigns, participants often explore variations of popular, state-of-the-art baselines as a low-risk strategy to achieve competitive results. While effective, this can lead to local "hill climbing" rather than more radical…

Information Retrieval · Computer Science 2023-01-31 Mehmet Deniz Türkmen , Matthew Lease , Mucahid Kutlu

Individual user fairness is commonly understood as treating similar users similarly. In Recommender Systems (RSs), several evaluation measures exist for quantifying individual user fairness. These measures evaluate fairness via either: (i)…

Computers and Society · Computer Science 2026-02-04 Theresia Veronika Rampisela , Maria Maistro , Tuukka Ruotsalo , Christina Lioma

Algorithmic fairness for artificial intelligence has become increasingly relevant as these systems become more pervasive in society. One realm of AI, recommender systems, presents unique challenges for fairness due to trade offs between…

Information Retrieval · Computer Science 2020-04-21 Jessie Smith , Nasim Sonboli , Casey Fiesler , Robin Burke

Algorithmic decision systems are increasingly used in areas such as hiring, school admission, or loan approval. Typically, these systems rely on labeled data for training a classification model. However, in many scenarios, ground-truth…

Machine Learning · Computer Science 2021-07-19 Jakob Schoeffer , Niklas Kuehl , Isabel Valera

While search efficacy has been evaluated traditionally on the basis of result relevance, fairness of search has attracted recent attention. In this work, we define a notion of distributional fairness and provide a conceptual framework for…

Information Retrieval · Computer Science 2019-07-23 Anubrata Das , Matthew Lease

Recent works in recommendation systems have focused on diversity in recommendations as an important aspect of recommendation quality. In this work we argue that the post-processing algorithms aimed at only improving diversity among…

Computers and Society · Computer Science 2018-07-18 Jurek Leonhardt , Avishek Anand , Megha Khosla

Algorithmic decision making systems are ubiquitous across a wide variety of online as well as offline services. These systems rely on complex learning methods and vast amounts of data to optimize the service functionality, satisfaction of…

Machine Learning · Statistics 2017-03-27 Muhammad Bilal Zafar , Isabel Valera , Manuel Gomez Rodriguez , Krishna P. Gummadi

There has been a prevalence of applying AI software in both high-stakes public-sector and industrial contexts. However, the lack of transparency has raised concerns about whether these data-informed AI software decisions secure fairness…

Machine Learning · Computer Science 2025-11-17 Xiaoyin Xi , Zhe Yu

Users increasingly expect modern search systems to offer a unified interface that seamlessly retrieves information from diverse data sources and formats. However, current information retrieval (IR) evaluation benchmarks have not kept pace…

Information Retrieval · Computer Science 2026-05-13 Mehmet Deniz Türkmen , Suchana Datta , Dwaipayan Roy , Daniel Hienert , Philipp Mayr , Derek Greene

Result ranking often affects consumer satisfaction as well as the amount of exposure each item receives in the ranking services. Myopically maximizing customer satisfaction by ranking items only according to relevance will lead to unfair…

Information Retrieval · Computer Science 2023-10-18 Tao Yang , Zhichao Xu , Qingyao Ai

Recent trends within computational and data sciences show an increasing recognition and adoption of computational workflows as tools for productivity and reproducibility that also democratize access to platforms and processing know-how. As…