English
Related papers

Related papers: FAIR: Fairness-Aware Information Retrieval Evaluat…

200 papers

Search relevance plays a central role in web e-commerce. While large language models (LLMs) have shown significant results on relevance task, existing benchmarks lack sufficient complexity for comprehensive model assessment, resulting in an…

Information Retrieval · Computer Science 2026-02-24 Chenji Lu , Zhuo Chen , Hui Zhao , Zhenyi Wang , Pengjie Wang , Chuan Yu , Jian Xu

It is essential for the advancement of science that scientists and researchers share, reuse and reproduce workflows and protocols used by others. The FAIR principles are a set of guidelines that aim to maximize the value and usefulness of…

Machine Learning · Computer Science 2019-11-22 Remzi Celebi , Joao Rebelo Moreira , Ahmed A. Hassan , Sandeep Ayyar , Lars Ridder , Tobias Kuhn , Michel Dumontier

The search engine evaluation research has quite a lot metrics available to it. Only recently, the question of the significance of individual metrics started being raised, as these metrics' correlations to real-world user experiences or…

Information Retrieval · Computer Science 2013-02-12 Pavel Sirotkin

Fairness in recommendation has attracted increasing attention due to bias and discrimination possibly caused by traditional recommenders. In Interactive Recommender Systems (IRS), user preferences and the system's fairness status are…

Information Retrieval · Computer Science 2021-06-28 Weiwen Liu , Feng Liu , Ruiming Tang , Ben Liao , Guangyong Chen , Pheng Ann Heng

The FAIR principles are globally accepted guidelines for improved data management practices with the potential to align data spaces on a global scale. In practice, this is only marginally achieved through the different ways in which…

Databases · Computer Science 2025-05-15 Nicolas Blumenroehr , Philipp-Joachim Ost , Felix Kraus , Achim Streit

Today, AI is increasingly being used in many high-stakes decision-making applications in which fairness is an important concern. Already, there are many examples of AI being biased and making questionable and unfair decisions. The AI…

Artificial Intelligence · Computer Science 2020-02-06 Yunfeng Zhang , Rachel K. E. Bellamy , Kush R. Varshney

Recommendation systems play a crucial role in our daily lives by impacting user experience across various domains, including e-commerce, job advertisements, entertainment, etc. Given the vital role of such systems in our lives,…

Information Retrieval · Computer Science 2025-06-24 Tahsin Alamgir Kheya , Mohamed Reda Bouadjenek , Sunil Aryal

With the introduction of machine learning in high-stakes decision making, ensuring algorithmic fairness has become an increasingly important problem to solve. In response to this, many mathematical definitions of fairness have been…

Machine Learning · Computer Science 2024-06-04 Edward Small , Wei Shao , Zeliang Zhang , Peihan Liu , Jeffrey Chan , Kacper Sokol , Flora Salim

Recommender systems are an essential tool to relieve the information overload challenge and play an important role in people's daily lives. Since recommendations involve allocations of social resources (e.g., job recommendation), an…

Information Retrieval · Computer Science 2022-07-12 Yifan Wang , Weizhi Ma , Min Zhang , Yiqun Liu , Shaoping Ma

This paper presents fairlib, an open-source framework for assessing and improving classification fairness. It provides a systematic framework for quickly reproducing existing baseline models, developing new methods, evaluating models with…

Machine Learning · Computer Science 2022-05-05 Xudong Han , Aili Shen , Yitong Li , Lea Frermann , Timothy Baldwin , Trevor Cohn

In an era where AI-driven hiring is transforming recruitment practices, concerns about fairness and bias have become increasingly important. To explore these issues, we introduce a benchmark, FAIRE (Fairness Assessment In Resume…

Computation and Language · Computer Science 2025-04-03 Athena Wen , Tanush Patil , Ansh Saxena , Yicheng Fu , Sean O'Brien , Kevin Zhu

As a highly data-driven application, recommender systems could be affected by data bias, resulting in unfair results for different data groups, which could be a reason that affects the system performance. Therefore, it is important to…

Information Retrieval · Computer Science 2021-04-22 Yunqi Li , Hanxiong Chen , Zuohui Fu , Yingqiang Ge , Yongfeng Zhang

We study critical systems that allocate scarce resources to satisfy basic needs, such as homeless services that provide housing. These systems often support communities disproportionately affected by systemic racial, gender, or other…

Computers and Society · Computer Science 2022-12-06 Nathanael Jo , Bill Tang , Kathryn Dullerud , Sina Aghaei , Eric Rice , Phebe Vayanos

Algorithmic fairness has attracted significant attention in the past years. Surprisingly, there is little work on fairness in networks. In this work, we consider fairness for link analysis algorithms and in particular for the celebrated…

Social and Information Networks · Computer Science 2021-03-25 Sotiris Tsioutsiouliklis , Evaggelia Pitoura , Panayiotis Tsaparas , Ilias Kleftakis , Nikos Mamoulis

Multilingual information retrieval (MLIR) considers the problem of ranking documents in several languages for a query expressed in a language that may differ from any of those languages. Recent work has observed that approaches such as…

Information Retrieval · Computer Science 2024-05-03 Eugene Yang , Thomas Jänich , James Mayfield , Dawn Lawrie

Fairness-aware classification requires balancing performance and fairness, often intensified by intersectional biases. Conflicting fairness definitions further complicate the task, making it difficult to identify universally fair solutions.…

Machine Learning · Computer Science 2025-09-11 Swati Swati , Arjun Roy , Emmanouil Panagiotou , Eirini Ntoutsi

Information retrieval (IR) evaluation measures are cornerstones for determining the suitability and task performance efficiency of retrieval systems. Their metric and scale properties enable to compare one system against another to…

Information Retrieval · Computer Science 2024-01-23 Fernando Giner

Ranking and scoring are ubiquitous. We consider the setting in which an institution, called a ranker, evaluates a set of individuals based on demographic, behavioral or other characteristics. The final output is a ranking that represents…

Databases · Computer Science 2016-10-28 Ke Yang , Julia Stoyanovich

The issue of fairness in recommendation is becoming increasingly essential as Recommender Systems touch and influence more and more people in their daily lives. In fairness-aware recommendation, most of the existing algorithmic approaches…

Information Retrieval · Computer Science 2022-01-04 Yingqiang Ge , Xiaoting Zhao , Lucia Yu , Saurabh Paul , Diane Hu , Chu-Cheng Hsieh , Yongfeng Zhang

Fairness of recommender systems (RS) has attracted increasing attention recently. Based on the involved stakeholders, the fairness of RS can be divided into user fairness, item fairness, and two-sided fairness which considers both user and…

Information Retrieval · Computer Science 2024-02-16 Yifan Wang , Peijie Sun , Weizhi Ma , Min Zhang , Yuan Zhang , Peng Jiang , Shaoping Ma