English
Related papers

Related papers: Offline Evaluation Measures of Fairness in Recomme…

200 papers

Fairness-aware classification is receiving increasing attention in the machine learning fields. Recently research proposes to formulate the fairness-aware classification as constrained optimization problems. However, several limitations…

Machine Learning · Computer Science 2018-09-14 Yongkai Wu , Lu Zhang , Xintao Wu

Conversational recommender systems have demonstrated great success. They can accurately capture a user's current detailed preference -- through a multi-round interaction cycle -- to effectively guide users to a more personalized…

Information Retrieval · Computer Science 2022-08-23 Allen Lin , Ziwei Zhu , Jianling Wang , James Caverlee

In the last decade, researchers have studied fairness as a software property. In particular, how to engineer fair software systems? This includes specifying, designing, and validating fairness properties. However, the landscape of works…

Software Engineering · Computer Science 2026-04-22 Ezekiel Soremekun , Mike Papadakis , Maxime Cordy , Yves Le Traon

Software systems are increasingly making decisions on behalf of humans, raising concerns about the fairness of such decisions. Such concerns are usually attributed to flaws in algorithmic design or biased data, but we argue that they are…

Software Engineering · Computer Science 2021-04-09 Ali Farahani , Liliana Pasquale , Amel Bennaceur , Thomas Welsh , Bashar Nuseibeh

Measurement professionals cannot come to an agreement on the definition of the term 'item fairness'. In this paper a continuous measure of item unfairness is proposed. The more the unfairness measure deviates from zero, the less fair the…

Artificial Intelligence · Computer Science 2020-10-06 Yefim Bakman

Impossibility results show that important fairness measures (independence, separation, sufficiency) cannot be satisfied at the same time under reasonable assumptions. This paper explores whether we can satisfy and/or improve these fairness…

Machine Learning · Computer Science 2022-03-21 Corinna Hertweck , Tim Räz

Fairness is a growing concern for high-risk decision-making using Artificial Intelligence (AI) but ensuring it through purely technical means is challenging: there is no universally accepted fairness measure, fairness is context-dependent,…

Artificial Intelligence · Computer Science 2024-10-07 Evdoxia Taka , Yuri Nakao , Ryosuke Sonoda , Takuya Yokota , Lin Luo , Simone Stumpf

We study critical systems that allocate scarce resources to satisfy basic needs, such as homeless services that provide housing. These systems often support communities disproportionately affected by systemic racial, gender, or other…

Computers and Society · Computer Science 2022-12-06 Nathanael Jo , Bill Tang , Kathryn Dullerud , Sina Aghaei , Eric Rice , Phebe Vayanos

Human lives are increasingly being affected by the outcomes of automated decision-making systems and it is essential for the latter to be, not only accurate, but also fair. The literature of algorithmic fairness has grown considerably over…

Machine Learning · Computer Science 2022-11-15 Ainhize Barrainkua , Paula Gordaliza , Jose A. Lozano , Novi Quadrianto

Software fairness testing is a central method for evaluating AI systems, yet the meaning of fairness is often treated as fixed and universally applicable. This vision paper positions fairness testing as culturally situated and examines the…

While algorithmic fairness is a thriving area of research, in practice, mitigating issues of bias often gets reduced to enforcing an arbitrarily chosen fairness metric, either by enforcing fairness constraints during the optimization step,…

Machine Learning · Computer Science 2023-10-02 Emily Black , Rakshit Naidu , Rayid Ghani , Kit T. Rodolfa , Daniel E. Ho , Hoda Heidari

Fairness is an important performance criterion in all resource allocation schemes, including those in distributed computer systems. However, it is often specified only qualitatively. The quantitative measures proposed in the literature are…

Networking and Internet Architecture · Computer Science 2007-05-23 R. Jain , D. Chiu , W. Hawe

This research seeks to benefit the software engineering society by proposing comparative separation, a novel group fairness notion to evaluate the fairness of machine learning software on comparative judgment test data. Fairness issues have…

Software Engineering · Computer Science 2026-01-13 Xiaoyin Xi , Neeku Capak , Kate Stockwell , Zhe Yu

Machine learning algorithms are now frequently used in sensitive contexts that substantially affect the course of human lives, such as credit lending or criminal justice. This is driven by the idea that `objective' machines base their…

Machine Learning · Computer Science 2019-01-17 Songül Tolan

As artificial intelligence plays an increasingly substantial role in decisions affecting humans and society, the accountability of automated decision systems has been receiving increasing attention from researchers and practitioners.…

Machine Learning · Computer Science 2023-07-04 Furkan Gursoy , Ioannis A. Kakadiaris

Many decision processes run for a long and unknown duration: in each round new requests arrive, an irrevocable choice must be made immediately, and the system is judged by ongoing fairness requirements. Examples include food banks…

Computer Science and Game Theory · Computer Science 2026-05-26 Ido Kahana , Erel Segal-Halevi , Noam Hazon

Fairness in recommender systems (RSs) is commonly categorised into group fairness and individual fairness. However, there is no established scientific understanding of the relationship between the two fairness types, as prior work on both…

Information Retrieval · Computer Science 2025-09-01 Theresia Veronika Rampisela , Maria Maistro , Tuukka Ruotsalo , Falk Scholer , Christina Lioma

Recommender systems are hedged with various requirements, such as ranking quality, optimisation efficiency, and item fairness. Item fairness is an emerging yet impending issue in practical systems. The notion of item fairness requires…

Information Retrieval · Computer Science 2022-11-22 Riku Togashi , Kenshi Abe

Fair machine learning works have been focusing on the development of equitable algorithms that address discrimination of certain groups. Yet, many of these fairness-aware approaches aim to obtain a unique solution to the problem, which…

Machine Learning · Computer Science 2021-12-14 Ana Valdivia , Javier Sánchez-Monedero , Jorge Casillas

A critical challenge in recommender systems is to establish reliable relationships between offline and online metrics that predict real-world performance. Motivated by recent advances in Pareto front approximation, we introduce a pragmatic…

Information Retrieval · Computer Science 2025-07-15 Timo Wilm , Philipp Normann