English
Related papers

Related papers: How Much Freedom Does An Effectiveness Metric Real…

200 papers

We turn the definition of individual fairness on its head---rather than ascertaining the fairness of a model given a predetermined metric, we find a metric for a given model that satisfies individual fairness. This can facilitate the…

Machine Learning · Computer Science 2020-10-14 Samuel Yeom , Matt Fredrikson

Given two relations containing multiple measurements - possibly with uncertainties - our objective is to find which sets of attributes from the first have a corresponding set on the second, using exclusively a sample of the data. This…

Databases · Computer Science 2022-07-20 Alejandro Alvarez-Ayllon , Manuel Palomo-Duarte , Juan-Manuel Dodero

We consider the problem of allocating indivisible objects to agents when agents have strict preferences over objects. There are inherent trade-offs between competing notions of efficiency, fairness and incentives in assignment mechanisms.…

Theoretical Economics · Economics 2020-11-02 Priyanka Shende , Manish Purohit

Many set selection and ranking algorithms have recently been enhanced with diversity constraints that aim to explicitly increase representation of historically disadvantaged populations, or to improve the overall representativeness of the…

Artificial Intelligence · Computer Science 2019-06-06 Ke Yang , Vasilis Gkatzelis , Julia Stoyanovich

Pairwise comparisons are an important tool of modern (multiple criteria) decision making. Since human judgments are often inconsistent, many studies focused on the ways how to express and measure this inconsistency, and several…

Artificial Intelligence · Computer Science 2017-05-01 Jiri Mazurek

How can we build recommender systems to take into account fairness? Real-world recommender systems are often composed of multiple models, built by multiple teams. However, most research on fairness focuses on improving fairness in a single…

Machine Learning · Computer Science 2021-01-27 Xuezhi Wang , Nithum Thain , Anu Sinha , Flavien Prost , Ed H. Chi , Jilin Chen , Alex Beutel

Reciprocal recommender systems~(RRS), conducting bilateral recommendations between two involved parties, have gained increasing attention for enhancing matching efficiency. However, the majority of existing methods in the literature still…

Information Retrieval · Computer Science 2024-08-20 Chen Yang , Sunhao Dai , Yupeng Hou , Wayne Xin Zhao , Jun Xu , Yang Song , Hengshu Zhu

We consider the discrete assignment problem in which agents express ordinal preferences over objects and these objects are allocated to the agents in a fair manner. We use the stochastic dominance relation between fractional or randomized…

Computer Science and Game Theory · Computer Science 2015-06-18 Haris Aziz , Serge Gaspers , Simon Mackenzie , Toby Walsh

We consider sequential or active ranking of a set of n items based on noisy pairwise comparisons. Items are ranked according to the probability that a given item beats a randomly chosen item, and ranking refers to partitioning the items…

Machine Learning · Computer Science 2016-09-26 Reinhard Heckel , Nihar B. Shah , Kannan Ramchandran , Martin J. Wainwright

We study notions of fairness in decision-making systems when individuals have diverse preferences over the possible outcomes of the decisions. Our starting point is the seminal work of Dwork et al. which introduced a notion of individual…

Machine Learning · Computer Science 2019-09-12 Michael P. Kim , Aleksandra Korolova , Guy N. Rothblum , Gal Yona

Ranking and scoring are ubiquitous. We consider the setting in which an institution, called a ranker, evaluates a set of individuals based on demographic, behavioral or other characteristics. The final output is a ranking that represents…

Databases · Computer Science 2016-10-28 Ke Yang , Julia Stoyanovich

The rapid trend of deploying artificial intelligence (AI) and machine learning (ML) systems in socially consequential domains has raised growing concerns about their trustworthiness, including potential discriminatory behaviours. Research…

Machine Learning · Computer Science 2025-09-22 Yijun Bian , Lei You , Yuya Sasaki , Haruka Maeda , Akira Igarashi

As AI systems develop in complexity it is becoming increasingly hard to ensure non-discrimination on the basis of protected attributes such as gender, age, and race. Many recent methods have been developed for dealing with this issue as…

Machine Learning · Computer Science 2020-04-21 Yair Horesh , Noa Haas , Elhanan Mishraky , Yehezkel S. Resheff , Shir Meir Lador

Fairness in recommender systems (RSs) is commonly categorised into group fairness and individual fairness. However, there is no established scientific understanding of the relationship between the two fairness types, as prior work on both…

Information Retrieval · Computer Science 2025-09-01 Theresia Veronika Rampisela , Maria Maistro , Tuukka Ruotsalo , Falk Scholer , Christina Lioma

With the emerging needs of creating fairness-aware solutions for search and recommendation systems, a daunting challenge exists of evaluating such solutions. While many of the traditional information retrieval (IR) metrics can capture the…

Information Retrieval · Computer Science 2022-03-31 Ruoyuan Gao , Yingqiang Ge , Chirag Shah

Though competitive analysis has been a very useful performance measure for the quality of online algorithms, it is recognized that it sometimes fails to distinguish between algorithms of different quality in practice. A number of…

Data Structures and Algorithms · Computer Science 2015-03-19 Joan Boyar , Kim S. Larsen , Abyayananda Maiti

We explore fairness from a statistical perspective by selectively utilizing either conditional distance covariance or distance covariance statistics as measures to assess the independence between predictions and sensitive attributes. We…

Machine Learning · Computer Science 2025-12-22 Ruifan Huang , Haixia Liu

We consider the problem of whether a given decision model, working with structured data, has individual fairness. Following the work of Dwork, a model is individually biased (or unfair) if there is a pair of valid inputs which are close to…

Machine Learning · Computer Science 2020-06-23 Philips George John , Deepak Vijaykeerthy , Diptikalyan Saha

How should researchers analyze randomized experiments in which the main outcome is latent and measured in multiple ways but each measure contains some degree of error? We first identify a critical study-specific noncomparability problem in…

Econometrics · Economics 2026-01-13 Jiawei Fu , Donald P. Green

As learning machines increase their influence on decisions concerning human lives, analyzing their fairness properties becomes a subject of central importance. Yet, our best tools for measuring the fairness of learning systems are rigid…

Machine Learning · Statistics 2022-07-21 David Lopez-Paz , Diane Bouchacourt , Levent Sagun , Nicolas Usunier