English
Related papers

Related papers: Top-$K$ Ranking from Pairwise Comparisons: When Sp…

200 papers

Fairness in ranking models is crucial, as disparities in exposure can disproportionately affect protected groups. Most fairness-aware ranking systems focus on ensuring comparable average exposure for groups across the entire ranked list,…

Machine Learning · Computer Science 2025-09-23 Boyang Zhang , Quanqi Hu , Mingxuan Sun , Qihang Lin , Tianbao Yang

Many applications such as recommendation systems or sports tournaments involve pairwise comparisons within a collection of $n$ items, the goal being to aggregate the binary outcomes of the comparisons in order to recover the latent strength…

Statistics Theory · Mathematics 2023-07-13 Eglantine Karlé , Hemant Tyagi

Ranking algorithms are deployed widely to order a set of items in applications such as search engines, news feeds, and recommendation systems. Recent studies, however, have shown that, left unchecked, the output of ranking algorithms can…

Data Structures and Algorithms · Computer Science 2018-07-31 L. Elisa Celis , Damian Straszak , Nisheeth K. Vishnoi

A common problem in machine learning is to rank a set of n items based on pairwise comparisons. Here ranking refers to partitioning the items into sets of pre-specified sizes according to their scores, which includes identification of the…

Machine Learning · Computer Science 2018-01-08 Reinhard Heckel , Max Simchowitz , Kannan Ramchandran , Martin J. Wainwright

Motivated by applications in recommender systems, web search, social choice and crowdsourcing, we consider the problem of identifying the set of top $K$ items from noisy pairwise comparisons. In our setting, we are non-actively given $r$…

Data Structures and Algorithms · Computer Science 2016-05-13 Xi Chen , Sivakanth Gopi , Jieming Mao , Jon Schneider

We consider sequential or active ranking of a set of n items based on noisy pairwise comparisons. Items are ranked according to the probability that a given item beats a randomly chosen item, and ranking refers to partitioning the items…

Machine Learning · Computer Science 2016-09-26 Reinhard Heckel , Nihar B. Shah , Kannan Ramchandran , Martin J. Wainwright

Given a number of pairwise preferences of items, a common task is to rank all the items. Examples include pairwise movie ratings, New Yorker cartoon caption contests, and many other consumer preferences tasks. What these settings have in…

Machine Learning · Computer Science 2020-07-06 Umang Varma , Lalit Jain , Anna C. Gilbert

This paper studies the performance of the spectral method in the estimation and uncertainty quantification of the unobserved preference scores of compared entities in a general and more realistic setup. Specifically, the comparison graph…

Methodology · Statistics 2024-03-04 Jianqing Fan , Zhipeng Lou , Weichen Wang , Mengxin Yu

Ranking objects is a simple and natural procedure for organizing data. It is often performed by assigning a quality score to each object according to its relevance to the problem at hand. Ranking is widely used for object selection, when…

Artificial Intelligence · Computer Science 2012-06-26 Or Zuk , Liat Ein-Dor , Eytan Domany

This paper explores the adaptive (active) PAC (probably approximately correct) top-$k$ ranking (i.e., top-$k$ item selection) and total ranking problems from $l$-wise ($l\geq 2$) comparisons under the multinomial logit (MNL) model. By…

Machine Learning · Computer Science 2018-09-11 Wenbo Ren , Jia Liu , Ness B. Shroff

We study the ranking of individuals, teams, or objects, based on pairwise comparisons between them, using the Bradley-Terry model. Estimates of rankings within this model are commonly made using a simple iterative algorithm first introduced…

Machine Learning · Statistics 2023-08-16 M. E. J. Newman

In this paper, we address the top-$K$ ranking problem with a monotone adversary. We consider the scenario where a comparison graph is randomly generated and the adversary is allowed to add arbitrary edges. The statistician's goal is then to…

Machine Learning · Statistics 2024-06-21 Yuepeng Yang , Antares Chen , Lorenzo Orecchia , Cong Ma

We consider the problem of probably approximately correct (PAC) ranking $n$ items by adaptively eliciting subset-wise preference feedback. At each round, the learner chooses a subset of $k$ items and observes stochastic feedback indicating…

Machine Learning · Computer Science 2019-03-06 Aadirupa Saha , Aditya Gopalan

We describe a seriation algorithm for ranking a set of items given pairwise comparisons between these items. Intuitively, the algorithm assigns similar rankings to items that compare similarly with all others. It does so by constructing a…

Machine Learning · Computer Science 2016-03-11 Fajwel Fogel , Alexandre d'Aspremont , Milan Vojnovic

This paper studies the problem of inferring a global preference based on the partial rankings provided by many users over different subsets of items according to the Plackett-Luce model. A question of particular interest is how to optimally…

Machine Learning · Statistics 2014-06-24 Bruce Hajek , Sewoong Oh , Jiaming Xu

We propose the Heterogeneous Thurstone Model (HTM) for aggregating ranked data, which can take the accuracy levels of different users into account. By allowing different noise distributions, the proposed HTM model maintains the generality…

Machine Learning · Computer Science 2019-12-04 Tao Jin , Pan Xu , Quanquan Gu , Farzad Farnoud

We address the problem of learning a ranking by using adaptively chosen pairwise comparisons. Our goal is to recover the ranking accurately but to sample the comparisons sparingly. If all comparison outcomes are consistent with the ranking,…

Machine Learning · Statistics 2017-06-16 Lucas Maystre , Matthias Grossglauser

Comparing the top $k$ elements between two or more ranked results is a common task in many contexts and settings. A few measures have been proposed to compare top $k$ lists with attractive mathematical properties, but they face a number of…

Information Theory · Computer Science 2013-10-02 Arun Konagurthu , James Collier

PageRank and the Bradley-Terry model are competing approaches to ranking entities such as teams in sports tournaments or journals in citation networks. The Bradley-Terry model is a classical statistical method for ranking based on paired…

Methodology · Statistics 2024-02-13 David Antony Selby

We study the active learning problem of top-$k$ ranking from multi-wise comparisons under the popular multinomial logit model. Our goal is to identify the top-$k$ items with high probability by adaptively querying sets for comparisons and…

Data Structures and Algorithms · Computer Science 2017-08-01 Xi Chen , Yuanzhi Li , Jieming Mao