English
Related papers

Related papers: Partially Identified Rankings from Pairwise Intera…

200 papers

We analyze different methods of sorting and selecting a set of objects by their intrinsic value, via pairwise comparisons whose outcome is uncertain. After discussing the limits of repeated Round Robins, two new methods are presented: The…

Statistical Mechanics · Physics 2016-08-31 Paolo Laureti , Joachim Mathiesen , Yi-Cheng Zhang

Ranking problems based on pairwise comparisons, such as those arising in online gaming, often involve a large pool of items to order. In these situations, the gap in performance between any two items can be significant, and the smallest and…

Statistics Theory · Mathematics 2022-06-16 Heejong Bong , Alessandro Rinaldo

Pairwise human-preference platforms such as Chatbot Arena have become central to large language model (LLM) evaluation, yet reliable task-specific ranking remains challenging. Global leaderboards mask task heterogeneity, while ranking each…

Methodology · Statistics 2026-05-29 Jiachun Li , David Simchi-Levi , Will Wei Sun

Ranking systems influence decision-making in high-stakes domains like health, education, and employment, where they can have substantial economic and social impacts. This makes the integration of safety mechanisms essential. One such…

Machine Learning · Computer Science 2025-05-30 Antonio Ferrara , Andrea Pugnana , Francesco Bonchi , Salvatore Ruggieri

We focus on the problem of ranking $N$ objects starting from a set of noisy pairwise comparisons provided by a crowd of unequal workers, each worker being characterized by a specific degree of reliability, which reflects her ability to rank…

Machine Learning · Computer Science 2023-10-04 Alessandro Nordio , Alberto tarable , Emilio Leonardi

We propose a topic modeling approach to the prediction of preferences in pairwise comparisons. We develop a new generative model for pairwise comparisons that accounts for multiple shared latent rankings that are prevalent in a population…

Machine Learning · Computer Science 2015-01-27 Weicong Ding , Prakash Ishwar , Venkatesh Saligrama

We consider the problem of ranking $N$ objects starting from a set of noisy pairwise comparisons provided by a crowd of equal workers. We assume that objects are endowed with intrinsic qualities and that the probability with which an object…

Information Retrieval · Computer Science 2020-02-27 Evgenia Christoforou , Alessandro Nordio , Alberto Tarable , Emilio Leonardi

We consider the problem of inferring an unknown ranking of $n$ items from a random tournament on $n$ vertices whose edge directions are correlated with the ranking. We establish, in terms of the strength of these correlations, the…

Statistics Theory · Mathematics 2024-07-24 Dmitriy Kunisky , Daniel A. Spielman , Xifan Yu

We consider the problem of estimating a ranking on a set of items from noisy pairwise comparisons given item features. We address the fact that pairwise comparison data often reflects irrational choice, e.g. intransitivity. Our key…

Machine Learning · Statistics 2020-06-30 Amanda Bower , Laura Balzano

Rankings are central to decision-making in fields ranging from education to online platforms, yet classical deterministic methods such as the Borda count method or Copeland-type pairwise methods ignore uncertainty due to sampling noise or…

Methodology · Statistics 2026-05-20 Shunpu Zhang

The rating of items based on pairwise comparisons has been a topic of statistical investigation for many decades. Numerous approaches have been proposed. One of the best known is the Bradley-Terry model. This paper seeks to assemble and…

Statistics Theory · Mathematics 2025-08-08 Ian Hamilton , Nick Tawn , David Firth

This paper considers ranking inference of $n$ items based on the observed data on the top choice among $M$ randomly selected items at each trial. This is a useful modification of the Plackett-Luce model for $M$-way ranking with only the top…

Methodology · Statistics 2023-01-09 Jianqing Fan , Zhipeng Lou , Weichen Wang , Mengxin Yu

Ranking and comparing items is crucial for collecting information about preferences in many areas, from marketing to politics. The Mallows rank model is among the most successful approaches to analyse rank data, but its computational…

Methodology · Statistics 2017-04-28 Valeria Vitelli , Øystein Sørensen , Marta Crispino , Arnoldo Frigessi , Elja Arjas

Estimating consumer preferences is central to many problems in economics and marketing. This paper develops a flexible framework for learning individual preferences from partial ranking information by interpreting observed rankings as…

Machine Learning · Statistics 2026-02-19 Yu-Chang Chen , Chen Chian Fuh , Shang En Tsai

Ranking systems produce ordered lists from scalar scores, yet the ranking itself depends only on pairwise comparisons. We develop a mathematical theory that takes this observation seriously, centering the analysis on pairwise margins rather…

Information Retrieval · Computer Science 2026-04-14 Yin Cheng

Learning to rank is an effective recommendation approach since its introduction around 2010. Famous algorithms such as Bayesian Personalized Ranking and Collaborative Less is More Filtering have left deep impact in both academia and…

Information Retrieval · Computer Science 2022-12-21 Hao Wang

After the phenomenal success of the PageRank algorithm, many researchers have extended the PageRank approach to ranking graphs with richer structures beside the simple linkage structure. In some scenarios we have to deal with…

Numerical Analysis · Mathematics 2018-11-15 Gianna M. Del Corso , Francesco Romani

We present a physically-inspired model and an efficient algorithm to infer hierarchical rankings of nodes in directed networks. It assigns real-valued ranks to nodes rather than simply ordinal ranks, and it formalizes the assumption that…

Physics and Society · Physics 2018-06-14 Caterina De Bacco , Daniel B. Larremore , Cristopher Moore

We study partial identification of the preference parameters in the one-to-one matching model with perfectly transferable utilities. We do so without imposing parametric distributional assumptions on the unobserved heterogeneity and with…

Econometrics · Economics 2022-07-28 Cristina Gualdani , Shruti Sinha

Analogical reasoning depends fundamentally on the ability to learn and generalize about relations between objects. We develop an approach to relational learning which, given a set of pairs of objects…

Methodology · Statistics 2013-08-30 Ricardo Silva , Katherine Heller , Zoubin Ghahramani , Edoardo M. Airoldi