English
Related papers

Related papers: Notes on the existence of solutions in the pairwis…

200 papers

Pairwise comparison matrices are widely used in Multicriteria Decision Making. This article applies incomplete pairwise comparison matrices in the area of sport tournaments, namely proposing alternative rankings for the 2010 Chess Olympiad…

Applications · Statistics 2019-06-20 László Csató

Recently, tremendous strides have been made to align the generation of Large Language Models (LLMs) with human values to mitigate toxic or unhelpful content. Leveraging Reinforcement Learning from Human Feedback (RLHF) proves effective and…

Computation and Language · Computer Science 2024-06-05 Mingye Zhu , Yi Liu , Lei Zhang , Junbo Guo , Zhendong Mao

Deciding which large language model (LLM) to use is a complex challenge. Pairwise ranking has emerged as a new method for evaluating human preferences for LLMs. This approach entails humans evaluating pairs of model outputs based on a…

Computation and Language · Computer Science 2025-02-18 Roland Daynauth , Christopher Clarke , Krisztian Flautner , Lingjia Tang , Jason Mars

Ordinal user-provided ratings across multiple items are frequently encountered in both scientific and commercial applications. Whilst recommender systems are known to do well on these type of data from a predictive point of view, their…

Methodology · Statistics 2025-03-05 Sjoerd Hermes

This study proposes a new constraint handling technique for assisting metaheuristic optimization algorithms to solve constrained optimization problems more effectively and efficiently. Given any two solutions of any constrained optimization…

Optimization and Control · Mathematics 2023-10-23 Ting Huang , Qiang Zhang , Witold Pedrycz , Shanlin Yang

This paper examines the problem of ranking a collection of objects using pairwise comparisons (rankings of two objects). In general, the ranking of $n$ objects can be identified by standard sorting methods using $n log_2 n$ pairwise…

Machine Learning · Computer Science 2011-12-13 Kevin G. Jamieson , Robert D. Nowak

The analytic hierarchy process (AHP) is one of the most widely used multicriteria decision-making methods, with applications from agriculture to space engineering. Despite its popularity, AHP has been repeatedly criticised for rank…

Optimization and Control · Mathematics 2026-02-20 Jiri Mazurek , Luis Ángel Calvo

Analyzing the consistency of preferences is an important step in decision making with pairwise comparison matrices, and several indices have been proposed in order to estimate it. In this paper we prove the proportionality between some…

Methodology · Statistics 2012-03-30 Matteo Brunelli , Andrew Critch , Michele Fedrizzi

Most popular strategies to capture subjective judgments from humans involve the construction of a unidimensional relative measurement scale, representing order preferences or judgments about a set of objects or conditions. This information…

Applications · Statistics 2017-12-18 Maria Perez-Ortiz , Rafal K. Mantiuk

We study the ranking of individuals, teams, or objects, based on pairwise comparisons between them, using the Bradley-Terry model. Estimates of rankings within this model are commonly made using a simple iterative algorithm first introduced…

Machine Learning · Statistics 2023-08-16 M. E. J. Newman

We propose a topic modeling approach to the prediction of preferences in pairwise comparisons. We develop a new generative model for pairwise comparisons that accounts for multiple shared latent rankings that are prevalent in a population…

Machine Learning · Computer Science 2015-01-27 Weicong Ding , Prakash Ishwar , Venkatesh Saligrama

We study the problem of learning to rank from pairwise preferences, and solve a long-standing open problem that has led to development of many heuristics but no provable results for our particular problem. Given a set $V$ of $n$ elements,…

Data Structures and Algorithms · Computer Science 2011-05-18 Nir Ailon

The experimental evaluation of algorithms results in a large set of data which generally do not follow a normal distribution or are not heteroscedastic. Besides, some of its entries may be missing, due to the inability of an algorithm to…

Machine Learning · Computer Science 2019-08-16 Iago A Carvalho

Multileaved comparison methods generalize interleaved comparison methods to provide a scalable approach for comparing ranking systems based on regular user interactions. Such methods enable the increasingly rapid research and development of…

Information Retrieval · Computer Science 2017-11-28 Harrie Oosterhuis , Maarten de Rijke

Eliciting preferences from human judgements is inherently imprecise, yet most decision analysis methods force a single priority vector from pairwise comparisons, discarding the information embedded in inconsistencies. We instead leverage…

General Economics · Economics 2026-02-27 Salvatore Greco , Sajid Siraj , Michele Lundy

Ranking and comparing items is crucial for collecting information about preferences in many areas, from marketing to politics. The Mallows rank model is among the most successful approaches to analyse rank data, but its computational…

Methodology · Statistics 2017-04-28 Valeria Vitelli , Øystein Sørensen , Marta Crispino , Arnoldo Frigessi , Elja Arjas

The eigenvalue method, suggested by the developer of the extensively used Analytic Hierarchy Process methodology, exhibits right-left asymmetry: the priorities derived from the right eigenvector do not necessarily coincide with the…

Optimization and Control · Mathematics 2023-11-14 László Csató

Several methods of preference modeling, ranking, voting and multi-criteria decision making include pairwise comparisons. It is usually simpler to compare two objects at a time, furthermore, some relations (e.g., the outcome of sports…

Optimization and Control · Mathematics 2025-09-04 László Gyarmati , Éva Orbán-Mihálykó , Csaba Mihálykó , Sándor Bozóki , Zsombor Szádoczki

We consider a method of pairwise variations for smooth optimization problems, which involve polyhedral constraints. It consists in making steps with respect to the difference of two selected extreme points of the feasible set together with…

Optimization and Control · Mathematics 2017-01-12 I. V. Konnov

Assessing consistency in Pairwise Comparison Matrices (PCMs) within the Analytical Hierarchy Process (AHP) poses significant challenges when using the traditional Consistency Ratio (CR) method. This study introduces a novel alternative that…

Methodology · Statistics 2025-05-13 Amarnath Bose