English
Related papers

Related papers: Randomized Kaczmarz for Rank Aggregation from Pair…

200 papers

Pairwise human-preference platforms such as Chatbot Arena have become central to large language model (LLM) evaluation, yet reliable task-specific ranking remains challenging. Global leaderboards mask task heterogeneity, while ranking each…

Methodology · Statistics 2026-05-29 Jiachun Li , David Simchi-Levi , Will Wei Sun

Nowadays, recommender systems already impact almost every facet of peoples lives. To provide personalized high quality recommendation results, conventional systems usually train pointwise rankers to predict the absolute value of objectives…

Information Retrieval · Computer Science 2021-12-01 Yi Ren , Hongyan Tang , Siwen Zhu

Kaczmarz algorithm is an efficient iterative algorithm to solve overdetermined consistent system of linear equations. During each updating step, Kaczmarz chooses a hyperplane based on an individual equation and projects the current estimate…

Numerical Analysis · Computer Science 2015-11-20 Yujun Li , Kaichun Mo , Haishan Ye

By introducing a subsampling strategy, we propose a randomized block Kaczmarz-Motzkin method for solving linear systems. Such strategy not only determines the block size, but also combines and extends two famous strategies, i.e., randomness…

Numerical Analysis · Mathematics 2022-12-01 Yanjun Zhang , Hanyu Li

Given a set of pairwise comparisons, the classical ranking problem computes a single ranking that best represents the preferences of all users. In this paper, we study the problem of inferring individual preferences, arising in the context…

Machine Learning · Statistics 2015-12-18 Rui Wu , Jiaming Xu , R. Srikant , Laurent Massoulié , Marc Lelarge , Bruce Hajek

In this paper, we consider large-scale ranking problems where one is given a set of (possibly non-redundant) pairwise comparisons and the underlying ranking explained by those comparisons is desired. We show that stochastic gradient descent…

Optimization and Control · Mathematics 2024-07-04 Benjamin Jarman , Lara Kassab , Deanna Needell , Alexander Sietsema

The Kaczmarz method for solving linear systems of equations is an iterative algorithm that has found many applications ranging from computer tomography to digital signal processing. Despite the popularity of this method, useful theoretical…

Numerical Analysis · Mathematics 2007-05-23 Thomas Strohmer , Roman Vershynin

This paper concerns with statistical estimation and inference for the ranking problems based on pairwise comparisons with additional covariate information such as the attributes of the compared items. Despite extensive studies, few prior…

Methodology · Statistics 2024-03-26 Jianqing Fan , Jikai Hou , Mengxin Yu

The randomized Kaczmarz (RK) method is a well-known approach for solving linear least-squares problems with a large number of rows. RK accesses and processes just one row at a time, leading to exponentially fast convergence for consistent…

Numerical Analysis · Mathematics 2025-04-11 Ethan N. Epperly , Gil Goldshlager , Robert J. Webber

Evaluating generative models is challenging because standard metrics often fail to reflect human preferences. Human evaluations are more reliable but costly and noisy, as participants vary in expertise, attention, and diligence. Pairwise…

Machine Learning · Computer Science 2026-05-13 Till Aczel , Lucas Theis , Roger Wattenhofer

The Kaczmarz method is a popular iterative scheme for solving large-scale linear systems. The randomized Kaczmarz method (RK) greatly improves the convergence rate of the Kaczmarz method, by using the rows of the coefficient matrix in…

Numerical Analysis · Mathematics 2020-12-01 Yutong Jiang , Gang Wu , Long Jiang

The randomized Kaczmarz algorithm has received considerable attention recently because of its simplicity, speed, and the ability to approximately solve large-scale linear systems of equations. In this paper we propose randomized double and…

Numerical Analysis · Mathematics 2020-10-28 Kui Du , Xiao-Hui Sun

The Kaczmarz method for solving a linear system $Ax = b$ interprets such a system as a collection of equations $\left\langle a_i, x\right\rangle = b_i$, where $a_i$ is the $i-$th row of $A$, then picks such an equation and corrects $x_{k+1}…

Numerical Analysis · Mathematics 2021-09-15 Stefan Steinerberger

When solving linear systems $Ax=b$, $A$ and $b$ are given, but the measurements $b$ often contain corruptions. Inspired by recent work on the quantile-randomized Kaczmarz method, we propose an acceleration of the randomized Kaczmarz method…

Numerical Analysis · Mathematics 2024-10-18 Emeric Battaglia , Anna Ma

The randomized sparse Kaczmarz method, designed for seeking the sparse solutions of the linear systems $Ax=b$, selects the $i$-th projection hyperplane with likelihood proportional to $\|a_{i}\|_2^2$, where $a_{i}^T$ is $i$-th row of $A$.…

Numerical Analysis · Mathematics 2023-06-13 Lu Zhang , Ziyang Yuan , Hongxia Wang , Hui Zhang

The Bradley-Terry model is a popular approach to describe probabilities of the possible outcomes when elements of a set are repeatedly compared with one another in pairs. It has found many applications including animal behaviour, chess…

Methodology · Statistics 2015-03-17 Francois Caron , Arnaud Doucet

In this paper, we study a popular method for inference of the Bradley-Terry model parameters, namely the MM algorithm, for maximum likelihood estimation and maximum a posteriori probability estimation. This class of models includes the…

Machine Learning · Statistics 2020-12-29 Milan Vojnovic , Seyoung Yun , Kaifang Zhou

The Bradley-Terry-Luce (BTL) model is a benchmark model for pairwise comparisons between individuals. Despite recent progress on the first-order asymptotics of several popular procedures, the understanding of uncertainty quantification in…

Statistics Theory · Mathematics 2022-08-11 Chao Gao , Yandi Shen , Anderson Y. Zhang

Rankings derived from pairwise comparisons are central to many economic and computational systems. In the context of large language models (LLMs), rankings are typically constructed from human preference data and presented as leaderboards…

Computation and Language · Computer Science 2026-03-05 Angel Rodrigo Avelar Menendez , Yufeng Liu , Xiaowu Dai

Randomized iterative algorithms, such as the randomized Kaczmarz method, have gained considerable popularity due to their efficacy in solving matrix-vector and matrix-matrix regression problems. Our present work leverages the insights…