English
Related papers

Related papers: New insights into Elo algorithm for practitioners …

200 papers

In this work we develop a new algorithm for rating of teams (or players) in one-on-one games by exploiting the observed difference of the game-points (such as goals), also known as a margin of victory (MOV). Our objective is to obtain the…

Methodology · Statistics 2022-02-09 Leszek Szczecinski

The Elo algorithm, renowned for its simplicity, is widely used for rating in sports tournaments and other applications. However, despite its widespread use, a detailed understanding of the convergence characteristics of the Elo algorithm is…

Machine Learning · Computer Science 2023-11-28 Daniel Gomes de Pinho Zanco , Leszek Szczecinski , Eduardo Vinicius Kuhn , Rui Seara

The Elo rating system is a highly successful ranking algorithm for games of skill where, by construction, one team wins and the other loses. A primary limitation of the original Elo algorithm is its inability to predict information beyond a…

Methodology · Statistics 2018-02-05 J. Scott Moreland , Matthew C. Superdock

In Natural Language Processing (NLP), the Elo rating system, originally designed for ranking players in dynamic games such as chess, is increasingly being used to evaluate Large Language Models (LLMs) through "A vs B" paired comparisons.…

Computation and Language · Computer Science 2023-11-30 Meriem Boubdir , Edward Kim , Beyza Ermis , Sara Hooker , Marzieh Fadaee

This work is concerned with the rating of players/teams in face-to-face games with three possible outcomes: loss, win, and draw. This is one of the fundamental problems in sport analytics, where the very simple and popular, non-trivial…

Statistics Theory · Mathematics 2019-10-15 Leszek Szczecinski , Aymen Djebbi

Elo rating, widely used for skill assessment across diverse domains ranging from competitive games to large language models, is often understood as an incremental update algorithm for estimating a stationary Bradley-Terry (BT) model.…

Machine Learning · Computer Science 2025-02-18 Shange Tang , Yuanhao Wang , Chi Jin

The Elo rating system is widely adopted to evaluate the skills of (chess) game and sports players. Recently it has been also integrated into machine learning algorithms in evaluating the performance of computerised AI agents. However, an…

Machine Learning · Computer Science 2022-01-21 Xue Yan , Yali Du , Binxin Ru , Jun Wang , Haifeng Zhang , Xu Chen

As large language models (LLMs) continue to advance, accurately and comprehensively evaluating their performance becomes increasingly challenging. Ranking the relative performance of LLMs based on Elo ratings, according to human judgment,…

Computation and Language · Computer Science 2023-11-14 Minghao Wu , Alham Fikri Aji

Marking and feedback are essential features of teaching and learning, across the overwhelming majority of educational settings and contexts. However, it can take a great deal of time and effort for teachers to mark assessments, and to…

Human-Computer Interaction · Computer Science 2022-04-06 Andy Gray , Alma Rahat , Tom Crick , Stephen Lindsay , Darren Wallace

As Large Language Models (LLMs) achieve breakthroughs in complex reasoning, Codeforces-based Elo ratings have emerged as a prominent metric for evaluating competitive programming capabilities. However, these ratings are often reported…

Software Engineering · Computer Science 2026-02-06 Shenyu Zheng , Ximing Dong , Xiaoshuang Liu , Gustavo Oliva , Chong Chun Yong , Dayi Lin , Boyuan Chen , Shaowei Wang , Ahmed E. Hassan

This article discusses in detail the rating system that won the kaggle competition "Chess Ratings: Elo vs the rest of the world". The competition provided a historical dataset of outcomes for chess games, and aimed to discover whether novel…

Machine Learning · Computer Science 2015-03-17 Yannis Sismanis

The Elo rating system is a simple and widely used method for calculating players' skills from paired comparisons data. Many have extended it in various ways. Yet the question of updating players' variances remains to be further explored. In…

Applications · Statistics 2023-10-17 Hsuan-Fu Hua , Ching-Ju Chang , Tse-Ching Lin , Ruby Chiu-Hsing Weng

This paper investigates the evaluation of learned multiagent strategies in the incomplete information setting, which plays a critical role in ranking and training of agents. Traditionally, researchers have relied on Elo ratings for this…

Multiagent Systems · Computer Science 2020-01-13 Mark Rowland , Shayegan Omidshafiei , Karl Tuyls , Julien Perolat , Michal Valko , Georgios Piliouras , Remi Munos

The Elo rating system is a popular and widely adopted method for measuring the relative skill levels of players or teams in various sports and competitions. It assigns players numerical ratings and dynamically updates them based on game…

Probability · Mathematics 2026-01-28 Roberto Cortez , Hagop Tossounian

Rating systems play a crucial role in evaluating player skill across competitive environments. The Elo rating system, originally designed for deterministic and information-complete games such as chess, has been widely adopted and modified…

Computer Science and Game Theory · Computer Science 2025-12-23 Avirup Chakraborty , Shirsa Maitra , Tathagata Banerjee , Diganta Mukherjee , Tridib Mukherjee

ELO rating system is proposed by Arpad Elo, a Hungarian-American physics professor. Originally, it was proposed for the ranking system of chess players, but it was soon adapted to many other zero-sum sports fields like football, baseball,…

Human-Computer Interaction · Computer Science 2023-10-24 Yuhan Song

Ranking athletes by their performance in competitions and tournaments is common in every popular sport and has significant benefits that contribute to both the organization and strategic aspects of competitions. Although rankings are…

Physics and Society · Physics 2025-08-28 Bogdán Asztalos , Boldizsár Balázs , Gergely Palla , Tamás Vicsek

This paper presents an original model for assessing scientific productivity, research power ranking, RPR, which is based on the adaptation of the Elo rating system to the context of scientific activity. Unlike traditional scientometric…

Physics and Society · Physics 2025-04-30 Eldar Knar

In this manuscript, we concentrate on a specific type of covariates, which we call statistically enhanced, for modeling tennis matches for men at Grand slam tournaments. Our goal is to assess whether these enhanced covariates have the…

Applications · Statistics 2025-02-27 Nourah Buhamra , Andreas Groll

Rating systems play an important role in competitive sports and games. They provide a measure of player skill, which incentivizes competitive performances and enables balanced match-ups. In this paper, we present a novel Bayesian rating…

Information Retrieval · Computer Science 2021-01-05 Aram Ebtekar , Paul Liu
‹ Prev 1 2 3 10 Next ›