English
Related papers

Related papers: Multiagent Evaluation under Incomplete Information

200 papers

Evaluating deep multiagent reinforcement learning (MARL) algorithms is complicated by stochasticity in training and sensitivity of agent performance to the behavior of other agents. We propose a meta-game evaluation framework for deep MARL,…

Multiagent Systems · Computer Science 2024-05-02 Zun Li , Michael P. Wellman

In this work, we adapt a training approach inspired by the original AlphaGo system to play the imperfect information game of Reconnaissance Blind Chess. Using only the observations instead of a full description of the game state, we first…

Artificial Intelligence · Computer Science 2022-08-04 Timo Bertram , Johannes Fürnkranz , Martin Müller

In imperfect information games, the evaluation of a game state not only depends on the observable world but also relies on hidden parts of the environment. As accessing the obstructed information trivialises state evaluations, one approach…

Artificial Intelligence · Computer Science 2024-07-15 Timo Bertram , Johannes Fürnkranz , Martin Müller

Multi-turn, multi-agent LLM game evaluations often exhibit substantial run-to-run variance. In long-horizon interactions, small early deviations compound across turns and are amplified by multi-agent coupling. This biases win rate estimates…

We study the problem of achieving decentralized coordination by a group of strategic decision makers choosing to engage or not in a task in a stochastic setting. First, we define a class of symmetric utility games that encompass a broad…

Systems and Control · Electrical Eng. & Systems 2023-04-05 Marcos M. Vasconcelos , Behrouz Touri

As large language models (LLMs) continue to advance, accurately and comprehensively evaluating their performance becomes increasingly challenging. Ranking the relative performance of LLMs based on Elo ratings, according to human judgment,…

Computation and Language · Computer Science 2023-11-14 Minghao Wu , Alham Fikri Aji

Multi-agent reinforcement learning is a challenging and active field of research due to the inherent nonstationary property and coupling between agents. A popular approach to modeling the multi-agent interactions underlying the multi-agent…

Multiagent Systems · Computer Science 2025-10-07 Jushan Chen , Santiago Paternain

Decentralised optimisation tasks are important components of multi-agent systems. These tasks can be interpreted as n-player potential games: therefore game-theoretic learning algorithms can be used to solve decentralised optimisation…

Multiagent Systems · Computer Science 2013-01-16 Michalis Smyrnakis

This work is concerned with the rating of players/teams in face-to-face games with three possible outcomes: loss, win, and draw. This is one of the fundamental problems in sport analytics, where the very simple and popular, non-trivial…

Statistics Theory · Mathematics 2019-10-15 Leszek Szczecinski , Aymen Djebbi

This work focuses on equilibrium selection in no-conflict multi-agent games, where we specifically study the problem of selecting a Pareto-optimal Nash equilibrium among several existing equilibria. It has been shown that many…

Machine Learning · Computer Science 2023-10-17 Filippos Christianos , Georgios Papoudakis , Stefano V. Albrecht

Network games provide a natural machinery to compactly represent strategic interactions among agents whose payoffs exhibit sparsity in their dependence on the actions of others. Besides encoding interaction sparsity, however, real networks…

Computational Engineering, Finance, and Science · Computer Science 2021-01-22 Kun Jin , Yevgeniy Vorobeychik , Mingyan Liu

We address the challenge of designing optimal adversarial noise algorithms for settings where a learner has access to multiple classifiers. We demonstrate how this problem can be framed as finding strategies at equilibrium in a two-player,…

Machine Learning · Computer Science 2019-06-10 Juan C. Perdomo , Yaron Singer

There has been significant recent progress in algorithms for approximation of Nash equilibrium in large two-player zero-sum imperfect-information games and exact computation of Nash equilibrium in multiplayer strategic-form games. While…

Computer Science and Game Theory · Computer Science 2025-10-01 Sam Ganzfried

To verify the robustness of a program or protocol, it is common in the computer science community to rely on the theoretical framework of game theory. In particular, if one seeks to enforce a desired property, or specification, despite an…

Computer Science and Game Theory · Computer Science 2026-05-20 Léonard Brice

Network games provide a framework to study strategic decision making processes that are governed by structured interdependencies among agents. However, existing models do not account for environments in which agents simultaneously interact…

Computer Science and Game Theory · Computer Science 2025-01-15 Raman Ebrahimi , Parinaz Naghizadeh

Multi-agent learning algorithms have been shown to display complex, unstable behaviours in a wide array of games. In fact, previous works indicate that convergent behaviours are less likely to occur as the total number of agents increases.…

Computer Science and Game Theory · Computer Science 2024-03-26 Aamal Hussain , Dan Leonte , Francesco Belardinelli , Georgios Piliouras

In this paper, we study the problem of robust cooperative multi-agent reinforcement learning (RL) where a large number of cooperative agents with distributed information aim to learn policies in the presence of \emph{stochastic} and…

Multiagent Systems · Computer Science 2025-06-16 Muhammad Aneeq uz Zaman , Mathieu Laurière , Alec Koppel , Tamer Başar

We investigate optimal decision making under imperfect recall, that is, when an agent forgets information it once held before. An example is the absentminded driver game, as well as team games in which the members have limited communication…

Computer Science and Game Theory · Computer Science 2024-06-25 Emanuel Tewolde , Brian Hu Zhang , Caspar Oesterheld , Manolis Zampetakis , Tuomas Sandholm , Paul W. Goldberg , Vincent Conitzer

We propose a game-theoretic framework for adaptive multi-agent intelligent systems. Unlike classical game theory, which often treats strategies as primitive objects chosen by perfectly rational agents, the proposed framework provides a…

Neural and Evolutionary Computing · Computer Science 2026-05-12 Zhe Sage Chen , Quanyan Zhu

In this paper, we present a framework for multi-agent learning in a nonstationary dynamic network environment. More specifically, we examine projected gradient play in smooth monotone repeated network games in which the agents'…

Computer Science and Game Theory · Computer Science 2024-08-13 Feras Al Taha , Kiran Rokade , Francesca Parise