English
Related papers

Related papers: Learning Equilibria from Data: Provably Efficient …

200 papers

This paper investigates the equilibrium convergence properties of a proposed algorithm for potential games with continuous strategy spaces in the presence of feedback delays, a main challenge in multi-agent systems that compromises the…

Optimization and Control · Mathematics 2023-03-20 Yuanhanqing Huang , Jianghai Hu

Multi-agent reinforcement learning (MARL) lies at the heart of a plethora of applications involving the interaction of a group of agents in a shared unknown environment. A prominent framework for studying MARL is Markov games, with the goal…

Machine Learning · Computer Science 2025-02-17 Tong Yang , Bo Dai , Lin Xiao , Yuejie Chi

Adversarial training is a standard technique for training adversarially robust models. In this paper, we study adversarial training as an alternating best-response strategy in a 2-player zero-sum game. We prove that even in a simple…

Machine Learning · Computer Science 2023-03-01 Maria-Florina Balcan , Rattana Pukdee , Pradeep Ravikumar , Hongyang Zhang

This paper studies the global Nash equilibrium problem of leader-follower multi-agent dynamics, which yields consensus with a privacy information encrypted learning algorithm. With the secure hierarchical structure, the relationship between…

Systems and Control · Electrical Eng. & Systems 2023-02-08 Kun Zhang , Ji-Feng Zhang , Rong Su , Huaguang Zhang

This paper studies the problem of Nash equilibrium approximation in large-scale heterogeneous mean-field games under communication and computation constraints. A deterministic mean-field game is considered in which the non-linear utility…

Optimization and Control · Mathematics 2017-09-20 Ehsan Nekouei , Tansu Alpcan , Girish Nair

We study episodic two-player zero-sum Markov games (MGs) in the offline setting, where the goal is to find an approximate Nash equilibrium (NE) policy pair based on a dataset collected a priori. When the dataset does not have uniform…

Machine Learning · Computer Science 2023-01-02 Han Zhong , Wei Xiong , Jiyuan Tan , Liwei Wang , Tong Zhang , Zhaoran Wang , Zhuoran Yang

This paper develops a distributed Nash Equilibrium seeking algorithm for heterogeneous multi-robot systems. The algorithm utilises distributed optimisation and output control to achieve the Nash equilibrium by leveraging information shared…

Robotics · Computer Science 2025-09-22 Yi Dong , Zhongguo Li , Sarvapali D. Ramchurn , Xiaowei Huang

In general, Nash equilibria in normal-form games may require players to play (probabilistically) mixed strategies. We define a measure of the complexity of finite probability distributions and study the complexity required to play Nash…

Computer Science and Game Theory · Computer Science 2024-05-14 Edan Orzech , Martin Rinard

Nash equilibrium serves as a fundamental mathematical tool in economics and game theory. However, it classically assumes knowledge of player utilities, whereas economics generally regards preferences as more fundamental. To leverage…

Computer Science and Game Theory · Computer Science 2026-05-11 Ian Gemp , Crystal Qian , Marc Lanctot , Kate Larson

Provably efficient and robust equilibrium computation in general-sum Markov games remains a core challenge in multi-agent reinforcement learning. Nash equilibrium is computationally intractable in general and brittle due to equilibrium…

Machine Learning · Computer Science 2026-03-11 Jake Gonzales , Max Horwitz , Eric Mazumdar , Lillian J. Ratliff

In this paper, the problem of finding a Nash equilibrium of a multi-player game is considered. The players are only aware of their own cost functions as well as the action space of all players. We develop a relatively fast algorithm within…

Systems and Control · Computer Science 2017-05-09 Farzad Salehisadaghiani , Lacra Pavel

We consider a multi-agent noncooperative game with agents' objective functions being affected by uncertainty. Following a data driven paradigm, we represent uncertainty by means of scenarios and seek a robust Nash equilibrium solution. We…

Optimization and Control · Mathematics 2020-10-15 Filiberto Fele , Kostas Margellos

Multi-agent reinforcement learning (MARL) methods, while effective in zero-sum or positive-sum games, often yield suboptimal outcomes in general-sum games where cooperation is essential for achieving globally optimal outcomes. Matrix game…

Computer Science and Game Theory · Computer Science 2024-08-09 Mustafa Yasir , Andrew Howes , Vasilios Mavroudis , Chris Hicks

A fundamental shortcoming of the concept of Nash equilibrium is its computational intractability: approximating Nash equilibria in normal-form games is PPAD-hard. In this paper, inspired by the ideas of smoothed analysis, we introduce a…

Computer Science and Game Theory · Computer Science 2024-07-23 Constantinos Daskalakis , Noah Golowich , Nika Haghtalab , Abhishek Shetty

In this paper, we consider a Nash equilibrium seeking problem for a class of high-order multi-agent systems with unknown dynamics. Different from existing results for single integrators, we aim to steer the outputs of this class of…

Systems and Control · Electrical Eng. & Systems 2021-01-11 Yutao Tang , Peng Yi

This work designs and analyzes a novel set of algorithms for multi-agent reinforcement learning (MARL) based on the principle of information-directed sampling (IDS). These algorithms draw inspiration from foundational concepts in…

Information Theory · Computer Science 2024-05-01 Qiaosheng Zhang , Chenjia Bai , Shuyue Hu , Zhen Wang , Xuelong Li

This paper proposes and studies a class of discrete-time finite-time-horizon Stackelberg mean-field games, with one leader and an infinite number of identical and indistinguishable followers. In this game, the objective of the leader is to…

Optimization and Control · Mathematics 2022-10-11 Xin Guo , Anran Hu , Jiacheng Zhang

We study optimal equilibria in multi-player games. An equilibrium is optimal for a player, if her payoff is maximal. A tempting approach to solving this problem is to seek optimal Nash equilibria, the standard form of equilibria where no…

Computer Science and Game Theory · Computer Science 2013-07-09 Anshul Gupta , Sven Schewe

The framework outlined in [arXiv:2010.13024] provides an approximation algorithm for computing Nash equilibria of normal form games. Since NASH is a well-known PPAD-complete problem, this framework has potential applications to other $PPAD$…

Computer Science and Game Theory · Computer Science 2021-10-27 Aadesh Salecha

In multi-agent reinforcement learning, the behaviors that agents learn in a single Markov Game (MG) are typically confined to the given agent number. Every single MG induced by varying the population may possess distinct optimal joint…

Machine Learning · Computer Science 2023-06-06 Shenao Zhang , Li Shen , Lei Han , Li Shen