English
Related papers

Related papers: Policy Space Diversity for Non-Transitive Games

200 papers

In this paper we contribute a novel algorithm family, which generalizes many unsupervised techniques including unnormalized and energy models, and allows us to infer different statistical modalities (e.g. data likelihood and ratio between…

Machine Learning · Computer Science 2021-01-14 Dmitry Kopitkov , Vadim Indelman

Several multiagent reinforcement learning (MARL) algorithms have been proposed to optimize agents decisions. Due to the complexity of the problem, the majority of the previously developed MARL algorithms assumed agents either had some…

Machine Learning · Computer Science 2014-01-16 Sherief Abdallah , Victor Lesser

We study computationally efficient methods for finding equilibria in n-player general-sum games, specifically ones that afford complex visuomotor skills. We show how existing methods would struggle in this setting, either computationally or…

Artificial Intelligence · Computer Science 2024-01-11 Siqi Liu , Luke Marris , Marc Lanctot , Georgios Piliouras , Joel Z. Leibo , Nicolas Heess

We study the open question of how players learn to play a social optimum pure-strategy Nash equilibrium (PSNE) through repeated interactions in general-sum coordination games. A social optimum of a game is the stable Pareto-optimal state…

Computer Science and Game Theory · Computer Science 2023-07-26 Duong Nguyen , Langford White , Hung Nguyen

Blotto Games are a popular model of multi-dimensional strategic resource allocation. Two players allocate resources in different battlefields in an auction setting. While competition with equal budgets is well understood, little is known…

Neural and Evolutionary Computing · Computer Science 2021-03-29 Aymeric Vie

In single-agent Markov decision processes, an agent can optimize its policy based on the interaction with environment. In multi-player Markov games (MGs), however, the interaction is non-stationary due to the behaviors of other players, so…

Computer Science and Game Theory · Computer Science 2021-10-19 Yuanheng Zhu , Dongbin Zhao , Mengchen Zhao , Dong Li

Scaling reinforcement learning to tens of thousands of parallel environments requires overcoming the limited exploration capacity of a single policy. Ensemble-based policy gradient methods, which employ multiple policies to collect diverse…

Machine Learning · Computer Science 2026-03-04 Naoki Shitanda , Motoki Omura , Tatsuya Harada , Takayuki Osa

Large language models (LLMs) have enabled rapid progress in automatic heuristic discovery (AHD), yet most existing methods are predominantly limited by static evaluation against fixed instance distributions, leading to potential overfitting…

Artificial Intelligence · Computer Science 2026-02-10 Xinyi Ke , Kai Li , Junliang Xing , Yifan Zhang , Jian Cheng

We investigate the complexity of computing approximate Nash equilibria in anonymous games. Our main algorithmic result is the following: For any $n$-player anonymous game with a bounded number of strategies and any constant $\delta>0$, an…

Computer Science and Game Theory · Computer Science 2016-08-29 Yu Cheng , Ilias Diakonikolas , Alistair Stewart

Despite many distributed resource allocation (DRA) algorithms have been reported in literature, it is still unknown how to allocate the resource optimally over multiple interacting coalitions. One major challenge in solving such a problem…

Optimization and Control · Mathematics 2025-09-24 Jialing Zhou , Guanghui Wen , Yuezu Lv , Tao Yang , Guanrong Chen

In this paper, we investigate the seeking of Nash equilibrium (NE) in a non-cooperative quadratic game where all agents exchange their delayed strategy information with their neighbors. To extend best-response algorithms to the delayed…

Systems and Control · Electrical Eng. & Systems 2026-02-24 Kaichen Jiang , Yuyue Yan , Mingda Yue , Yuhu Wu

Games with incomplete preferences are an important model for studying rational decision-making in scenarios where players face incomplete information about their preferences and must contend with incomparable outcomes. We study the problem…

Computer Science and Game Theory · Computer Science 2024-08-13 Abhishek N. Kulkarni , Jie Fu , Ufuk Topcu

This paper aims at investigating the problem of fast convergence to the Nash equilibrium (NE) for N-Player noncooperative differential games. The proposed method is such that the players attain their NE point without steady-state…

Optimization and Control · Mathematics 2023-01-13 Zahra Zahedi , Alireza Khayatian , Mohammad Mehdi Arefi , Shen Yin

We propose a new family of policy gradient methods for reinforcement learning, which alternate between sampling data through interaction with the environment, and optimizing a "surrogate" objective function using stochastic gradient ascent.…

Machine Learning · Computer Science 2017-08-29 John Schulman , Filip Wolski , Prafulla Dhariwal , Alec Radford , Oleg Klimov

In this paper we study the problem of exact recovery of the pure-strategy Nash equilibria (PSNE) set of a graphical game from noisy observations of joint actions of the players alone. We consider sparse linear influence games --- a…

Computer Science and Game Theory · Computer Science 2019-05-28 Asish Ghoshal , Jean Honorio

Continuous games are multiplayer games in which strategy sets are compact and utility functions are continuous. These games typically have a highly complicated structure of Nash equilibria, and numerical methods for the equilibrium…

Computer Science and Game Theory · Computer Science 2022-07-12 T. Kroupa , T. Votroubek

Static reduction of information structures (ISs) is a method that is commonly adopted in stochastic control, team theory, and game theory. One approach entails change of measure arguments, which has been crucial for stochastic analysis and…

Optimization and Control · Mathematics 2023-07-13 Sina Sanjari , Tamer Başar , Serdar Yüksel

We study multi-player general-sum Markov games with one of the players designated as the leader and the other players regarded as followers. In particular, we focus on the class of games where the followers are myopic, i.e., they aim to…

Machine Learning · Computer Science 2021-12-28 Han Zhong , Zhuoran Yang , Zhaoran Wang , Michael I. Jordan

In this work, we attempt to bridge the two fields of finite-agent and infinite-agent games, by studying how the optimal policies of agents evolve with the number of agents (population size) in mean-field games, an agent-centric perspective…

Machine Learning · Computer Science 2023-02-08 Pengdeng Li , Xinrun Wang , Shuxin Li , Hau Chan , Bo An

This work studies an independent natural policy gradient (NPG) algorithm for the multi-agent reinforcement learning problem in Markov potential games. It is shown that, under mild technical assumptions and the introduction of the…

Machine Learning · Computer Science 2023-10-30 Youbang Sun , Tao Liu , Ruida Zhou , P. R. Kumar , Shahin Shahrampour