English
Related papers

Related papers: Exploiting hidden structures in non-convex games f…

200 papers

We contribute the first provable guarantees of global convergence to Nash equilibria (NE) in two-player zero-sum convex Markov games (cMGs) by using independent policy gradient methods. Convex Markov games, recently defined by Gemp et al.…

Computer Science and Game Theory · Computer Science 2025-06-23 Fivos Kalogiannis , Emmanouil-Vasileios Vlatakis-Gkaragkounis , Ian Gemp , Georgios Piliouras

In this paper we consider the problem of distributed Nash equilibrium (NE) seeking over networks, a setting in which players have limited local information. We start from a continuous-time gradient-play dynamics that converges to an NE…

Optimization and Control · Mathematics 2024-10-30 Dian Gadjov , Lacra Pavel

The performance of optimization methods is often tied to the spectrum of the objective Hessian. Yet, conventional assumptions, such as smoothness, do often not enable us to make finely-grained convergence statements -- particularly not for…

Optimization and Control · Mathematics 2024-02-08 Nikita Doikov , Sebastian U. Stich , Martin Jaggi

The two-timescale gradient descent-ascent (GDA) is a canonical gradient algorithm designed to find Nash equilibria in min-max games. We analyze the two-timescale GDA by investigating the effects of learning rate ratios on convergence…

Optimization and Control · Mathematics 2025-10-13 Jing An , Jianfeng Lu

Distributed optimization and Nash equilibrium (NE) seeking problems have drawn much attention in the control community recently. This paper studies a class of non-cooperative games, known as N-cluster game, which subsumes both cooperative…

Optimization and Control · Mathematics 2023-03-01 Yipeng Pang , Guoqiang Hu

Distributed Nash equilibrium seeking of aggregative games is investigated and a continuous-time algorithm is proposed. The algorithm is designed by virtue of projected gradient play dynamics and distributed average tracking dynamics, and is…

Optimization and Control · Mathematics 2021-12-07 Shu Liang , Peng Yi , Yiguang Hong , Kaixiang Peng

In this paper, a multi-cluster game with high-order players is investigated. Different from the well-known multi-cluster games, the dynamics of players are taken into account in our problem. Due to the high-order dynamics of players,…

Systems and Control · Electrical Eng. & Systems 2021-06-28 Zhenhua Deng , Yangyang Liu

We study Nash equilibria learning of a general-sum stochastic game with an unknown transition probability density function. Agents take actions at the current environment state and their joint action influences the transition of the…

Systems and Control · Electrical Eng. & Systems 2022-10-19 Yan Chen , Tao Li

We consider two classes of constrained finite state-action stochastic games. First, we consider a two player nonzero sum single controller constrained stochastic game with both average and discounted cost criterion. We consider the same…

Optimization and Control · Mathematics 2012-06-11 Vikas Vikram Singh , N. Hemachandra

We consider a class of nonsmooth aggregative games over networks in stochastic regimes, where each player is characterized by a composite cost function $f_i+r_i$, $f_i$ is a smooth expectation-valued function dependent on its own strategy…

Optimization and Control · Mathematics 2024-06-28 Jinlong Lei , Uday V. Shanbhag , Jie Chen

Consider a strongly monotone game where the players' utility functions include a reward function and a linear term for each dimension, with coefficients that are controlled by the manager. Gradient play converges to a unique Nash…

Multiagent Systems · Computer Science 2026-02-25 Siddharth Chandak , Ilai Bistritz , Nicholas Bambos

We propose fully-distributed algorithms for Nash equilibrium seeking in aggregative games over networks. We first consider the case where local constraints are present and we design an algorithm combining, for each agent, (i) the projected…

Systems and Control · Electrical Eng. & Systems 2024-04-04 Guido Carnevale , Filippo Fabiani , Filiberto Fele , Kostas Margellos , Giuseppe Notarstefano

We present a unified framework for characterizing local Nash equilibria in continuous games on either infinite-dimensional or finite-dimensional non-convex strategy spaces. We provide intrinsic necessary and sufficient first- and…

Optimization and Control · Mathematics 2014-11-11 Lillian J. Ratliff , Samuel A. Burden , S. Shankar Sastry

Unsupervised learning aims at the discovery of hidden structure that drives the observations in the real world. It is essential for success in modern machine learning. Latent variable models are versatile in unsupervised learning and have…

Machine Learning · Computer Science 2016-06-13 Furong Huang

In the digital age, resources such as open-source software and publicly accessible databases form a crucial category of digital public goods, providing extensive benefits for Internet. This paper investigates networked public goods games…

Computer Science and Game Theory · Computer Science 2025-02-04 Yukun Cheng , Xiaotie Deng , Yunxuan Ma

We study online optimization methods for zero-sum games, a fundamental problem in adversarial learning in machine learning, economics, and many other domains. Traditional methods approximate Nash equilibria (NE) using either regret-based…

Computer Science and Game Theory · Computer Science 2025-07-16 Taemin Kim , James P. Bailey

In this paper, we propose a passivity-based methodology for analysis and design of reinforcement learning in multi-agent finite games. Starting from a known exponentially-discounted reinforcement learning scheme, we show that convergence to…

Optimization and Control · Mathematics 2024-10-30 Bolin Gao , Lacra Pavel

Structured game representations have recently attracted interest as models for multi-agent artificial intelligence scenarios, with rational behavior most commonly characterized by Nash equilibria. This paper presents efficient, exact…

Computer Science and Game Theory · Computer Science 2011-10-27 B. Blum , D. Koller , C. R. Shelton

This paper investigates stochastic generalized dynamic games with coupling chance constraints, where agents have incomplete information about uncertainties satisfying a concentration of measure property. This problem, in general, is…

Systems and Control · Electrical Eng. & Systems 2026-02-06 Seyed Shahram Yadollahi , Hamed Kebriaei , Sadegh Soudjani

This paper explores distributed aggregative games in multi-agent systems. Current methods for finding distributed Nash equilibrium require players to send original messages to their neighbors, leading to communication burden and privacy…

Systems and Control · Electrical Eng. & Systems 2024-05-07 Wei Huo , Xiaomeng Chen , Kemi Ding , Subhrakanti Dey , Ling Shi