English
Related papers

Related papers: Path to Stochastic Stability: Comparative Analysis…

200 papers

This paper considers a class of reinforcement-based learning (namely, perturbed learning automata) and provides a stochastic-stability analysis in repeatedly-played, positive-utility, finite strategic-form games. Prior work in this class of…

Computer Science and Game Theory · Computer Science 2019-01-29 Georgios C. Chasparis

We discuss the long-run behavior of stochastic dynamics of many interacting players in spatial evolutionary games. In particular, we investigate the effect of the number of players and the noise level on the stochastic stability of Nash…

Statistical Mechanics · Physics 2009-11-07 Jacek Miekisz

The theory of learning in games has extensively studied situations where agents respond dynamically to each other by optimizing a fixed utility function. However, in real situations, the strategic environment varies as a result of past…

Computer Science and Game Theory · Computer Science 2022-07-15 Brandon C. Collins , Shouhuai Xu , Philip N. Brown

A model of stochastic games where multiple controllers jointly control the evolution of the state of a dynamic system but have access to different information about the state and action processes is considered. The asymmetry of information…

Computer Science and Game Theory · Computer Science 2012-09-18 Ashutosh Nayyar , Abhishek Gupta , Cédric Langbort , Tamer Başar

Stochastic momentum methods have been widely adopted in training deep neural networks. However, their theoretical analysis of convergence of the training objective and the generalization error for prediction is still under-explored. This…

Machine Learning · Computer Science 2018-08-31 Yan Yan , Tianbao Yang , Zhe Li , Qihang Lin , Yi Yang

Multiagent systems where agents interact among themselves and with a stochastic environment can be formalized as stochastic games. We study a subclass named Markov potential games (MPGs) that appear often in economic and engineering…

Multiagent Systems · Computer Science 2018-05-23 Sergio Valcarcel Macua , Javier Zazo , Santiago Zazo

In this paper, we examine the long-run behavior of regularized, no-regret learning in finite games. A well-known result in the field states that the empirical frequencies of no-regret play converge to the game's set of coarse correlated…

Computer Science and Game Theory · Computer Science 2023-11-07 Victor Boone , Panayotis Mertikopoulos

Stochastic games have become a prevalent framework for studying long-term multi-agent interactions, especially in the context of multi-agent reinforcement learning. In this work, we comprehensively investigate the concept of constant-memory…

Computer Science and Game Theory · Computer Science 2025-10-16 Fengming Zhu , Fangzhen Lin

Game theory is playing more and more important roles in understanding complex systems and in investigating intelligent machines with various uncertainties. As a starting point, we consider the classical two-player zero-sum linear-quadratic…

Optimization and Control · Mathematics 2022-04-20 Nian Liu , Lei Guo

We consider a distributed stochastic approximation (SA) scheme for computing an equilibrium of a stochastic Nash game. Standard SA schemes employ diminishing steplength sequences that are square summable but not summable. Such requirements…

Optimization and Control · Mathematics 2013-03-20 Farzad Yousefian , Angelia Nedich , Uday V. Shanbhag

One of the main criticisms to game theory concerns the assumption of full rationality. Logit dynamics is a decentralized algorithm in which a level of irrationality (a.k.a. "noise") is introduced in players' behavior. In this context, the…

Computer Science and Game Theory · Computer Science 2014-11-05 Diodato Ferraioli , Carmine Ventre

There has been substantial progress in the inference of formal behavioural specifications from sample trajectories, for example, using Linear Temporal Logic (LTL). However, these techniques cannot handle specifications that correctly…

Logic in Computer Science · Computer Science 2025-05-20 Rajarshi Roy , Yash Pote , David Parker , Marta Kwiatkowska

Achieving robust coordination and cooperation is a central challenge in multi-agent reinforcement learning (MARL). Uncovering the mechanisms underlying such emergent behaviors calls for a dynamical understanding of learn processes. In this…

Physics and Society · Physics 2026-01-13 Yuxin Geng , Wolfram Barfuss , Feng Fu , Xingru Chen

Recent extensions to dynamic games of the well-known fictitious play learning procedure in static games were proved to globally converge to stationary Nash equilibria in two important classes of dynamic games (zero-sum and…

Computer Science and Game Theory · Computer Science 2022-07-08 Lucas Baudin , Rida Laraki

This paper addresses the problem of learning optimal policies for satisfying signal temporal logic (STL) specifications by agents with unknown stochastic dynamics. The system is modeled as a Markov decision process, in which the states…

Systems and Control · Computer Science 2016-09-26 Derya Aksaray , Austin Jones , Zhaodan Kong , Mac Schwager , Calin Belta

Synthesis from linear temporal logic (LTL) specifications provides assured controllers for systems operating in stochastic and potentially adversarial environments. Automatic synthesis tools, however, require a model of the environment to…

Artificial Intelligence · Computer Science 2026-04-07 Alper Kamil Bozkurt , Yu Wang , Michael M. Zavlanos , Miroslav Pajic

Stochastic models such as Continuous-Time Markov Chains (CTMC) and Stochastic Hybrid Automata (SHA) are powerful formalisms to model and to reason about the dynamics of biological systems, due to their ability to capture the stochasticity…

Logic in Computer Science · Computer Science 2013-09-05 Ezio Bartocci , Luca Bortolussi , Laura Nenzi , Guido Sanguinetti

Animal behavior and evolution can often be described by game-theoretic models. Although in many situations, the number of players is very large, their strategic interactions are usually decomposed into a sum of two-player games. Only…

Populations and Evolution · Quantitative Biology 2007-05-23 Dominik Kaminski , Jacek Miekisz , Marcin Zaborowski

It is common to assume that agents will adopt Nash equilibrium strategies; however, experimental studies have demonstrated that Nash equilibrium is often a poor description of human players' behavior in unrepeated normal-form games. In this…

Computer Science and Game Theory · Computer Science 2017-10-17 James R. Wright , Kevin Leyton-Brown

In this article, we study feature attributions of Machine Learning (ML) models originating from linear game values and coalitional values defined as operators on appropriate functional spaces. The main focus is on random games based on the…

Computer Science and Game Theory · Computer Science 2024-08-13 Alexey Miroshnikov , Konstandinos Kotsiopoulos , Khashayar Filom , Arjun Ravi Kannan