English
Related papers

Related papers: Decentralized Q-Learning for Stochastic Teams and …

200 papers

As assembly tasks grow in complexity, collaboration among multiple robots becomes essential for task completion. However, centralized task planning has become inadequate for adapting to the increasing intelligence and versatility of robots,…

Robotics · Computer Science 2024-04-22 Yuhan Zhao , Lan Shi , Quanyan Zhu

This paper considers a class of reinforcement-learning that belongs to the family of Learning Automata and provides a stochastic-stability analysis in strategic-form games. For this class of dynamics, convergence to pure Nash equilibria has…

Computer Science and Game Theory · Computer Science 2017-02-28 Georgios C. Chasparis

Reinforcement learning (RL) is a classical tool to solve network control or policy optimization problems in unknown environments. The original Q-learning suffers from performance and complexity challenges across very large networks. Herein,…

Machine Learning · Computer Science 2024-09-02 Talha Bozkus , Urbashi Mitra

This paper studies the finite-time horizon Markov games where the agents' dynamics are decoupled but the rewards can possibly be coupled across agents. The policy class is restricted to local policies where agents make decisions using their…

Computer Science and Game Theory · Computer Science 2023-04-11 Runyu Zhang , Yuyang Zhang , Rohit Konda , Bryce Ferguson , Jason Marden , Na Li

Smart active matter has the ability to control its motion guided by individual policies to achieve collective goals. We introduce a theoretical framework to study a decentralized learning process in which agents can locally exchange…

Statistical Mechanics · Physics 2025-07-08 Gerhard Jung , Misaki Ozawa , Eric Bertin

We study Stackelberg equilibria in finitely repeated games, where the leader commits to a strategy that picks actions in each round and can be adaptive to the history of play (i.e. they commit to an algorithm). In particular, we study…

Computer Science and Game Theory · Computer Science 2024-03-08 Natalie Collina , Eshwar Ram Arunachaleswaran , Michael Kearns

Many real-world tasks involve multiple agents with partial observability and limited communication. Learning is challenging in these settings due to local viewpoints of agents, which perceive the world as non-stationary due to…

Machine Learning · Computer Science 2018-05-23 Shayegan Omidshafiei , Jason Pazis , Christopher Amato , Jonathan P. How , John Vian

This paper investigates online stochastic aggregative games subject to local set constraints and time-varying coupled inequality constraints, where each player possesses a time-varying expectation-valued cost function relying on not only…

Optimization and Control · Mathematics 2025-11-18 Kaixin Du , Min Meng

In this paper, a review of model-free reinforcement learning for learning of dynamical systems in uncertain environments has discussed. For this purpose, the Markov Decision Process (MDP) will be reviewed. Furthermore, some learning…

Machine Learning · Computer Science 2019-05-21 Mehran Attar , Mohammadreza Dabirian

We consider a multi-agent reinforcement learning problem where each agent seeks to maximize a shared reward while interacting with other agents, and they may or may not be able to communicate. Typically the agents do not have access to…

Multiagent Systems · Computer Science 2021-04-26 Alex Tong Lin , Mark J. Debord , Katia Estabridis , Gary Hewer , Guido Montufar , Stanley Osher

We study model-based and model-free policy optimization in a class of nonzero-sum stochastic dynamic games called linear quadratic (LQ) deep structured games. In such games, players interact with each other through a set of weighted…

Computer Science and Game Theory · Computer Science 2020-12-15 Masoud Roudneshin , Jalal Arabneydi , Amir G. Aghdam

Learning in games refers to scenarios where multiple players interact in a shared environment, each aiming to minimize their regret. An equilibrium can be computed at a fast rate of $O(1/T)$ when all players follow the optimistic…

Computer Science and Game Theory · Computer Science 2025-02-18 Taira Tsuchiya , Shinji Ito , Haipeng Luo

We consider the problem of simultaneous learning in stochastic games with many players in the finite-horizon setting. While the typical target solution for a stochastic game is a Nash equilibrium, this is intractable with many players. We…

Computer Science and Game Theory · Computer Science 2022-10-27 William Brown

We study online learning in episodic constrained Markov decision processes (CMDPs), where the learner aims at collecting as much reward as possible over the episodes, while satisfying some long-term constraints during the learning process.…

Stochastic games combine controllable and adversarial non-determinism with stochastic behavior and are a common tool in control, verification and synthesis of reactive systems facing uncertainty. Multi-objective stochastic games are natural…

Computational Complexity · Computer Science 2022-07-21 Tobias Winkler , Maximilian Weininger

Matching algorithms have demonstrated great success in several practical applications, but they often require centralized coordination and plentiful information. In many modern online marketplaces, agents must independently seek out and…

Computer Science and Game Theory · Computer Science 2025-01-14 Vade Shah , Bryce L. Ferguson , Jason R. Marden

We develop methodology for a multistage decision problem with flexible number of stages in which the rewards are survival times that are subject to censoring. We present a novel Q-learning algorithm that is adjusted for censored data and…

Statistics Theory · Mathematics 2012-05-31 Yair Goldberg , Michael R. Kosorok

Classification algorithms based on Artificial Intelligence (AI) are nowadays applied in high-stakes decisions in finance, healthcare, criminal justice, or education. Individuals can strategically adapt to the information gathered about…

Computer Science and Game Theory · Computer Science 2025-08-14 Marta C. Couto , Flavia Barsotti , Fernando P. Santos

This paper addresses zero-sum ``turn'' games, in which only one player can make decisions at each state. We show that pure saddle-point state-feedback policies for turn games can be constructed from dynamic programming fixed-point equations…

Systems and Control · Electrical Eng. & Systems 2025-09-18 Sean Anderson , Chris Darken , João Hespanha

As a schematic model of the complexity economic agents are confronted with, we introduce the ``SK-game'', a discrete time binary choice model inspired from mean-field spin-glasses. We show that even in a completely static environment,…

Statistical Mechanics · Physics 2024-08-27 Jerome Garnier-Brun , Michael Benzaquen , Jean-Philippe Bouchaud