English
Related papers

Related papers: Discrete-Time Mean Field Control with Environment …

200 papers

The research of extending deep reinforcement learning (drl) to multi-agent field has solved many complicated problems and made great achievements. However, almost all these studies only focus on discrete or continuous action space and there…

Machine Learning · Computer Science 2022-09-01 Hongzhi Hua , Guixuan Wen , Kaigui Wu

Deep reinforcement learning in continuous domains focuses on learning control policies that map states to distributions over actions that ideally concentrate on the optimal choices in each step. In multi-agent navigation problems, the…

Robotics · Computer Science 2022-10-20 Chenning Yu , Hongzhan Yu , Sicun Gao

This paper considers mean field games in a multi-agent Markov decision process (MDP) framework. Each player has a continuum state and binary action. By active control, a player can bring its state to a resetting point. All players are…

Optimization and Control · Mathematics 2017-01-25 Minyi Huang , Yan Ma

We study discrete-time, finite-state mean-field games (MFGs) under model uncertainty, where agents face ambiguity about the state transition probabilities. Each agent maximizes its expected payoff against the worst-case transitions within…

Optimization and Control · Mathematics 2026-01-21 Zongxia Liang , Zhou Zhou , Yaqi Zhuang , Bin Zou

Synchronizing decisions across multiple agents in realistic settings is problematic since it requires agents to wait for other agents to terminate and communicate about termination reliably. Ideally, agents should learn and execute…

Machine Learning · Computer Science 2022-10-12 Yuchen Xiao , Weihao Tan , Christopher Amato

We discuss a class of explicitly solvable mean field type control problems/mean field games with a clear economic interpretation. More precisely, we consider long term average impulse control problems with underlying general one-dimensional…

Optimization and Control · Mathematics 2021-04-28 Sören Christensen , Berenice Anne Neumann , Tobias Sohr

Multi-agent reinforcement learning (MARL) becomes more challenging in the presence of more agents, as the capacity of the joint state and action spaces grows exponentially in the number of agents. To address such a challenge of scale, we…

Machine Learning · Computer Science 2021-05-19 Yan Li , Lingxiao Wang , Jiachen Yang , Ethan Wang , Zhaoran Wang , Tuo Zhao , Hongyuan Zha

We study infinite horizon discounted Mean Field Control (MFC) problems with common noise through the lens of Mean Field Markov Decision Processes (MFMDP). We allow the agents to use actions that are randomized not only at the individual…

Optimization and Control · Mathematics 2021-10-14 René Carmona , Mathieu Laurière , Zongjun Tan

We discuss the problem of decentralized multi-agent reinforcement learning (MARL) in this work. In our setting, the global state, action, and reward are assumed to be fully observable, while the local policy is protected as privacy by each…

Multiagent Systems · Computer Science 2021-11-02 Kuo Li , Qing-Shan Jia

This paper seeks to combine differential game theory with the actor-critic-identifier architecture to determine forward-in-time, approximate optimal controllers for formation tracking in multi-agent systems, where the agents have uncertain…

Systems and Control · Computer Science 2017-07-25 Rushikesh Kamalapurkar , Justin R. Klotz , Patrick Walters , Warren E. Dixon

Multi-agent navigation in dynamic environments is of great industrial value when deploying a large scale fleet of robot to real-world applications. This paper proposes a decentralized partially observable multi-agent path planning with…

Robotics · Computer Science 2020-08-03 Zuxin Liu , Baiming Chen , Hongyi Zhou , Guru Koushik , Martial Hebert , Ding Zhao

We develop a new policy gradient and actor-critic algorithm for solving mean-field control problems within a continuous time reinforcement learning setting. Our approach leverages a gradient-based representation of the value function,…

Machine Learning · Statistics 2023-09-11 Huyên Pham , Xavier Warin

Autonomous driving is a multi-agent setting where the host vehicle must apply sophisticated negotiation skills with other road users when overtaking, giving way, merging, taking left and right turns and while pushing ahead in unstructured…

Artificial Intelligence · Computer Science 2016-10-12 Shai Shalev-Shwartz , Shaked Shammah , Amnon Shashua

In this paper, we examine the convergence landscape of multi-agent learning under uncertainty. Specifically, we analyze two stochastic models of regularized learning in continuous games -- one in continuous and one in discrete time with the…

Computer Science and Game Theory · Computer Science 2025-12-10 Kyriakos Lotidis , Panayotis Mertikopoulos , Nicholas Bambos , Jose Blanchet

We consider a Mean Field Games model where the dynamics of the agents is subdiffusive. According to the optimal control interpretation of the problem, we get a system involving fractional time-derivatives for the Hamilton-Jacobi-Bellman and…

Analysis of PDEs · Mathematics 2018-01-23 Fabio Camilli , Raul De Maio

Collaborative autonomous multi-agent systems covering a specified area have many potential applications, such as UAV search and rescue, forest fire fighting, and real-time high-resolution monitoring. Traditional approaches for such coverage…

Robotics · Computer Science 2023-10-17 Xinyu Zhao , Razvan C. Fetecau , Mo Chen

Modern AI systems increasingly operate inside markets and institutions where data, behavior, and incentives are endogenous. This paper develops an economic foundation for multi-agent learning by studying a principal-agent interaction in a…

Machine Learning · Statistics 2026-01-08 Nassim Helou

Deep reinforcement learning offers a model-free alternative to supervised deep learning and classical optimization for solving the transmit power control problem in wireless networks. The multi-agent deep reinforcement learning approach…

Signal Processing · Electrical Eng. & Systems 2020-09-16 Yasar Sinan Nasir , Dongning Guo

Control of multi-agent systems via game theory is investigated. Assume a system level object is given, the utility functions for individual agents are designed to convert a multi-agent system into a potential game. First, for fixed…

Optimization and Control · Mathematics 2016-08-02 Ting Liu , Jinhuan Wang , Daizhan Cheng

We use the recently developed probabilistic analysis of mean field games with finitely many states in the weak formulation, to set-up a principal / agent contract theory model where the principal faces a large population of agents…

Probability · Mathematics 2018-08-27 Rene Carmona , Peiqi Wang