English
Related papers

Related papers: Convergence of Multi-Scale Reinforcement Q-Learnin…

200 papers

Despite the success of single-agent reinforcement learning, multi-agent reinforcement learning (MARL) remains challenging due to complex interactions between agents. Motivated by decentralized applications such as sensor networks, swarm…

Machine Learning · Computer Science 2019-01-10 Hoi-To Wai , Zhuoran Yang , Zhaoran Wang , Mingyi Hong

In this paper, we consider a finite horizon, non-stationary, mean field games (MFG) with a large population of homogeneous players, sequentially making strategic decisions, where each player is affected by other players through an aggregate…

Systems and Control · Electrical Eng. & Systems 2020-04-07 Rajesh K Mishra , Deepanshu Vasal , Sriram Vishwanath

One of the main goals of reinforcement learning (RL) is to provide a~way for physical machines to learn optimal behavior instead of being programmed. However, effective control of the machines usually requires fine time discretization. The…

Machine Learning · Computer Science 2022-07-12 Jakub Łyskawa , Paweł Wawrzyński

Reinforcement learning (RL) commonly relies on scalar rewards with limited ability to express temporal, conditional, or safety-critical goals, and can lead to reward hacking. Temporal logic expressible via the more general class of…

Artificial Intelligence · Computer Science 2025-11-26 Dominik Wagner , Leon Witzman , Luke Ong

Recent years have witnessed significant advances in reinforcement learning (RL), which has registered great success in solving various sequential decision-making problems in machine learning. Most of the successful RL applications, e.g.,…

Machine Learning · Computer Science 2021-04-30 Kaiqing Zhang , Zhuoran Yang , Tamer Başar

Non-stationarity is a fundamental challenge in multi-agent reinforcement learning (MARL), where agents update their behaviour as they learn. Many theoretical advances in MARL avoid the challenge of non-stationarity by coordinating the…

Computer Science and Game Theory · Computer Science 2025-03-19 Bora Yongacoglu , Gürdal Arslan , Serdar Yüksel

In the Lasry--Lions framework, Mean-Field Games (MFGs) model interactions among an infinite number of agents. However, existing algorithms either require strict monotonicity or only guarantee the convergence of averaged iterates, as in…

Computer Science and Game Theory · Computer Science 2025-10-28 Noboru Isobe , Kenshi Abe , Kaito Ariu

We address the numerical solution of second-order Mean Field Game problems through Newton iterations in infinite dimensions, introduced in [14], where quadratic convergence of the method was rigorously established. Building upon this…

Numerical Analysis · Mathematics 2026-03-20 Elisabetta Carlini , Ahmad Zorkot

Reinforcement learning (RL) is one of the most practical ways to learn from real-life use-cases. Motivated from the cognitive methods used by humans makes it a widely acceptable strategy in the field of artificial intelligence. Most of the…

Artificial Intelligence · Computer Science 2026-04-14 Abhishek Sawaika , Samuel Yen-Chi Chen , Udaya Parampalli , Rajkumar Buyya

Counterfactual regret minimization (CFR) is a popular method to deal with decision-making problems of two-player zero-sum games with imperfect information. Unlike existing studies that mostly explore for solving larger scale problems or…

Machine Learning · Computer Science 2020-09-15 Huale Li , Xuan Wang , Fengwei Jia , Yifan Li , Yulin Wu , Jiajia Zhang , Shuhan Qi

In this article we consider finite Mean Field Games (MFGs), i.e. with finite time and finite states. We adopt the framework introduced in Gomes Mohr and Souza in 2010, and study two seemly unexplored subjects. In the first one, we analyze…

Optimization and Control · Mathematics 2018-05-16 Saeed Hadikhanloo , Francisco José Silva

We propose a reinforcement learning algorithm for stationary mean-field games, where the goal is to learn a pair of mean-field state and stationary policy that constitutes the Nash equilibrium. When viewing the mean-field state and the…

Machine Learning · Computer Science 2020-10-12 Qiaomin Xie , Zhuoran Yang , Zhaoran Wang , Andreea Minca

We present a generic and flexible Reinforcement Learning (RL) based meta-learning framework for the problem of few-shot learning. During training, it learns the best optimization algorithm to produce a learner (ranker/classifier, etc) by…

Machine Learning · Computer Science 2020-05-05 Raviteja Anantha , Stephen Pulman , Srinivas Chappidi

This paper is a continuation work of Ren et al. (2026) aiming to further devise q-learning algorithms for mean-field control (MFC) with controlled common noise. Based on the relaxed control formulation, we first establish the martingale…

Optimization and Control · Mathematics 2026-05-01 Zhenjie Ren , Xiaoli Wei , Xiang Yu , Xun Yu Zhou

This paper investigates the control of a massive population of UAVs such as drones. The straightforward method of control of UAVs by considering the interactions among them to make a flock requires a huge inter-UAV communication which is…

Networking and Internet Architecture · Computer Science 2020-08-13 Hamid Shiri , Jihong Park , Mehdi Bennis

In this paper, we propose several approaches to learn the optimal population-dependent controls in order to solve mean field control problems (MFC). Such policies enable us to solve MFC problems with forms of common noises at a level of…

Optimization and Control · Mathematics 2023-11-21 Gokce Dayanikli , Mathieu Lauriere , Jiacheng Zhang

In numerous reinforcement learning (RL) problems involving safety-critical systems, a key challenge lies in balancing multiple objectives while simultaneously meeting all stringent safety constraints. To tackle this issue, we propose a…

Artificial Intelligence · Computer Science 2024-05-28 Shangding Gu , Bilgehan Sel , Yuhao Ding , Lu Wang , Qingwei Lin , Alois Knoll , Ming Jin

Reinforcement learning (RL) is a framework to optimize a control policy using rewards that are revealed by the system as a response to a control action. In its standard form, RL involves a single agent that uses its policy to accomplish a…

Systems and Control · Electrical Eng. & Systems 2021-11-24 Juan Cervino , Juan Andres Bazerque , Miguel Calvo-Fullana , Alejandro Ribeiro

This paper studies the existence and approximation of equilibria for general time-inconsistent mean field game (MFG) problems in continuous time. To handle the intricate nonlocal equilibrium Hamilton-Jacobi-Bellman (EHJB) system arising…

Optimization and Control · Mathematics 2026-05-29 Erhan Bayraktar , Zhenhua Wang , Xiang Yu , Keyu Zhang

Reinforcement learning has been successful both empirically and theoretically in single-agent settings, but extending these results to multi-agent reinforcement learning in general-sum Markov games remains challenging. This paper studies…

Machine Learning · Computer Science 2026-04-07 Narim Jeong , Donghwan Lee