English
Related papers

Related papers: Mean-Field Reinforcement Learning without Synchron…

200 papers

Meta-reinforcement learning (meta-RL) is a promising approach that enables the agent to learn new tasks quickly. However, most meta-RL algorithms show poor generalization in multi-task scenarios due to the insufficient task information…

Artificial Intelligence · Computer Science 2023-07-06 Xiangtong Yao , Zhenshan Bing , Genghang Zhuang , Kejia Chen , Hongkuan Zhou , Kai Huang , Alois Knoll

Reinforcement learning (RL) allows to solve complex tasks such as Go often with a stronger performance than humans. However, the learned behaviors are usually fixed to specific tasks and unable to adapt to different contexts. Here we…

Machine Learning · Computer Science 2020-04-21 Chris Reinke

Mean-field analysis is an important tool for understanding dynamics on complex networks. However, surprisingly little attention has been paid to the question of whether mean-field predictions are accurate, and this is particularly true for…

Physics and Society · Physics 2015-03-17 James P. Gleeson , Sergey Melnik , Jonathan A. Ward , Mason A. Porter , Peter J. Mucha

Reinforcement Learning (RL) enables an intelligent agent to optimise its performance in a task by continuously taking action from an observed state and receiving a feedback from the environment in form of rewards. RL typically uses tables…

Artificial Intelligence · Computer Science 2025-01-28 Alberto Castagna

Mean-field games (MFG) provide a statistical physics inspired modeling framework for decision making in large-populations of strategic, non-cooperative agents. Mathematically, these systems consist of a forward-backward in time system of…

Dynamical Systems · Mathematics 2024-05-10 Ali Akbar Rezaei Lori , Piyush Grover

The mean field games (MFG) paradigm was introduced to provide tractable approximations of games involving very large populations. The theory typically rests on two key assumptions: homogeneity, meaning that all players share the same…

Optimization and Control · Mathematics 2025-11-10 Mathieu Laurière

Many tasks in human environments require performing a sequence of navigation and manipulation steps involving objects. In unstructured human environments, the location and configuration of the objects involved often change in unpredictable…

Robotics · Computer Science 2015-04-14 Jaeyong Sung , Bart Selman , Ashutosh Saxena

Meta reinforcement learning (meta RL), as a combination of meta-learning ideas and reinforcement learning (RL), enables the agent to adapt to different tasks using a few samples. However, this sampling-based adaptation also makes meta RL…

Machine Learning · Computer Science 2023-03-09 Tao Li , Haozhe Lei , Quanyan Zhu

Reinforcement Learning (RL) agents deployed in real-world environments face degradation from sensor faults, actuator wear, and environmental shifts, yet lack intrinsic mechanisms to detect and diagnose these failures. We present an…

Artificial Intelligence · Computer Science 2025-09-15 Cameron Reid , Wael Hafez , Amirhossein Nazeri

The intersection of Mean Field Games (MFGs) and Reinforcement Learning (RL) has fostered a growing family of algorithms designed to solve large-scale multi-agent systems. However, the field currently lacks a standardized evaluation…

Machine Learning · Computer Science 2026-02-16 Lorenzo Magnino , Jiacheng Shen , Matthieu Geist , Olivier Pietquin , Mathieu Laurière

This study proposes the use of a social learning method to estimate a global state within a multi-agent off-policy actor-critic algorithm for reinforcement learning (RL) operating in a partially observable environment. We assume that the…

Machine Learning · Computer Science 2024-07-09 Ainur Zhaikhan , Ali H. Sayed

Consider mutli-goal tasks that involve static environments and dynamic goals. Examples of such tasks, such as goal-directed navigation and pick-and-place in robotics, abound. Two types of Reinforcement Learning (RL) algorithms are used for…

Machine Learning · Computer Science 2019-01-08 Vikas Dhiman , Shurjo Banerjee , Jeffrey M. Siskind , Jason J. Corso

Mean Field Game (MFG) models implicitly assume "rational expectations", meaning that the heterogeneous agents being modeled correctly know all relevant transition probabilities for the complex system they inhabit. When there is common…

Analysis of PDEs · Mathematics 2026-02-26 Benjamin Moll , Lenya Ryzhik

The framework of Mean-field Games (MFGs) is used for modelling the collective dynamics of large populations of non-cooperative decision-making agents. We formulate and analyze a kinetic MFG model for an interacting system of non-cooperative…

Optimization and Control · Mathematics 2024-07-29 Piyush Grover , Mandy Huo

We investigate a paradigm in multi-task reinforcement learning (MT-RL) in which an agent is placed in an environment and needs to learn to perform a series of tasks, within this space. Since the environment does not change, there is…

Artificial Intelligence · Computer Science 2016-03-08 Diana Borsa , Thore Graepel , John Shawe-Taylor

Recent advances in multiagent learning have seen the introduction ofa family of algorithms that revolve around the population-based trainingmethod PSRO, showing convergence to Nash, correlated and coarse corre-lated equilibria. Notably,…

Computer Science and Game Theory · Computer Science 2022-08-30 Paul Muller , Mark Rowland , Romuald Elie , Georgios Piliouras , Julien Perolat , Mathieu Lauriere , Raphael Marinier , Olivier Pietquin , Karl Tuyls

Transfer Learning has shown great potential to enhance single-agent Reinforcement Learning (RL) efficiency. Similarly, Multiagent RL (MARL) can also be accelerated if agents can share knowledge with each other. However, it remains a problem…

We propose a single-level numerical approach to solve Stackelberg mean field game (MFG) problems. In Stackelberg MFG, an infinite population of agents play a non-cooperative game and choose their controls to optimize their individual…

Optimization and Control · Mathematics 2024-04-24 Gokce Dayanikli , Mathieu Lauriere

Interference among concurrent transmissions in a wireless network is a key factor limiting the system performance. One way to alleviate this problem is to manage the radio resources in order to maximize either the average or the worst-case…

Machine Learning · Computer Science 2019-06-24 Navid Naderializadeh , Jaroslaw Sydir , Meryem Simsek , Hosein Nikopour , Shilpa Talwar

In this paper, we introduce a natural learning rule for mean field games with finite state and action space, the so-called myopic adjustment process. The main motivation for these considerations are the complex computations necessary to…

Optimization and Control · Mathematics 2020-09-01 Berenice Anne Neumann