中文
相关论文

相关论文: Mean-Field Controls with Q-learning for Cooperativ…

200 篇论文

Multi-agent reinforcement learning (MARL) under partial observability has long been considered challenging, primarily due to the requirement for each agent to maintain a belief over all other agents' local histories -- a domain that…

人工智能 · 计算机科学 2020-08-18 Weichao Mao , Kaiqing Zhang , Erik Miehling , Tamer Başar

Multi-agent reinforcement learning (MARL) provides a framework for problems involving multiple interacting agents. Despite apparent similarity to the single-agent case, multi-agent problems are often harder to train and analyze…

机器学习 · 计算机科学 2024-04-04 Michał Zawalski , Błażej Osiński , Henryk Michalewski , Piotr Miłoś

Concave Utility Reinforcement Learning (CURL) extends RL from linear to concave utilities in the occupancy measure induced by the agent's policy. This encompasses not only RL but also imitation learning and exploration, among others. Yet,…

The exploration-exploitation dilemma has been a central challenge in reinforcement learning (RL) with complex model classes. In this paper, we propose a new algorithm, Monotonic Q-Learning with Upper Confidence Bound (MQL-UCB) for RL with…

机器学习 · 计算机科学 2025-10-06 Heyang Zhao , Jiafan He , Quanquan Gu

Model-free approaches for reinforcement learning (RL) and continuous control find policies based only on past states and rewards, without fitting a model of the system dynamics. They are appealing as they are general purpose and easy to…

机器学习 · 计算机科学 2018-10-09 Yasin Abbasi-Yadkori , Nevena Lazic , Csaba Szepesvari

Reinforcement learning (RL) promises a framework for near-universal problem-solving. In practice however, RL algorithms are often tailored to specific benchmarks, relying on carefully tuned hyperparameters and algorithmic choices. Recently,…

机器学习 · 计算机科学 2025-01-28 Scott Fujimoto , Pierluca D'Oro , Amy Zhang , Yuandong Tian , Michael Rabbat

We investigate the global numerical approximation of a class of extended mean field control problems (MFC), where the dynamics and costs depend on the joint distribution of the state and the control. We propose a framework to approximate…

最优化与控制 · 数学 2026-03-23 Athena Picarelli , Marco Scaratti , Jonathan Tam

This paper studies the q-learning, recently coined as the continuous time counterpart of Q-learning by Jia and Zhou (2023), for continuous time Mckean-Vlasov control problems in the setting of entropy-regularized reinforcement learning. In…

机器学习 · 计算机科学 2024-11-04 Xiaoli Wei , Xiang Yu

In this paper, we study the problem of robust cooperative multi-agent reinforcement learning (RL) where a large number of cooperative agents with distributed information aim to learn policies in the presence of \emph{stochastic} and…

多智能体系统 · 计算机科学 2025-06-16 Muhammad Aneeq uz Zaman , Mathieu Laurière , Alec Koppel , Tamer Başar

Model-free reinforcement learning has been successfully applied to a range of challenging problems, and has recently been extended to handle large neural network policies and value functions. However, the sample complexity of model-free…

机器学习 · 计算机科学 2016-03-03 Shixiang Gu , Timothy Lillicrap , Ilya Sutskever , Sergey Levine

Cooperative multi-agent reinforcement learning (MARL) benchmarks commonly emphasize aggregate outcomes such as return, success rate, or completion time. While essential, these metrics often fail to reveal how agents coordinate, particularly…

多智能体系统 · 计算机科学 2026-05-08 Maria Ana Cardei , Matthew Landers , Afsaneh Doryab

To achieve general intelligence, agents must learn how to interact with others in a shared environment: this is the challenge of multiagent reinforcement learning (MARL). The simplest form is independent reinforcement learning (InRL), where…

Reinforcement learning (RL) is a promising data-driven approach for adaptive traffic signal control (ATSC) in complex urban traffic networks, and deep neural networks further enhance its learning power. However, centralized RL is infeasible…

机器学习 · 计算机科学 2019-03-13 Tianshu Chu , Jie Wang , Lara Codecà , Zhaojian Li

Connected and automated vehicles (CAVs) are considered a potential solution for future transportation challenges, aiming to develop systems that are efficient, safe, and environmentally friendly. However, CAV control presents significant…

机器人学 · 计算机科学 2024-10-22 Min Hua , Dong Chen , Xinda Qi , Kun Jiang , Zemin Eitan Liu , Quan Zhou , Hongming Xu

This paper investigates the use of multi-agent reinforcement learning (MARL) to address distributed channel access in wireless local area networks. In particular, we consider the challenging yet more practical case where the agents…

机器学习 · 计算机科学 2025-06-13 Jiaming Yu , Le Liang , Chongtao Guo , Ziyang Guo , Shi Jin , Geoffrey Ye Li

This paper presents a multi-agent reinforcement learning (MARL) framework for cooperative collision avoidance of UAV swarms leveraging domain knowledge-driven reward. The reward is derived from knowledge in the domain of image processing,…

多智能体系统 · 计算机科学 2025-07-16 Shuangyao Huang , Haibo Zhang , Zhiyi Huang

Federated learning (FL) is a training technique that enables client devices to jointly learn a shared model by aggregating locally-computed models without exposing their raw data. While most of the existing work focuses on improving the FL…

机器学习 · 计算机科学 2022-01-11 Sai Qian Zhang , Jieyu Lin , Qi Zhang

It has long been recognized that multi-agent reinforcement learning (MARL) faces significant scalability issues due to the fact that the size of the state and action spaces are exponentially large in the number of agents. In this paper, we…

最优化与控制 · 数学 2020-06-12 Guannan Qu , Yiheng Lin , Adam Wierman , Na Li

We study multi-agent reinforcement learning in the setting of episodic Markov decision processes, where multiple agents cooperate via communication through a central server. We propose a provably efficient algorithm based on value iteration…

机器学习 · 计算机科学 2023-06-27 Yifei Min , Jiafan He , Tianhao Wang , Quanquan Gu

A fundamental question in any peer-to-peer ridesharing system is how to, both effectively and efficiently, dispatch user's ride requests to the right driver in real time. Traditional rule-based solutions usually work on a simplified problem…

多智能体系统 · 计算机科学 2019-02-01 Minne Li , Zhiwei , Qin , Yan Jiao , Yaodong Yang , Zhichen Gong , Jun Wang , Chenxi Wang , Guobin Wu , Jieping Ye