中文
相关论文

相关论文: Solving Continuous Control via Q-learning

200 篇论文

We propose Q-learning with Adjoint Matching (QAM), a novel TD-based reinforcement learning (RL) algorithm that tackles a long-standing challenge in continuous-action RL: efficient optimization of an expressive diffusion or flow-matching…

机器学习 · 计算机科学 2026-05-20 Qiyang Li , Sergey Levine

Multi-agent reinforcement learning (MARL) is a powerful paradigm for solving cooperative and competitive decision-making problems. While many MARL benchmarks have been proposed, few combine continuous state and action spaces with…

人工智能 · 计算机科学 2025-11-18 Artem Pshenitsyn , Aleksandr Panov , Alexey Skrynnik

Cooperative multi-agent reinforcement learning (MARL) aims to develop agents that can collaborate effectively. However, most cooperative MARL methods overfit training agents, making learned policies not generalize well to unseen…

人工智能 · 计算机科学 2025-01-13 Kanefumi Matsuyama , Kefan Su , Jiangxing Wang , Deheng Ye , Zongqing Lu

Fast and efficient transport protocols are the foundation of an increasingly distributed world. The burden of continuously delivering improved communication performance to support next-generation applications and services, combined with the…

机器学习 · 计算机科学 2023-06-27 Raffaele Galliera , Alessandro Morelli , Roberto Fronteddu , Niranjan Suri

Decentralized Actor-Critic (AC) algorithms have been widely utilized for multi-agent reinforcement learning (MARL) and have achieved remarkable success. Apart from its empirical success, the theoretical convergence property of decentralized…

机器学习 · 计算机科学 2023-01-31 Qijun Luo , Xiao Li

This paper serves to introduce the reader to the field of multi-agent reinforcement learning (MARL) and its intersection with methods from the study of causality. We highlight key challenges in MARL and discuss these in the context of how…

机器学习 · 计算机科学 2021-12-02 St John Grimbly , Jonathan Shock , Arnu Pretorius

Centralized training with decentralized execution has become an important paradigm in multi-agent learning. Though practical, current methods rely on restrictive assumptions to decompose the centralized value function across agents for…

机器学习 · 计算机科学 2020-06-11 Yaodong Yang , Ying Wen , Liheng Chen , Jun Wang , Kun Shao , David Mguni , Weinan Zhang

Categorical Distributional Reinforcement Learning (CDRL) has demonstrated superior sample efficiency in learning complex tasks compared to conventional Reinforcement Learning (RL) approaches. However, the practical application of CDRL is…

机器学习 · 计算机科学 2025-02-07 David Valencia , Henry Williams , Yuning Xing , Trevor Gee , Bruce A MacDonald , Minas Liarokapis

This paper studies the q-learning, recently coined as the continuous time counterpart of Q-learning by Jia and Zhou (2023), for continuous time Mckean-Vlasov control problems in the setting of entropy-regularized reinforcement learning. In…

机器学习 · 计算机科学 2024-11-04 Xiaoli Wei , Xiang Yu

Multi-agent adversarial inverse reinforcement learning (MA-AIRL) is a recent approach that applies single-agent AIRL to multi-agent problems where we seek to recover both policies for our agents and reward functions that promote expert-like…

多智能体系统 · 计算机科学 2020-02-26 Wonseok Jeon , Paul Barde , Derek Nowrouzezahrai , Joelle Pineau

Multi-agent deep reinforcement learning (MARL) suffers from a lack of commonly-used evaluation tasks and criteria, making comparisons between approaches difficult. In this work, we provide a systematic evaluation and comparison of three…

机器学习 · 计算机科学 2021-11-10 Georgios Papoudakis , Filippos Christianos , Lukas Schäfer , Stefano V. Albrecht

Agent faults pose a significant threat to the performance of multi-agent reinforcement learning (MARL) algorithms, introducing two key challenges. First, agents often struggle to extract critical information from the chaotic state space…

机器学习 · 计算机科学 2024-12-03 Yuchen Shi , Huaxin Pei , Liang Feng , Yi Zhang , Danya Yao

Multi-agent Reinforcement learning (MARL) studies the behaviour of multiple learning agents that coexist in a shared environment. MARL is more challenging than single-agent RL because it involves more complex learning dynamics: the…

人工智能 · 计算机科学 2023-04-26 Roger Creus Castanyer

Deep reinforcement learning (RL) algorithms can use high-capacity deep networks to learn directly from image observations. However, these high-dimensional observation spaces present a number of challenges in practice, since the policy must…

机器学习 · 计算机科学 2020-10-27 Alex X. Lee , Anusha Nagabandi , Pieter Abbeel , Sergey Levine

Motivated by the recent applications of game-theoretical learning techniques to the design of distributed control systems, we study a class of control problems that can be formulated as potential games with continuous action sets, and we…

最优化与控制 · 数学 2014-12-03 Steven Perkins , Panayotis Mertikopoulos , David S. Leslie

As a data-driven approach, offline MARL learns superior policies solely from offline datasets, ideal for domains rich in historical data but with high interaction costs and risks. However, most existing methods are task-specific, requiring…

机器学习 · 计算机科学 2025-09-29 Xun Wang , Zhuoran Li , Hai Zhong , Longbo Huang

This paper proposes a novel method to improve locomotion learning for a single quadruped robot using multi-agent deep reinforcement learning (MARL). Many existing methods use single-agent reinforcement learning for an individual robot or…

机器人学 · 计算机科学 2024-10-18 Qi Liu , Jingxiang Guo , Sixu Lin , Shuaikang Ma , Jinxuan Zhu , Yanjie Li

Actor-critic methods constitute a central paradigm in reinforcement learning (RL), coupling policy evaluation with policy improvement. While effective across many domains, these methods rely on separate actor and critic networks, which…

机器学习 · 计算机科学 2025-09-26 Donghyeon Ki , Hee-Jun Ahn , Kyungyoon Kim , Byung-Jun Lee

Offline cooperative multi-agent reinforcement learning (MARL) faces unique challenges due to distributional shifts, particularly stemming from the high dimensionality of joint action spaces and the presence of out-of-distribution joint…

机器学习 · 计算机科学 2026-05-29 Dan Qiao , Wenhao Li , Shanchao Yang , Hongyuan Zha , Baoxiang Wang

Reinforcement Learning (RL) has emerged as a crucial method for training or fine-tuning large language models (LLMs), enabling adaptive, task-specific optimizations through interactive feedback. Multi-Agent Reinforcement Learning (MARL), in…

机器学习 · 计算机科学 2026-02-10 Junwei Su , Chuan Wu