中文
相关论文

相关论文: Learning Partial Action Replacement in Offline MAR…

200 篇论文

In this paper, we introduce an alternative approach to enhancing Multi-Agent Reinforcement Learning (MARL) through the integration of domain knowledge and attention-based policy mechanisms. Our methodology focuses on the incorporation of…

机器学习 · 计算机科学 2025-04-04 Andre R Kuroswiski , Annie S Wu , Angelo Passaro

One of the main challenges in offline Reinforcement Learning (RL) is the distribution shift that arises from the learned policy deviating from the data collection policy. This is often addressed by avoiding out-of-distribution (OOD) actions…

机器学习 · 计算机科学 2023-11-07 Daiki E. Matsunaga , Jongmin Lee , Jaeseok Yoon , Stefanos Leonardos , Pieter Abbeel , Kee-Eung Kim

Although Multi-Agent Reinforcement Learning (MARL) is effective for complex multi-robot tasks, it suffers from low sample efficiency and requires iterative manual reward tuning. Large Language Models (LLMs) have shown promise in…

机器人学 · 计算机科学 2025-06-04 Guobin Zhu , Rui Zhou , Wenkang Ji , Shiyu Zhao

Training multiple agents to coordinate is an essential problem with applications in robotics, game theory, economics, and social sciences. However, most existing Multi-Agent Reinforcement Learning (MARL) methods are online and thus…

机器学习 · 计算机科学 2024-01-19 Paul Barde , Jakob Foerster , Derek Nowrouzezahrai , Amy Zhang

Reinforcement learning with offline data suffers from Q-value extrapolation errors. To address this issue, we first demonstrate that linear extrapolation of the Q-function beyond the data range is particularly problematic. To mitigate this,…

We study the scalable multi-agent reinforcement learning (MARL) with general utilities, defined as nonlinear functions of the team's long-term state-action occupancy measure. The objective is to find a localized policy that maximizes the…

机器学习 · 计算机科学 2023-08-29 Donghao Ying , Yuhao Ding , Alec Koppel , Javad Lavaei

In offline multi-agent reinforcement learning (MARL), agents estimate policies from a given dataset. We study reward-poisoning attacks in this setting where an exogenous attacker modifies the rewards in the dataset before the agents see the…

机器学习 · 计算机科学 2023-03-09 Young Wu , Jeremy McMahan , Xiaojin Zhu , Qiaomin Xie

One of the challenges for multi-agent reinforcement learning (MARL) is designing efficient learning algorithms for a large system in which each agent has only limited or partial information of the entire system. While exciting progress has…

机器学习 · 计算机科学 2022-02-22 Haotian Gu , Xin Guo , Xiaoli Wei , Renyuan Xu

Offline reinforcement learning (RL) optimizes the policy on a previously collected dataset without any interactions with the environment, yet usually suffers from the distributional shift problem. To mitigate this issue, a typical solution…

机器学习 · 计算机科学 2023-09-06 Qisen Yang , Shenzhi Wang , Qihang Zhang , Gao Huang , Shiji Song

Effectively leveraging large, previously collected datasets in reinforcement learning (RL) is a key challenge for large-scale real-world applications. Offline RL algorithms promise to learn effective policies from previously-collected,…

机器学习 · 计算机科学 2020-08-20 Aviral Kumar , Aurick Zhou , George Tucker , Sergey Levine

This study investigates how Multi-Agent Reinforcement Learning (MARL) can improve dynamic pricing strategies in supply chains, particularly in contexts where traditional ERP systems rely on static, rule-based approaches that overlook…

机器学习 · 计算机科学 2025-07-04 Thomas Hazenberg , Yao Ma , Seyed Sahand Mohammadi Ziabari , Marijn van Rijswijk

Multi-agent reinforcement learning (MARL) has emerged as a useful approach to solving decentralised decision-making problems at scale. Research in the field has been growing steadily with many breakthrough algorithms proposed in recent…

机器学习 · 计算机科学 2022-09-22 Rihab Gorsane , Omayma Mahjoub , Ruan de Kock , Roland Dubb , Siddarth Singh , Arnu Pretorius

A key problem in off-policy Reinforcement Learning (RL) is the mismatch, or distribution shift, between the dataset and the distribution over states and actions visited by the learned policy. This problem is exacerbated in the fully offline…

机器学习 · 计算机科学 2023-11-28 Melrose Roderick , Gaurav Manek , Felix Berkenkamp , J. Zico Kolter

The teleoperated driving (TD) scenario comes with stringent Quality of Service (QoS) communication constraints, especially in terms of end-to-end (E2E) latency and reliability. In this context, Predictive Quality of Service (PQoS), possibly…

网络与互联网体系结构 · 计算机科学 2025-05-07 Giacomo Avanzi , Marco Giordani , Michele Zorzi

Learning anticipation in Multi-Agent Reinforcement Learning (MARL) is a reasoning paradigm where agents anticipate the learning steps of other agents to improve cooperation among themselves. As MARL uses gradient-based optimization,…

多智能体系统 · 计算机科学 2023-04-05 Ariyan Bighashdel , Daan de Geus , Pavol Jancura , Gijs Dubbelman

Multi-agent formation as well as obstacle avoidance is one of the most actively studied topics in the field of multi-agent systems. Although some classic controllers like model predictive control (MPC) and fuzzy control achieve a certain…

系统与控制 · 电气工程与系统科学 2021-11-16 Yuzi Yan , Xiaoxiang Li , Xinyou Qiu , Jiantao Qiu , Jian Wang , Yu Wang , Yuan Shen

In Reinforcement Learning (RL), agents have no incentive to exhibit predictable behaviors, and are often pushed (through e.g. policy entropy regularisation) to randomise their actions in favor of exploration. This often makes it challenging…

机器学习 · 计算机科学 2025-06-04 Daniel Jarne Ornia , Giannis Delimpaltadakis , Jens Kober , Javier Alonso-Mora

Mean-Field Control (MFC) has recently been proven to be a scalable tool to approximately solve large-scale multi-agent reinforcement learning (MARL) problems. However, these studies are typically limited to unconstrained cumulative reward…

机器学习 · 计算机科学 2024-09-11 Washim Uddin Mondal , Vaneet Aggarwal , Satish V. Ukkusuri

Multi-agent reinforcement learning (MARL) has received increasing attention for its applications in various domains. Researchers have paid much attention on its partially observable and cooperative settings for meeting real-world…

多智能体系统 · 计算机科学 2021-12-08 Meng Yao , Qiyue Yin , Jun Yang , Tongtong Yu , Shengqi Shen , Junge Zhang , Bin Liang , Kaiqi Huang

When learning a task as a team, some agents in Multi-Agent Reinforcement Learning (MARL) may fail to understand their true impact in the performance of the team. Such agents end up learning sub-optimal policies, demonstrating undesired lazy…

人工智能 · 计算机科学 2023-03-28 Rafael Pina , Varuna De Silva , Corentin Artaud