中文
相关论文

相关论文: Offline Multi-Agent Reinforcement Learning with Co…

200 篇论文

Offline goal-conditioned reinforcement learning (GCRL) offers a practical learning paradigm in which goal-reaching policies are trained from abundant state-action trajectory datasets without additional environment interaction. However,…

机器学习 · 计算机科学 2025-11-05 Hongjoon Ahn , Heewoong Choi , Jisu Han , Taesup Moon

In this paper, we propose a distributed off-policy actor critic method to solve multi-agent reinforcement learning problems. Specifically, we assume that all agents keep local estimates of the global optimal policy parameter and update…

机器学习 · 计算机科学 2019-03-25 Yan Zhang , Michael M. Zavlanos

Meta-reinforcement learning (RL) methods can meta-train policies that adapt to new tasks with orders of magnitude less data than standard RL, but meta-training itself is costly and time-consuming. If we can meta-train on offline data, then…

机器学习 · 计算机科学 2022-07-08 Vitchyr H. Pong , Ashvin Nair , Laura Smith , Catherine Huang , Sergey Levine

Offline reinforcement learning (RL) presents an attractive paradigm for training intelligent agents without expensive online interactions. However, current approaches still struggle with complex, long-horizon sequential decision making. In…

机器学习 · 计算机科学 2025-10-10 Changyeon Kim , Haeone Lee , Younggyo Seo , Kimin Lee , Yuke Zhu

Many real world tasks require multiple agents to work together. Multi-agent reinforcement learning (RL) methods have been proposed in recent years to solve these tasks, but current methods often fail to efficiently learn policies. We thus…

机器学习 · 计算机科学 2019-12-03 Johannes Ackermann , Volker Gabler , Takayuki Osa , Masashi Sugiyama

Offline reinforcement learning (RL) learns policies from a fixed dataset, but often requires large amounts of data. The challenge arises when labeled datasets are expensive, especially when rewards have to be provided by human labelers for…

机器学习 · 计算机科学 2025-05-30 Yen-Ru Lai , Fu-Chieh Chang , Pei-Yuan Wu

The alignment of Multi-Agent Systems (MAS) for autonomous software engineering is constrained by evaluator epistemic uncertainty. Current paradigms, such as Reinforcement Learning from Human Feedback (RLHF) and AI Feedback (RLAIF),…

人工智能 · 计算机科学 2026-04-14 Kun Liu , Liqun Chen

Offline reinforcement learning (offline RL) offers a promising framework for developing control strategies in chemical process systems using historical data, without the risks or costs of online experimentation. This work investigates the…

系统与控制 · 电气工程与系统科学 2025-07-31 Alex Durkin , Jasper Stolte , Matthew Jones , Raghuraman Pitchumani , Bei Li , Christian Michler , Mehmet Mercangöz

Training practical agents usually involve offline and online reinforcement learning (RL) to balance the policy's performance and interaction costs. In particular, online fine-tuning has become a commonly used method to correct the erroneous…

机器学习 · 计算机科学 2023-06-07 Qisen Yang , Shenzhi Wang , Matthieu Gaetan Lin , Shiji Song , Gao Huang

Reinforcement learning (RL) is a powerful machine learning technique that enables an intelligent agent to learn an optimal policy that maximizes the cumulative rewards in sequential decision making. Most of methods in the existing…

机器学习 · 统计学 2023-01-06 Chengchun Shi , Zhengling Qi , Jianing Wang , Fan Zhou

Offline reinforcement learning (RL) holds promise as a means to learn high-reward policies from a static dataset, without the need for further environment interactions. However, a key challenge in offline RL lies in effectively stitching…

机器学习 · 计算机科学 2023-09-14 Siddarth Venkatraman , Shivesh Khaitan , Ravi Tej Akella , John Dolan , Jeff Schneider , Glen Berseth

Offline reinforcement learning (RL) aims to learn an optimal policy from pre-collected data. However, it faces challenges of distributional shift, where the learned policy may encounter unseen scenarios not covered in the offline data.…

机器学习 · 计算机科学 2025-05-27 Jin Zhu , Xin Zhou , Jiaang Yao , Gholamali Aminian , Omar Rivasplata , Simon Little , Lexin Li , Chengchun Shi

Multi-agent reinforcement learning tasks put a high demand on the volume of training samples. Different from its single-agent counterpart, distributed value-based multi-agent reinforcement learning faces the unique challenges of demanding…

机器学习 · 计算机科学 2021-12-06 Siyang Wu , Tonghan Wang , Chenghao Li , Yang Hu , Chongjie Zhang

Model-based methods have recently shown promising for offline reinforcement learning (RL), aiming to learn good policies from historical data without interacting with the environment. Previous model-based offline RL methods learn fully…

机器学习 · 计算机科学 2022-06-06 Zheng-Mao Zhu , Xiong-Hui Chen , Hong-Long Tian , Kun Zhang , Yang Yu

Offline Reinforcement Learning (ORL) offers a robust solution to training agents in applications where interactions with the environment must be strictly limited due to cost, safety, or lack of accurate simulation environments. Despite its…

机器学习 · 计算机科学 2024-07-16 Carlo Romeo , Andrew D. Bagdanov

Offline multi-agent reinforcement learning (MARL) aims to solve cooperative decision-making problems in multi-agent systems using pre-collected datasets. Existing offline MARL methods primarily constrain training within the dataset…

人工智能 · 计算机科学 2026-03-01 Sijia Li , Xinran Li , Shibo Chen , Jun Zhang

Offline reinforcement learning (RL) is challenged by the distributional shift between learning policies and datasets. To address this problem, existing works mainly focus on designing sophisticated algorithms to explicitly or implicitly…

机器学习 · 计算机科学 2022-10-18 Yang Yue , Bingyi Kang , Xiao Ma , Zhongwen Xu , Gao Huang , Shuicheng Yan

With the widespread adoption of deep learning, reinforcement learning (RL) has experienced a dramatic increase in popularity, scaling to previously intractable problems, such as playing complex games from pixel observations, sustaining…

机器学习 · 计算机科学 2023-04-20 Rafael Figueiredo Prudencio , Marcos R. O. A. Maximo , Esther Luna Colombini

Reliant on too many experiments to learn good actions, current Reinforcement Learning (RL) algorithms have limited applicability in real-world settings, which can be too expensive to allow exploration. We propose an algorithm for batch RL,…

机器学习 · 计算机科学 2021-12-07 Rasool Fakoor , Jonas Mueller , Kavosh Asadi , Pratik Chaudhari , Alexander J. Smola

In fully cooperative multi-agent reinforcement learning (MARL) settings, the environments are highly stochastic due to the partial observability of each agent and the continuously changing policies of the other agents. To address the above…

多智能体系统 · 计算机科学 2021-12-23 Wei-Fang Sun , Cheng-Kuang Lee , Chun-Yi Lee