中文
相关论文

相关论文: ComaDICE: Offline Cooperative Multi-Agent Reinforc…

200 篇论文

Enhancing diverse human decision-making processes in an urban environment is a critical issue across various applications, including ride-sharing vehicle dispatching, public transportation management, and autonomous driving. Offline…

机器学习 · 计算机科学 2024-06-21 Xinbo Zhao , Yingxue Zhang , Xin Zhang , Yu Yang , Yiqun Xie , Yanhua Li , Jun Luo

Offline reinforcement learning (RL) aims to learn policies from pre-existing datasets without further interactions, making it a challenging task. Q-learning algorithms struggle with extrapolation errors in offline settings, while supervised…

人工智能 · 计算机科学 2025-01-03 Zhengbang Zhu , Minghuan Liu , Liyuan Mao , Bingyi Kang , Minkai Xu , Yong Yu , Stefano Ermon , Weinan Zhang

Offline reinforcement learning (RL) refers to the problem of learning policies from a static dataset of environment interactions. Offline RL enables extensive use and re-use of historical datasets, while also alleviating safety concerns…

机器学习 · 计算机科学 2020-12-22 Rafael Rafailov , Tianhe Yu , Aravind Rajeswaran , Chelsea Finn

Multi-agent reinforcement learning (MARL) provides a framework for problems involving multiple interacting agents. Despite apparent similarity to the single-agent case, multi-agent problems are often harder to train and analyze…

机器学习 · 计算机科学 2024-04-04 Michał Zawalski , Błażej Osiński , Henryk Michalewski , Piotr Miłoś

This work leverages adaptive social learning to estimate partially observable global states in multi-agent reinforcement learning (MARL) problems. Unlike existing methods, the proposed approach enables the concurrent operation of social…

多智能体系统 · 计算机科学 2025-08-11 Ainur Zhaikhan , Malek Khammassi , Ali H. Sayed

Offline reinforcement learning (RL) aims to learn an optimal policy from a static dataset, making it particularly valuable in scenarios where data collection is costly, such as robotics. A major challenge in offline RL is distributional…

机器学习 · 计算机科学 2025-07-16 Motoki Omura , Yusuke Mukuta , Kazuki Ota , Takayuki Osa , Tatsuya Harada

Offline reinforcement learning (RL) suffers from the distribution shift between the offline dataset and the online environment. In multi-agent RL (MARL), this distribution shift may arise from the nonstationary opponents in the online…

机器学习 · 计算机科学 2025-02-25 Tao Li , Juan Guevara , Xinhong Xie , Quanyan Zhu

We study off-dynamics offline reinforcement learning, where the goal is to learn a policy from offline source and limited target datasets with mismatched dynamics. Existing methods either penalize the reward or discard source transitions…

机器学习 · 计算机科学 2026-03-19 Yihong Guo , Yu Yang , Pan Xu , Anqi Liu

End-to-end learning robotic manipulation with high data efficiency is one of the key challenges in robotics. The latest methods that utilize human demonstration data and unsupervised representation learning has proven to be a promising…

机器人学 · 计算机科学 2021-10-22 Jin Li , Xianyuan Zhan , Zixu Xiao , Guyue Zhou

Current Reinforcement Learning (RL) is often limited by the large amount of data needed to learn a successful policy. Offline RL aims to solve this issue by using transitions collected by a different behavior policy. We address a novel…

机器学习 · 计算机科学 2024-05-29 Johannes Ackermann , Takayuki Osa , Masashi Sugiyama

Offline multi-agent reinforcement learning (MARL) is severely hampered by the challenge of evaluating out-of-distribution (OOD) joint actions. Our core finding is that when the behavior policy is factorized - a common scenario where agents…

机器学习 · 计算机科学 2025-11-12 Yue Jin , Giovanni Montana

Sample efficiency and exploration remain critical challenges in Deep Reinforcement Learning (DRL), particularly in complex domains. Offline RL, which enables agents to learn optimal policies from static, pre-collected datasets, has emerged…

机器学习 · 计算机科学 2025-12-23 Gaurav Chaudhary , Wassim Uddin Mondal , Laxmidhar Behera

Inspired by the recent successes of Inverse Optimization (IO) across various application domains, we propose a novel offline Reinforcement Learning (ORL) algorithm for continuous state and action spaces, leveraging the convex loss function…

机器学习 · 计算机科学 2026-03-19 Ioannis Dimanidis , Tolga Ok , Peyman Mohajerin Esfahani

Offline multi-agent reinforcement learning (MARL) aims to solve cooperative decision-making problems in multi-agent systems using pre-collected datasets. Existing offline MARL methods primarily constrain training within the dataset…

人工智能 · 计算机科学 2026-03-01 Sijia Li , Xinran Li , Shibo Chen , Jun Zhang

Distribution shift in imitation learning refers to the problem that the agent cannot plan proper actions for a state that has not been visited during the training. This problem can be largely attributed to the inherently narrow state-action…

机器人学 · 计算机科学 2026-05-26 Hyung-Suk Yoon , Seung-Woo Seo

Offline Reinforcement Learning (RL) is structured to derive policies from static trajectory data without requiring real-time environment interactions. Recent studies have shown the feasibility of framing offline RL as a sequence modeling…

机器学习 · 计算机科学 2023-09-01 Abdelghani Ghanem , Philippe Ciblat , Mounir Ghogho

To obtain a near-optimal policy with fewer interactions in Reinforcement Learning (RL), a promising approach involves the combination of offline RL, which enhances sample efficiency by leveraging offline datasets, and online RL, which…

机器学习 · 计算机科学 2024-11-18 Xiaoyu Wen , Xudong Yu , Rui Yang , Haoyuan Chen , Chenjia Bai , Zhen Wang

The Intelligent Transportation System (ITS) environment is known to be dynamic and distributed, where participants (vehicle users, operators, etc.) have multiple, changing and possibly conflicting objectives. Although Reinforcement Learning…

机器学习 · 计算机科学 2024-03-19 Jing Tan , Ramin Khalili , Holger Karl

Online interactions with the environment to collect data samples for training a Reinforcement Learning (RL) agent is not always feasible due to economic and safety concerns. The goal of Offline Reinforcement Learning is to address this…

机器学习 · 计算机科学 2021-10-05 Chi Zhang , Sanmukh Rao Kuppannagari , Viktor K Prasanna

In offline reinforcement learning (RL), we seek to utilize offline data to evaluate (or learn) policies in scenarios where the data are collected from a distribution that substantially differs from that of the target policy to be evaluated.…

机器学习 · 计算机科学 2021-03-09 Ruosong Wang , Yifan Wu , Ruslan Salakhutdinov , Sham M. Kakade