English
Related papers

Related papers: Offline-to-Online Multi-Agent Reinforcement Learni…

200 papers

The evolution of metropolitan cities and the increase in travel demands impose stringent requirements on traffic assignment methods. Multi-agent reinforcement learning (MARL) approaches outperform traditional methods in modeling adaptive…

Machine Learning · Computer Science 2025-12-16 Leizhen Wang , Peibo Duan , Cheng Lyu , Zewen Wang , Zhiqiang He , Nan Zheng , Zhenliang Ma

Learning in multi-agent scenarios is a fruitful research direction, but current approaches still show scalability problems in multiple games with general reward settings and different opponent types. The Multi-Agent Reinforcement Learning…

Artificial Intelligence · Computer Science 2025-04-14 Diego Perez-Liebana , Katja Hofmann , Sharada Prasanna Mohanty , Noboru Kuno , Andre Kramer , Sam Devlin , Raluca D. Gaina , Daniel Ionita

This paper endeavors to augment the robustness of offline reinforcement learning (RL) in scenarios laden with heavy-tailed rewards, a prevalent circumstance in real-world applications. We propose two algorithmic frameworks, ROAM and ROOM,…

Machine Learning · Computer Science 2024-04-02 Jin Zhu , Runzhe Wan , Zhengling Qi , Shikai Luo , Chengchun Shi

Offline reinforcement learning faces a significant challenge of value over-estimation due to the distributional drift between the dataset and the current learned policy, leading to learning failure in practice. The common approach is to…

Machine Learning · Computer Science 2023-12-05 Liting Chen , Jie Yan , Zhengdao Shao , Lu Wang , Qingwei Lin , Saravan Rajmohan , Thomas Moscibroda , Dongmei Zhang

Recently, deep multi-agent reinforcement learning (MARL) has gained significant popularity due to its success in various cooperative multi-agent tasks. However, exploration still remains a challenging problem in MARL due to the partial…

Machine Learning · Computer Science 2024-01-17 Yonghyeon Jo , Sunwoo Lee , Junghyuk Yeom , Seungyul Han

Offline-to-online reinforcement learning (RL), by combining the benefits of offline pretraining and online finetuning, promises enhanced sample efficiency and policy performance. However, existing methods, effective as they are, suffer from…

Machine Learning · Computer Science 2023-05-26 Jianxiong Li , Xiao Hu , Haoran Xu , Jingjing Liu , Xianyuan Zhan , Ya-Qin Zhang

Existing off-policy reinforcement learning algorithms often rely on an explicit state-action-value function representation, which can be problematic in high-dimensional action spaces due to the curse of dimensionality. This reliance results…

Machine Learning · Computer Science 2025-02-18 Fabian Otto , Philipp Becker , Ngo Anh Vien , Gerhard Neumann

The teleoperated driving (TD) scenario comes with stringent Quality of Service (QoS) communication constraints, especially in terms of end-to-end (E2E) latency and reliability. In this context, Predictive Quality of Service (PQoS), possibly…

Networking and Internet Architecture · Computer Science 2025-05-07 Giacomo Avanzi , Marco Giordani , Michele Zorzi

Offline reinforcement learning (RL) provides a powerful framework for training robotic agents using pre-collected, suboptimal datasets, eliminating the need for costly, time-consuming, and potentially hazardous online interactions. This is…

Machine Learning · Computer Science 2025-08-01 Tung M. Luu , Donghoon Lee , Younghwan Lee , Chang D. Yoo

Offline reinforcement learning (RL) provides a promising approach to avoid costly online interaction with the real environment. However, the performance of offline RL highly depends on the quality of the datasets, which may cause…

Robotics · Computer Science 2024-05-08 Yiwen Hou , Haoyuan Sun , Jinming Ma , Feng Wu

Multi-Objective Reinforcement Learning (MORL) is a generalization of traditional Reinforcement Learning (RL) that aims to optimize multiple, often conflicting objectives simultaneously rather than focusing on a single reward. This approach…

Machine Learning · Computer Science 2025-08-15 Davide Guidobene , Lorenzo Benedetti , Diego Arapovic

Learning a reward function from human preferences is challenging as it typically requires having a high-fidelity simulator or using expensive and potentially unsafe actual physical rollouts in the environment. However, in many tasks the…

Machine Learning · Computer Science 2022-02-18 Daniel Shin , Daniel S. Brown , Anca D. Dragan

Learning-based vehicle planning is receiving increasing attention with the emergence of diverse driving simulators and large-scale driving datasets. While offline reinforcement learning (RL) is well suited for these safety-critical tasks,…

Robotics · Computer Science 2023-11-20 Zenan Li , Fan Nie , Qiao Sun , Fang Da , Hang Zhao

As multi-agent reinforcement learning (MARL) progresses towards solving larger and more complex problems, it becomes increasingly important that algorithms exhibit the key properties of (1) strong performance, (2) memory efficiency, and (3)…

Combining offline and online reinforcement learning (RL) is crucial for efficient and safe learning. However, previous approaches treat offline and online learning as separate procedures, resulting in redundant designs and limited…

Machine Learning · Computer Science 2024-03-19 Kun Lei , Zhengmao He , Chenhao Lu , Kaizhe Hu , Yang Gao , Huazhe Xu

End-to-end learning robotic manipulation with high data efficiency is one of the key challenges in robotics. The latest methods that utilize human demonstration data and unsupervised representation learning has proven to be a promising…

Robotics · Computer Science 2021-10-22 Jin Li , Xianyuan Zhan , Zixu Xiao , Guyue Zhou

Online continual learning (OCL) aims to train neural networks incrementally from a non-stationary data stream with a single pass through data. Rehearsal-based methods attempt to approximate the observed input distributions over time with a…

Machine Learning · Computer Science 2022-11-15 Yaqian Zhang , Bernhard Pfahringer , Eibe Frank , Albert Bifet , Nick Jin Sean Lim , Yunzhe Jia

We study the off-policy evaluation (OPE) problem in reinforcement learning with linear function approximation, which aims to estimate the value function of a target policy based on the offline data collected by a behavior policy. We propose…

Machine Learning · Computer Science 2022-01-05 Yifei Min , Tianhao Wang , Dongruo Zhou , Quanquan Gu

To accommodate real-world dynamics, artificial intelligence systems need to cope with sequentially arriving content in an online manner. Beyond regular Continual Learning (CL) attempting to address catastrophic forgetting with offline…

Machine Learning · Computer Science 2024-04-02 HongWei Yan , Liyuan Wang , Kaisheng Ma , Yi Zhong

Off-policy reinforcement learning (RL) has achieved notable success in tackling many complex real-world tasks, by leveraging previously collected data for policy learning. However, most existing off-policy RL algorithms fail to maximally…

Machine Learning · Computer Science 2024-05-30 Yu Luo , Tianying Ji , Fuchun Sun , Jianwei Zhang , Huazhe Xu , Xianyuan Zhan