English
Related papers

Related papers: Benchmarking Offline Reinforcement Learning on Rea…

200 papers

Offline meta-reinforcement learning (OMRL) proficiently allows an agent to tackle novel tasks while solely relying on a static dataset. For precise and efficient task identification, existing OMRL research suggests learning separate task…

Machine Learning · Computer Science 2024-03-13 Chengxing Jia , Fuxiang Zhang , Yi-Chen Li , Chen-Xiao Gao , Xu-Hui Liu , Lei Yuan , Zongzhang Zhang , Yang Yu

Reinforcement learning (RL) with diverse offline datasets can have the advantage of leveraging the relation of multiple tasks and the common skills learned across those tasks, hence allowing us to deal with real-world complex problems…

Machine Learning · Computer Science 2024-08-29 Minjong Yoo , Sangwoo Cho , Honguk Woo

Deep reinforcement learning enables algorithms to learn complex behavior, deal with continuous action spaces and find good strategies in environments with high dimensional state spaces. With deep reinforcement learning being an active area…

Machine Learning · Computer Science 2018-10-17 Winfried Lötzsch

Reinforcement learning in partially observable domains is challenging due to the lack of observable state information. Thankfully, learning offline in a simulator with such state information is often possible. In particular, we propose a…

Robotics · Computer Science 2022-11-11 Hai Nguyen , Andrea Baisero , Dian Wang , Christopher Amato , Robert Platt

Reinforcement learning has shown great promise in robotics thanks to its ability to develop efficient robotic control procedures through self-training. In particular, reinforcement learning has been successfully applied to solving the…

Robotics · Computer Science 2020-11-12 Pierre Aumjaud , David McAuliffe , Francisco Javier Rodríguez Lera , Philip Cardiff

Reinforcement learning (RL) is a powerful data-driven control method that has been largely explored in autonomous driving tasks. However, conventional RL approaches learn control policies through trial-and-error interactions with the…

Robotics · Computer Science 2021-11-03 Tianyu Shi , Dong Chen , Kaian Chen , Zhaojian Li

The recent development of reinforcement learning (RL) has boosted the adoption of online RL for wireless radio resource management (RRM). However, online RL algorithms require direct interactions with the environment, which may be…

Information Theory · Computer Science 2023-11-21 Kun Yang , Cong Shen , Jing Yang , Shu-ping Yeh , Jerry Sydir

In offline reinforcement learning (RL), we seek to utilize offline data to evaluate (or learn) policies in scenarios where the data are collected from a distribution that substantially differs from that of the target policy to be evaluated.…

Machine Learning · Computer Science 2021-03-09 Ruosong Wang , Yifan Wu , Ruslan Salakhutdinov , Sham M. Kakade

Offline Reinforcement Learning (RL) aims at learning an optimal control from a fixed dataset, without interactions with the system. An agent in this setting should avoid selecting actions whose consequences cannot be predicted from the…

Offline Safe Reinforcement Learning (RL) seeks to address safety constraints by learning from static datasets and restricting exploration. However, these approaches heavily rely on the dataset and struggle to generalize to unseen scenarios…

Robotics · Computer Science 2025-03-04 Chenyang Cao , Yucheng Xin , Silang Wu , Longxiang He , Zichen Yan , Junbo Tan , Xueqian Wang

In many real-world multi-agent cooperative tasks, due to high cost and risk, agents cannot continuously interact with the environment and collect experiences during learning, but have to learn from offline datasets. However, the transition…

Machine Learning · Computer Science 2023-08-01 Jiechuan Jiang , Zongqing Lu

Offline reinforcement learning (RL) algorithms are applied to learn performant, well-generalizing policies when provided with a static dataset of interactions. Many recent approaches to offline RL have seen substantial success, but with one…

Machine Learning · Computer Science 2024-07-30 Padmanaba Srinivasan , William Knottenbelt

Combining offline and online reinforcement learning (RL) is crucial for efficient and safe learning. However, previous approaches treat offline and online learning as separate procedures, resulting in redundant designs and limited…

Machine Learning · Computer Science 2024-03-19 Kun Lei , Zhengmao He , Chenhao Lu , Kaizhe Hu , Yang Gao , Huazhe Xu

In recent years, on-policy reinforcement learning (RL) has been successfully applied to many different continuous control tasks. While RL algorithms are often conceptually simple, their state-of-the-art implementations take numerous low-…

We consider the problem of offline reinforcement learning where only a set of system transitions is made available for policy optimization. Following recent advances in the field, we consider a model-based reinforcement learning algorithm…

Machine Learning · Computer Science 2024-02-06 Abdelhakim Benechehab , Albert Thomas , Balázs Kégl

Learning generalizable robot manipulation policies, especially for complex multi-fingered humanoids, remains a significant challenge. Existing approaches primarily rely on extensive data collection and imitation learning, which are…

Robotics · Computer Science 2025-09-03 Toru Lin , Kartik Sachdev , Linxi Fan , Jitendra Malik , Yuke Zhu

While deep reinforcement learning methods have shown impressive results in robot learning, their sample inefficiency makes the learning of complex, long-horizon behaviors with real robot systems infeasible. To mitigate this issue,…

Machine Learning · Computer Science 2022-04-26 Taewook Nam , Shao-Hua Sun , Karl Pertsch , Sung Ju Hwang , Joseph J Lim

Offline reinforcement learning (RL) refers to the problem of learning policies entirely from a large batch of previously collected data. This problem setting offers the promise of utilizing such datasets to acquire policies without any…

Machine Learning · Computer Science 2020-11-24 Tianhe Yu , Garrett Thomas , Lantao Yu , Stefano Ermon , James Zou , Sergey Levine , Chelsea Finn , Tengyu Ma

Learning contact-rich manipulation skills is essential. Such skills require the robots to interact with the environment with feasible manipulation trajectories and suitable compliance control parameters to enable safe and stable contact.…

Robotics · Computer Science 2023-10-17 Xiang Zhang , Changhao Wang , Lingfeng Sun , Zheng Wu , Xinghao Zhu , Masayoshi Tomizuka

Offline reinforcement learning (RL) learns policies from a fixed dataset, but often requires large amounts of data. The challenge arises when labeled datasets are expensive, especially when rewards have to be provided by human labelers for…

Machine Learning · Computer Science 2025-05-30 Yen-Ru Lai , Fu-Chieh Chang , Pei-Yuan Wu