English
Related papers

Related papers: Simple Ingredients for Offline Reinforcement Learn…

200 papers

Model-based reinforcement learning (RL) has shown great promise due to its sample efficiency, but still struggles with long-horizon sparse-reward tasks, especially in offline settings where the agent learns from a fixed dataset. We…

Machine Learning · Computer Science 2024-05-17 Rohan Chitnis , Yingchen Xu , Bobak Hashemi , Lucas Lehnert , Urun Dogan , Zheqing Zhu , Olivier Delalleau

Recent advance in deep offline reinforcement learning (RL) has made it possible to train strong robotic agents from offline datasets. However, depending on the quality of the trained agents and the application being considered, it is often…

Robotics · Computer Science 2021-11-02 Seunghyun Lee , Younggyo Seo , Kimin Lee , Pieter Abbeel , Jinwoo Shin

Reinforcement learning (RL) makes an agent learn from trial-and-error experiences gathered during the interaction with the environment. Recently, offline RL has become a popular RL paradigm because it saves the interactions with…

Machine Learning · Computer Science 2024-03-21 Chen Gong , Zhou Yang , Yunpeng Bai , Junda He , Jieke Shi , Kecen Li , Arunesh Sinha , Bowen Xu , Xinwen Hou , David Lo , Tianhao Wang

Offline reinforcement learning (RL) algorithms can acquire effective policies by utilizing previously collected experience, without any online interaction. It is widely understood that offline RL is able to extract good policies even from…

Machine Learning · Computer Science 2022-04-13 Aviral Kumar , Joey Hong , Anikait Singh , Sergey Levine

Distributionally robust offline reinforcement learning (RL) aims to find a policy that performs the best under the worst environment within an uncertainty set using an offline dataset collected from a nominal model. While recent advances in…

Machine Learning · Computer Science 2025-01-07 Ruiquan Huang , Yingbin Liang , Jing Yang

Safe offline reinforcement learning aims to learn policies that maximize cumulative rewards while adhering to safety constraints, using only offline data for training. A key challenge is balancing safety and performance, particularly when…

Machine Learning · Computer Science 2024-12-13 Prajwal Koirala , Zhanhong Jiang , Soumik Sarkar , Cody Fleming

Diffusion and flow models have emerged as powerful generative approaches capable of modeling diverse and multimodal behavior. However, applying these models to offline reinforcement learning (RL) remains challenging due to the iterative…

Machine Learning · Computer Science 2025-05-30 Nicolas Espinosa-Dice , Yiyi Zhang , Yiding Chen , Bradley Guo , Owen Oertell , Gokul Swamy , Kiante Brantley , Wen Sun

Due to their adaptability and mobility, Unmanned Aerial Vehicles (UAVs) are becoming increasingly essential for wireless network services, particularly for data harvesting tasks. In this context, Artificial Intelligence (AI)-based…

Machine Learning · Computer Science 2026-01-21 Babacar Toure , Dimitrios Tsilimantos , Omid Esrafilian , Marios Kountouris

Foundation models compress a large amount of information in a single, large neural network, which can then be queried for individual tasks. There are strong parallels between this widespread framework and offline goal-conditioned…

Machine Learning · Computer Science 2026-05-14 Marco Bagatella , Mert Albaba , Jonas Hübotter , Georg Martius , Andreas Krause

Classifier free guidance has shown strong potential in diffusion-based reinforcement learning. However, existing methods rely on joint training of the guidance module and the diffusion model, which can be suboptimal during the early stages…

Machine Learning · Computer Science 2025-06-05 Zhaoyang Chen , Cody Fleming

Reinforcement Learning (RL) is used extensively in Autonomous Systems (AS) as it enables learning at runtime without the need for a model of the environment or predefined actions. However, most applications of RL in AS, such as those based…

Artificial Intelligence · Computer Science 2024-10-01 Juan C. Rosero , Ivana Dusparic , Nicolás Cardozo

Offline reinforcement learning (RL) is a compelling paradigm to extend RL's practical utility by leveraging pre-collected, static datasets, thereby avoiding the limitations associated with collecting online interactions. The major…

Machine Learning · Computer Science 2024-06-10 Yutaka Shimizu , Joey Hong , Sergey Levine , Masayoshi Tomizuka

Offline reinforcement learning (RL) allows learning sequential behavior from fixed datasets. Since offline datasets do not cover all possible situations, many methods collect additional data during online fine-tuning to improve performance.…

Machine Learning · Computer Science 2024-06-13 Mohammadreza Nakhaei , Aidan Scannell , Joni Pajarinen

We consider a challenging theoretical problem in offline reinforcement learning (RL): obtaining sample-efficiency guarantees with a dataset lacking sufficient coverage, under only realizability-type assumptions for the function…

Machine Learning · Computer Science 2022-06-16 Jinglin Chen , Nan Jiang

Goal-conditioned reinforcement learning (GCRL) refers to learning general-purpose skills that aim to reach diverse goals. In particular, offline GCRL only requires purely pre-collected datasets to perform training tasks without additional…

Machine Learning · Computer Science 2023-10-13 Hanlin Zhu , Amy Zhang

Existing theoretical studies on offline reinforcement learning (RL) mostly consider a dataset sampled directly from the target task. In practice, however, data often come from several heterogeneous but related sources. Motivated by this…

Machine Learning · Statistics 2023-06-16 Chengshuai Shi , Wei Xiong , Cong Shen , Jing Yang

Offline reinforcement learning (RL) learns policies entirely from static datasets, thereby avoiding the challenges associated with online data collection. Practical applications of offline RL will inevitably require learning from datasets…

Machine Learning · Computer Science 2022-11-22 Anikait Singh , Aviral Kumar , Quan Vuong , Yevgen Chebotar , Sergey Levine

Off-policy reinforcement learning algorithms promise to be applicable in settings where only a fixed data-set (batch) of environment interactions is available and no new experience can be acquired. This property makes these algorithms…

Reinforcement learning (RL) is a powerful data-driven control method that has been largely explored in autonomous driving tasks. However, conventional RL approaches learn control policies through trial-and-error interactions with the…

Robotics · Computer Science 2021-11-03 Tianyu Shi , Dong Chen , Kaian Chen , Zhaojian Li

Offline reinforcement learning (RL) is crucial for real-world applications where exploration can be costly or unsafe. However, offline learned policies are often suboptimal, and further online fine-tuning is required. In this paper, we…

Machine Learning · Computer Science 2024-06-03 Hao Hu , Yiqin Yang , Jianing Ye , Chengjie Wu , Ziqing Mai , Yujing Hu , Tangjie Lv , Changjie Fan , Qianchuan Zhao , Chongjie Zhang