English
Related papers

Related papers: Residual Learning and Context Encoding for Adaptiv…

200 papers

Offline reinforcement learning (RL) enables policy optimization using static datasets, avoiding the risks and costs of extensive real-world exploration. However, it struggles with suboptimal offline behaviors and inaccurate value estimation…

Machine Learning · Computer Science 2025-05-20 Minting Pan , Yitao Zheng , Jiajian Li , Yunbo Wang , Xiaokang Yang

Offline reinforcement learning (RL) presents a promising approach for learning reinforced policies from offline datasets without the need for costly or unsafe interactions with the environment. However, datasets collected by humans in…

Machine Learning · Computer Science 2024-03-12 Rui Yang , Han Zhong , Jiawei Xu , Amy Zhang , Chongjie Zhang , Lei Han , Tong Zhang

Traditional offline reinforcement learning (RL) methods predominantly operate in a batch-constrained setting. This confines the algorithms to a specific state-action distribution present in the dataset, reducing the effects of…

Machine Learning · Statistics 2025-07-16 Charles A. Hepburn , Yue Jin , Giovanni Montana

Recently, Offline Reinforcement Learning (RL) has achieved remarkable progress with the emergence of various algorithms and datasets. However, these methods usually focus on algorithmic advancements, ignoring that many low-level…

Machine Learning · Computer Science 2023-06-02 Bingyi Kang , Xiao Ma , Yirui Wang , Yang Yue , Shuicheng Yan

Offline reinforcement learning (RL) represents a significant shift in RL research, allowing agents to learn from pre-collected datasets without further interaction with the environment. A key, yet underexplored, challenge in offline RL is…

Machine Learning · Computer Science 2025-02-27 Yiqin Yang , Quanwei Wang , Chenghao Li , Hao Hu , Chengjie Wu , Yuhua Jiang , Dianyu Zhong , Ziyou Zhang , Qianchuan Zhao , Chongjie Zhang , Xu Bo

Offline meta-reinforcement learning (OMRL) utilizes pre-collected offline datasets to enhance the agent's generalization ability on unseen tasks. However, the context shift problem arises due to the distribution discrepancy between the…

Machine Learning · Computer Science 2023-11-08 Yunkai Gao , Rui Zhang , Jiaming Guo , Fan Wu , Qi Yi , Shaohui Peng , Siming Lan , Ruizhi Chen , Zidong Du , Xing Hu , Qi Guo , Ling Li , Yunji Chen

Offline Reinforcement Learning (RL) is a promising approach for next-generation wireless networks, where online exploration is unsafe and large amounts of operational data can be reused across the model lifecycle. However, the behavior of…

Networking and Internet Architecture · Computer Science 2026-03-05 Nicolas Helson , Pegah Alizadeh , Anastasios Giovanidis

Cross-domain offline reinforcement learning (RL) aims to train a well-performing agent in the target environment, leveraging both a limited target domain dataset and a source domain dataset with (possibly) sufficient data coverage. Due to…

Machine Learning · Computer Science 2026-03-23 Zhongjian Qiao , Rui Yang , Jiafei Lyu , Chenjia Bai , Xiu Li , Siyang Gao , Shuang Qiu

Offline Reinforcement Learning (RL) provides a promising avenue for training policies from pre-collected datasets when gathering additional interaction data is infeasible. However, existing offline RL methods often assume stationarity or…

Machine Learning · Computer Science 2025-12-30 Suzan Ece Ada , Georg Martius , Emre Ugur , Erhan Oztop

In this paper, we consider the problem of predicting unknown targets from data. We propose Online Residual Learning (ORL), a method that combines online adaptation with offline-trained predictions. At a lower level, we employ multiple…

Systems and Control · Electrical Eng. & Systems 2024-09-10 Anastasios Vlachos , Anastasios Tsiamis , Aren Karapetyan , Efe C. Balta , John Lygeros

Offline reinforcement learning struggles with distributional shift and constrained performance due to static dataset limitations, while online RL demands prohibitive environment interactions. The recent advent of hybrid offline-to-online…

Machine Learning · Computer Science 2026-05-19 Qisai Liu , Zhanhong Jiang , Joshua Russell Waite , Aditya Balu , Cody Fleming , Soumik Sarkar

Sample efficiency and exploration remain major challenges in online reinforcement learning (RL). A powerful approach that can be applied to address these issues is the inclusion of offline data, such as prior trajectories from a human…

Machine Learning · Computer Science 2023-06-01 Philip J. Ball , Laura Smith , Ilya Kostrikov , Sergey Levine

Offline inverse reinforcement learning (Offline IRL) aims to recover the structure of rewards and environment dynamics that underlie observed actions in a fixed, finite set of demonstrations from an expert agent. Accurate models of…

Machine Learning · Computer Science 2024-03-01 Siliang Zeng , Chenliang Li , Alfredo Garcia , Mingyi Hong

Recent research has turned to Reinforcement Learning (RL) to solve challenging decision problems, as an alternative to hand-tuned heuristics. RL can learn good policies without the need for modeling the environment's dynamics. Despite this…

Machine Learning · Computer Science 2023-01-30 Pouya Hamadanian , Malte Schwarzkopf , Siddartha Sen , Mohammad Alizadeh

Offline reinforcement learning (RL) is a compelling framework for learning optimal policies from past experiences without additional interaction with the environment. Nevertheless, offline RL inevitably faces the problem of distributional…

Machine Learning · Computer Science 2024-04-09 Yeda Song , Dongwook Lee , Gunhee Kim

Model-based offline reinforcement Learning (RL) is a promising approach that leverages existing data effectively in many real-world applications, especially those involving high-dimensional inputs like images and videos. To alleviate the…

Computer Vision and Pattern Recognition · Computer Science 2024-06-17 Shenghua Wan , Ziyuan Chen , Le Gan , Shuai Feng , De-Chuan Zhan

Reinforcement learning (RL) has achieved remarkable success in real-world decision-making across diverse domains, including gaming, robotics, online advertising, public health, and natural language processing. Despite these advances, a…

Applications · Statistics 2026-01-23 Asim H. Gazi , Yongyi Guo , Daiqi Gao , Ziping Xu , Kelly W. Zhang , Susan A. Murphy

Leveraging offline data is a promising way to improve the sample efficiency of online reinforcement learning (RL). This paper expands the pool of usable data for offline-to-online RL by leveraging abundant non-curated data that is…

Machine Learning · Computer Science 2025-05-20 Yi Zhao , Aidan Scannell , Wenshuai Zhao , Yuxin Hou , Tianyu Cui , Le Chen , Dieter Büchler , Arno Solin , Juho Kannala , Joni Pajarinen

Policy constraint methods in offline reinforcement learning employ additional regularization techniques to constrain the discrepancy between the learned policy and the offline dataset. However, these methods tend to result in overly…

Machine Learning · Computer Science 2024-08-06 Shirong Liu , Chenjia Bai , Zixian Guo , Hao Zhang , Gaurav Sharma , Yang Liu

Real-world reinforcement learning (RL) environments, whether in robotics or industrial settings, often involve non-visual observations and require not only efficient but also reliable and thus interpretable and flexible RL approaches. To…

Machine Learning · Computer Science 2024-02-19 Moritz Lange , Noah Krystiniak , Raphael C. Engelhardt , Wolfgang Konen , Laurenz Wiskott