English
Related papers

Related papers: The Least Restriction for Offline Reinforcement Le…

200 papers

The prevalent use of benchmarks in current offline reinforcement learning (RL) research has led to a neglect of the imbalance of real-world dataset distributions in the development of models. The real-world offline RL dataset is often…

Machine Learning · Computer Science 2024-05-22 Li Jiang , Sijie Cheng , Jielin Qiu , Haoran Xu , Wai Kin Chan , Zhao Ding

Offline reinforcement learning (RL) allows agents to learn effective, return-maximizing policies from a static dataset. Three popular algorithms for offline RL are Conservative Q-Learning (CQL), Behavior Cloning (BC), and Decision…

Machine Learning · Computer Science 2024-03-13 Prajjwal Bhargava , Rohan Chitnis , Alborz Geramifard , Shagun Sodhani , Amy Zhang

In this paper, we study the outage minimization problem in a decode-and-forward cooperative network with relay uncertainty. To reduce the outage probability and improve the quality of service, existing researches usually rely on the…

Information Theory · Computer Science 2022-05-19 Yuanzhe Geng , Erwu Liu , Rui Wang , Pengcheng Sun , Binyu Lu

Link adaptation (LA) is an essential function in modern wireless communication systems that dynamically adjusts the transmission rate of a communication link to match time- and frequency-varying radio link conditions. However, factors such…

Machine Learning · Computer Science 2024-12-02 Samuele Peri , Alessio Russo , Gabor Fodor , Pablo Soldati

Offline reinforcement learning (RL) can in principle synthesize more optimal behavior from a dataset consisting only of suboptimal trials. One way that this can happen is by "stitching" together the best parts of otherwise suboptimal…

Machine Learning · Computer Science 2023-11-01 Joey Hong , Anca Dragan , Sergey Levine

We study the offline meta-reinforcement learning (OMRL) problem, a paradigm which enables reinforcement learning (RL) algorithms to quickly adapt to unseen tasks without any interactions with the environments, making RL truly practical in…

Machine Learning · Computer Science 2021-05-07 Lanqing Li , Rui Yang , Dijun Luo

Recent advancements in deep reinforcement learning (RL) have demonstrated notable progress in sample efficiency, spanning both model-based and model-free paradigms. Despite the identification and mitigation of specific bottlenecks in prior…

Machine Learning · Computer Science 2024-04-02 Yibo Wang , Jiang Zhao

Offline reinforcement learning (RL) have received rising interest due to its appealing data efficiency. The present study addresses behavior estimation, a task that lays the foundation of many offline RL algorithms. Behavior estimation aims…

Machine Learning · Computer Science 2023-05-29 Guoxi Zhang , Hisashi Kashima

Behavior constrained policy optimization has been demonstrated to be a successful paradigm for tackling Offline Reinforcement Learning. By exploiting historical transitions, a policy is trained to maximize a learned value function while…

Machine Learning · Computer Science 2023-07-25 Jiachen Li , Edwin Zhang , Ming Yin , Qinxun Bai , Yu-Xiang Wang , William Yang Wang

Most prior approaches to offline reinforcement learning (RL) have taken an iterative actor-critic approach involving off-policy evaluation. In this paper we show that simply doing one step of constrained/regularized policy improvement using…

Machine Learning · Computer Science 2021-12-06 David Brandfonbrener , William F. Whitney , Rajesh Ranganath , Joan Bruna

We propose a novel algorithm for offline reinforcement learning using optimal transport. Typically, in offline reinforcement learning, the data is provided by various experts and some of them can be sub-optimal. To extract an efficient…

Machine Learning · Computer Science 2024-10-21 Arip Asadulaev , Rostislav Korst , Alexander Korotin , Vage Egiazarian , Andrey Filchenkov , Evgeny Burnaev

Offline reinforcement learning (RL) enables the agent to effectively learn from logged data, which significantly extends the applicability of RL algorithms in real-world scenarios where exploration can be expensive or unsafe. Previous works…

Machine Learning · Computer Science 2022-12-05 Yiqin Yang , Hao Hu , Wenzhe Li , Siyuan Li , Jun Yang , Qianchuan Zhao , Chongjie Zhang

We study the offline reinforcement learning (RL) in the face of unmeasured confounders. Due to the lack of online interaction with the environment, offline RL is facing the following two significant challenges: (i) the agent may be…

Machine Learning · Computer Science 2022-09-20 Zuyue Fu , Zhengling Qi , Zhaoran Wang , Zhuoran Yang , Yanxun Xu , Michael R. Kosorok

Offline reinforcement learning enables learning from a fixed dataset, without further interactions with the environment. The lack of environmental interactions makes the policy training vulnerable to state-action pairs far from the training…

Machine Learning · Statistics 2022-10-11 Shentao Yang , Zhendong Wang , Huangjie Zheng , Yihao Feng , Mingyuan Zhou

The offline reinforcement learning (RL) problem is often motivated by the need to learn data-driven decision policies in financial, legal and healthcare applications. However, the learned policy could retain sensitive information of…

Machine Learning · Computer Science 2023-01-04 Dan Qiao , Yu-Xiang Wang

Offline reinforcement learning (RL) aims to learn the optimal policy from a fixed dataset generated by behavior policies without additional environment interactions. One common challenge that arises in this setting is the…

Machine Learning · Computer Science 2026-02-06 Songyuan Zhang , Oswin So , H. M. Sabbir Ahmad , Eric Yang Yu , Matthew Cleaveland , Mitchell Black , Chuchu Fan

Constrained reinforcement learning (RL) seeks high-performance policies under safety constraints. We focus on an offline setting where the agent has only a fixed dataset -- common in realistic tasks to prevent unsafe exploration. To address…

Machine Learning · Computer Science 2025-09-08 Junyu Guo , Zhi Zheng , Donghao Ying , Ming Jin , Shangding Gu , Costas Spanos , Javad Lavaei

Existing theoretical studies on offline reinforcement learning (RL) mostly consider a dataset sampled directly from the target task. In practice, however, data often come from several heterogeneous but related sources. Motivated by this…

Machine Learning · Statistics 2023-06-16 Chengshuai Shi , Wei Xiong , Cong Shen , Jing Yang

Offline Reinforcement Learning (RL) is a promising approach for learning optimal policies in environments where direct exploration is expensive or unfeasible. However, the adoption of such policies in practice is often challenging, as they…

Machine Learning · Computer Science 2020-11-03 Aaron Sonabend-W , Junwei Lu , Leo A. Celi , Tianxi Cai , Peter Szolovits

Offline reinforcement learning (RL) recently gains growing interests from RL researchers. However, the performance of offline RL suffers from the out-of-distribution problem, which can be corrected by feedback in online RL. Previous offline…

Machine Learning · Computer Science 2025-06-25 Shuncheng He , Hongchang Zhang , Jianzhun Shao , Yuhang Jiang , Xiangyang Ji