English
Related papers

Related papers: Provable Domain Adaptation for Offline Reinforceme…

200 papers

Offline reinforcement learning (RL) allows learning sequential behavior from fixed datasets. Since offline datasets do not cover all possible situations, many methods collect additional data during online fine-tuning to improve performance.…

Machine Learning · Computer Science 2024-06-13 Mohammadreza Nakhaei , Aidan Scannell , Joni Pajarinen

Existing offline reinforcement learning (RL) algorithms typically assume that training data is either: 1) generated by a known policy, or 2) of entirely unknown origin. We consider multi-demonstrator offline RL, a middle ground where we…

Machine Learning · Computer Science 2022-11-29 Alan Clark , Shoaib Ahmed Siddiqui , Robert Kirk , Usman Anwar , Stephen Chung , David Krueger

Offline-to-online reinforcement learning (O2O RL) aims to obtain a continually improving policy as it interacts with the environment, while ensuring the initial policy behaviour is satisficing. This satisficing behaviour is necessary for…

Robotics · Computer Science 2025-01-24 Bryan Chan , Anson Leung , James Bergstra

The growing complexity and capacity demands for mobile networks necessitate innovative techniques for optimizing resource usage. Meanwhile, recent breakthroughs have brought Reinforcement Learning (RL) into the domain of continuous control…

Networking and Internet Architecture · Computer Science 2022-10-28 Vegard Edvardsen , Gard Spreemann , Jeriek Van den Abeele

We consider offline reinforcement learning (RL) with heterogeneous agents under severe data scarcity, i.e., we only observe a single historical trajectory for every agent under an unknown, potentially sub-optimal policy. We find that the…

Machine Learning · Computer Science 2021-11-11 Anish Agarwal , Abdullah Alomar , Varkey Alumootil , Devavrat Shah , Dennis Shen , Zhi Xu , Cindy Yang

Current Reinforcement Learning (RL) is often limited by the large amount of data needed to learn a successful policy. Offline RL aims to solve this issue by using transitions collected by a different behavior policy. We address a novel…

Machine Learning · Computer Science 2024-05-29 Johannes Ackermann , Takayuki Osa , Masashi Sugiyama

Offline reinforcement-learning (RL) algorithms learn to make decisions using a given, fixed training dataset without online data collection. This problem setting is captivating because it holds the promise of utilizing previously collected…

Machine Learning · Computer Science 2022-12-07 Dan Elbaz , Gal Novik , Oren Salzman

It remains a critical challenge to adapt policies across domains with mismatched dynamics in reinforcement learning (RL). In this paper, we study cross-domain offline RL, where an offline dataset from another similar source domain can be…

Machine Learning · Computer Science 2026-02-06 Mengbei Yan , Jiafei Lyu , Shengjie Sun , Zhongjian Qiao , Jingwen Yang , Zichuan Lin , Deheng Ye , Xiu Li

Offline reinforcement learning (RL) can in principle synthesize more optimal behavior from a dataset consisting only of suboptimal trials. One way that this can happen is by "stitching" together the best parts of otherwise suboptimal…

Machine Learning · Computer Science 2023-11-01 Joey Hong , Anca Dragan , Sergey Levine

Offline reinforcement learning (RL) aims to learn a policy from a static dataset without further interactions with the environment. Collecting sufficiently large datasets for offline RL is exhausting since this data collection requires…

Artificial Intelligence · Computer Science 2025-10-22 Jongchan Park , Mingyu Park , Donghwan Lee

Offline reinforcement learning (RL) aims to learn a policy using only pre-collected and fixed data. Although avoiding the time-consuming online interactions in RL, it poses challenges for out-of-distribution (OOD) state actions and often…

Machine Learning · Computer Science 2023-06-23 Jinxin Liu , Ziqi Zhang , Zhenyu Wei , Zifeng Zhuang , Yachen Kang , Sibo Gai , Donglin Wang

Reinforcement learning (RL) problems are fundamental in online decision-making and have been instrumental in finding an optimal policy for Markov decision processes (MDPs). Function approximations are usually deployed to handle large or…

Machine Learning · Computer Science 2025-05-20 Jiashuo Jiang , Yiming Zong , Yinyu Ye

Offline reinforcement learning (RL) aims to find a near-optimal policy using pre-collected datasets. In real-world scenarios, data collection could be costly and risky; therefore, offline RL becomes particularly challenging when the…

Machine Learning · Computer Science 2024-12-18 Ruizhe Shi , Yuyao Liu , Yanjie Ze , Simon S. Du , Huazhe Xu

This paper introduces the offline meta-reinforcement learning (offline meta-RL) problem setting and proposes an algorithm that performs well in this setting. Offline meta-RL is analogous to the widely successful supervised learning strategy…

Machine Learning · Computer Science 2021-07-22 Eric Mitchell , Rafael Rafailov , Xue Bin Peng , Sergey Levine , Chelsea Finn

Offline reinforcement learning (RL) aims to find performant policies from logged data without further environment interaction. Model-based algorithms, which learn a model of the environment from the dataset and perform conservative policy…

Machine Learning · Computer Science 2022-10-12 Marc Rigter , Bruno Lacerda , Nick Hawes

We study off-dynamics Reinforcement Learning (RL), where the policy is trained on a source domain and deployed to a distinct target domain. We aim to solve this problem via online distributionally robust Markov decision processes (DRMDPs),…

Machine Learning · Computer Science 2024-02-26 Zhishuai Liu , Pan Xu

Two central paradigms have emerged in the reinforcement learning (RL) community: online RL and offline RL. In the online RL setting, the agent has no prior knowledge of the environment, and must interact with it in order to find an…

Machine Learning · Computer Science 2023-07-21 Andrew Wagenmaker , Aldo Pacchiano

Fast adaptation to new tasks is extremely important for embodied agents in the real world. Meta-reinforcement learning (meta-RL) has emerged as an effective method to enable fast adaptation in unknown environments. Compared to on-policy…

Machine Learning · Computer Science 2024-06-19 Menglong Zhang , Fuyuan Qian , Quanying Liu

We study risk-sensitive reinforcement learning (RL), a crucial field due to its ability to enhance decision-making in scenarios where it is essential to manage uncertainty and minimize potential adverse outcomes. Particularly, our work…

Machine Learning · Computer Science 2024-07-11 Dake Zhang , Boxiang Lyu , Shuang Qiu , Mladen Kolar , Tong Zhang

Recently, robust reinforcement learning (RL) methods against input observation have garnered significant attention and undergone rapid evolution due to RL's potential vulnerability. Although these advanced methods have achieved reasonable…

Machine Learning · Computer Science 2024-09-04 Kosuke Nakanishi , Akihiro Kubo , Yuji Yasui , Shin Ishii