English
Related papers

Related papers: Provably Improved Context-Based Offline Meta-RL wi…

200 papers

We study reinforcement learning (RL) problems in which agents observe the reward or transition realizations at their current state before deciding which action to take. Such observations are available in many applications, including…

Machine Learning · Computer Science 2024-10-22 Nadav Merlis

Offline reinforcement learning (RL) enables policy optimization using static datasets, avoiding the risks and costs of extensive real-world exploration. However, it struggles with suboptimal offline behaviors and inaccurate value estimation…

Machine Learning · Computer Science 2025-05-20 Minting Pan , Yitao Zheng , Jiajian Li , Yunbo Wang , Xiaokang Yang

Offline reinforcement learning (RL) seeks to learn optimal policies from static datasets without interacting with the environment. A common challenge is handling multi-modal action distributions, where multiple behaviours are represented in…

Machine Learning · Computer Science 2025-03-20 Mianchu Wang , Yue Jin , Giovanni Montana

Recently, Offline Reinforcement Learning (RL) has achieved remarkable progress with the emergence of various algorithms and datasets. However, these methods usually focus on algorithmic advancements, ignoring that many low-level…

Machine Learning · Computer Science 2023-06-02 Bingyi Kang , Xiao Ma , Yirui Wang , Yang Yue , Shuicheng Yan

Offline reinforcement learning (RL) refers to the problem of learning policies entirely from a large batch of previously collected data. This problem setting offers the promise of utilizing such datasets to acquire policies without any…

Machine Learning · Computer Science 2020-11-24 Tianhe Yu , Garrett Thomas , Lantao Yu , Stefano Ermon , James Zou , Sergey Levine , Chelsea Finn , Tengyu Ma

Catastrophic forgetting is a significant challenge in online continual learning (OCL), especially for non-stationary data streams that do not have well-defined task boundaries. This challenge is exacerbated by the memory constraints and…

Computer Vision and Pattern Recognition · Computer Science 2024-11-11 Xiwen Wei , Guihong Li , Radu Marculescu

We consider the hybrid reinforcement learning setting where the agent has access to both offline data and online interactive access. While Reinforcement Learning (RL) research typically assumes offline data contains complete action, reward…

Machine Learning · Computer Science 2024-06-12 Yuda Song , J. Andrew Bagnell , Aarti Singh

Offline reinforcement learning (RL) learns effective policies from a static target dataset. The performance of state-of-the-art offline RL algorithms notwithstanding, it relies on the size of the target dataset, and it degrades if limited…

Machine Learning · Computer Science 2026-02-10 Weiqin Chen , Xinjie Zhang , Sandipan Mishra , Santiago Paternain

Reinforcement learning (RL) algorithms are designed to optimize problem-solving by learning actions that maximize rewards, a task that becomes particularly challenging in random and nonstationary environments. Even advanced RL algorithms…

Machine Learning · Computer Science 2025-10-31 Sebastian Zieglmeier , Niklas Erdmann , Narada D. Warakagoda

Recent advancements in state-of-the-art (SOTA) offline reinforcement learning (RL) have primarily focused on addressing function approximation errors, which contribute to the overestimation of Q-values for out-of-distribution actions, a…

Machine Learning · Computer Science 2025-05-01 Pulkit Agrawal , Rukma Talwadker , Aditya Pareek , Tridib Mukherjee

Consider mutli-goal tasks that involve static environments and dynamic goals. Examples of such tasks, such as goal-directed navigation and pick-and-place in robotics, abound. Two types of Reinforcement Learning (RL) algorithms are used for…

Machine Learning · Computer Science 2019-01-08 Vikas Dhiman , Shurjo Banerjee , Jeffrey M. Siskind , Jason J. Corso

As Multimodal Large Language Models (MLLMs) mature, GUI agents are evolving from static interactions to complex navigation. While Reinforcement Learning (RL) has emerged as a promising paradigm for training MLLM agents on dynamic GUI tasks,…

Offline goal-conditioned reinforcement learning (GCRL) is a major problem in reinforcement learning (RL) because it provides a simple, unsupervised, and domain-agnostic way to acquire diverse behaviors and representations from unlabeled…

Machine Learning · Computer Science 2025-02-14 Seohong Park , Kevin Frans , Benjamin Eysenbach , Sergey Levine

Meta reinforcement learning (meta-RL) aims to learn a policy solving a set of training tasks simultaneously and quickly adapting to new tasks. It requires massive amounts of data drawn from training tasks to infer the common structure…

Machine Learning · Computer Science 2022-07-21 Yijie Guo , Qiucheng Wu , Honglak Lee

As a paradigm for sequential decision making in unknown environments, reinforcement learning (RL) has received a flurry of attention in recent years. However, the explosion of model complexity in emerging applications and the presence of…

Machine Learning · Statistics 2025-07-22 Yuejie Chi , Yuxin Chen , Yuting Wei

The field of Offline Reinforcement Learning (RL) aims to derive effective policies from pre-collected datasets without active environment interaction. While traditional offline RL algorithms like Conservative Q-Learning (CQL) and Implicit…

Machine Learning · Computer Science 2025-11-21 Ali Murtaza Caunhye , Asad Jeewa

Robotic systems that rely primarily on self-supervised learning have the potential to decrease the amount of human annotation and engineering effort required to learn control strategies. In the same way that prior robotic systems have…

Machine Learning · Computer Science 2025-06-11 Chongyi Zheng , Benjamin Eysenbach , Homer Walke , Patrick Yin , Kuan Fang , Ruslan Salakhutdinov , Sergey Levine

We study offline reinforcement learning of style-conditioned policies using explicit style supervision via subtrajectory labeling functions. In this setting, aligning style with high task performance is particularly challenging due to…

Machine Learning · Computer Science 2026-02-02 Mathieu Petitbois , Rémy Portelas , Sylvain Lamprier

Offline meta-reinforcement learning (meta-RL) methods, which adapt to unseen target tasks with prior experience, are essential in robot control tasks. Current methods typically utilize task contexts and skills as prior experience, where…

Machine Learning · Computer Science 2023-12-12 Hongcai He , Anjie Zhu , Shuang Liang , Feiyu Chen , Jie Shao

State-of-the-art (SOTA) reinforcement learning (RL) methods have enabled vision-language model (VLM) agents to learn from interaction with online environments without human supervision. However, these methods often struggle with learning…

Machine Learning · Computer Science 2025-05-22 Qingyuan Wu , Jianheng Liu , Jianye Hao , Jun Wang , Kun Shao