English
Related papers

Related papers: Q-WSL: Optimizing Goal-Conditioned RL with Weighte…

200 papers

Consider mutli-goal tasks that involve static environments and dynamic goals. Examples of such tasks, such as goal-directed navigation and pick-and-place in robotics, abound. Two types of Reinforcement Learning (RL) algorithms are used for…

Machine Learning · Computer Science 2019-01-08 Vikas Dhiman , Shurjo Banerjee , Jeffrey M. Siskind , Jason J. Corso

Recent works have shown that tackling offline reinforcement learning (RL) with a conditional policy produces promising results. The Decision Transformer (DT) combines the conditional policy approach and a transformer architecture, showing…

Machine Learning · Computer Science 2023-05-26 Taku Yamagata , Ahmed Khalil , Raul Santos-Rodriguez

Upside-Down Reinforcement Learning (UDRL) is an approach for solving RL problems that does not require value functions and uses only supervised learning, where the targets for given inputs in a dataset do not change over time. Ghosh et al.…

Goal-Conditioned Reinforcement Learning (GCRL) mitigates the difficulty of reward design by framing tasks as goal reaching rather than maximizing hand-crafted reward signals. In this setting, the optimal goal-conditioned value function…

Machine Learning · Computer Science 2026-03-03 Vittorio Giammarino , Ahmed H. Qureshi

We introduce a novel objective for training deep generative time-series models with discrete latent variables for which supervision is only sparsely available. This instance of semi-supervised learning is challenging for existing methods,…

Machine Learning · Computer Science 2020-07-02 Michael Teng , Tuan Anh Le , Adam Scibior , Frank Wood

Approaches for goal-conditioned reinforcement learning (GCRL) often use learned state representations to extract goal-reaching policies. Two frameworks for representation structure have yielded particularly effective GCRL algorithms: (1)…

Machine Learning · Computer Science 2025-12-03 Vivek Myers , Bill Chunyuan Zheng , Benjamin Eysenbach , Sergey Levine

Goal-Conditioned Reinforcement Learning (GCRL) can enable agents to spontaneously set diverse goals to learn a set of skills. Despite the excellent works proposed in various fields, reaching distant goals in temporally extended tasks…

Robotics · Computer Science 2023-07-21 Zhifeng Qian , Mingyu You , Hongjun Zhou , Xuanhui Xu , Bin He

In constrained reinforcement learning (C-RL), an agent seeks to learn from the environment a policy that maximizes the expected cumulative reward while satisfying minimum requirements in secondary cumulative reward constraints. Several…

Machine Learning · Computer Science 2022-12-06 Tianqi Zheng , Pengcheng You , Enrique Mallada

Large language models often require fine-tuning to better align their behavior with user intent at deployment. Existing approaches are commonly divided into online and offline paradigms. Online methods, such as RL-based alignment, can…

Machine Learning · Computer Science 2026-05-19 Shijun Li , Kaiwen Dong , Xiang Gao , Joydeep Ghosh

In recent years, semi-supervised learning (SSL) has gained significant attention due to its ability to leverage both labeled and unlabeled data to improve model performance, especially when labeled data is scarce. However, most current SSL…

Machine Learning · Computer Science 2024-05-06 Marzi Heidari , Hanping Zhang , Yuhong Guo

The exponential growth of data-intensive applications has placed unprecedented demands on modern storage systems, necessitating dynamic and efficient optimization strategies. Traditional heuristics employed for storage performance…

Operating Systems · Computer Science 2025-08-25 Chiyu Cheng , Chang Zhou , Yang Zhao

Self-paced reinforcement learning (RL) aims to improve the data efficiency of learning by automatically creating sequences, namely curricula, of probability distributions over contexts. However, existing techniques for self-paced RL fail in…

Machine Learning · Computer Science 2023-05-29 Cevahir Koprulu , Ufuk Topcu

Offline Safe Reinforcement Learning (OSRL) aims to learn a policy to achieve high performance in sequential decision-making while satisfying constraints, using only pre-collected datasets. Recent works, inspired by the strong capabilities…

Machine Learning · Computer Science 2026-02-06 Zifan Liu , Xinran Li , Shibo Chen , Jun Zhang

Standard approaches to goal-conditioned reinforcement learning (GCRL) that rely on temporal-difference learning can be unstable and sample-inefficient due to bootstrapping. While recent work has explored contrastive and supervised…

Machine Learning · Computer Science 2026-04-21 Franki Nguimatsia Tiofack , Fabian Schramm , Théotime Le Hellard , Justin Carpentier

While reinforcement learning (RL) is increasingly used for LLM-based tool learning, its efficiency is often hampered by an overabundance of simple samples that provide diminishing learning value as training progresses. Existing dynamic…

Machine Learning · Computer Science 2025-09-19 Zihao Feng , Xiaoxue Wang , Bowen Wu , Hailong Cao , Tiejun Zhao , Qun Yu , Baoxun Wang

Goal-conditioned reinforcement learning (GCRL) refers to learning general-purpose skills that aim to reach diverse goals. In particular, offline GCRL only requires purely pre-collected datasets to perform training tasks without additional…

Machine Learning · Computer Science 2023-10-13 Hanlin Zhu , Amy Zhang

Unsupervised goal-conditioned reinforcement learning (GCRL) is a promising paradigm for developing diverse robotic skills without external supervision. However, existing unsupervised GCRL methods often struggle to cover a wide range of…

Machine Learning · Computer Science 2024-12-10 Junik Bae , Kwanyoung Park , Youngwoon Lee

Episodic tasks in Reinforcement Learning (RL) often pose challenges due to sparse reward signals and high-dimensional state spaces, which hinder efficient learning. Additionally, these tasks often feature hidden "trap states" --…

Machine Learning · Computer Science 2025-05-23 Yuxuan Li , Yicheng Gao , Ning Yang , Stephen Xia

Reinforcement learning (RL) has achieved significant success across a wide range of domains, however, most existing methods are formulated in discrete time. In this work, we introduce a novel RL method for continuous-time control, where…

Machine Learning · Computer Science 2025-10-21 Chengxiu Hua , Jiawen Gu , Yushun Tang

In this work, we address the problem of determining reliable policies in reinforcement learning (RL), with a focus on optimization under uncertainty and the need for performance guarantees. While classical RL algorithms aim at maximizing…

Machine Learning · Computer Science 2025-10-22 Nadir Farhi