English
Related papers

Related papers: Goal-Conditioned Supervised Learning with Sub-Goal…

200 papers

Developing agents that can execute multiple skills by learning from pre-collected datasets is an important problem in robotics, where online interaction with the environment is extremely time-consuming. Moreover, manually designing reward…

Reinforcement learning offers the promise of automating the acquisition of complex behavioral skills. However, compared to commonly used and well-understood supervised learning methods, reinforcement learning algorithms can be brittle,…

Machine Learning · Computer Science 2020-01-01 Aviral Kumar , Xue Bin Peng , Sergey Levine

Deep learning is typically performed by learning a neural network solely from data in the form of input-output pairs ignoring available domain knowledge. In this work, the Constraint Guided Gradient Descent (CGGD) framework is proposed that…

Artificial Intelligence · Computer Science 2022-06-15 Quinten Van Baelen , Peter Karsmakers

We present a novel two-layer hierarchical reinforcement learning approach equipped with a Goals Relational Graph (GRG) for tackling the partially observable goal-driven task, such as goal-driven visual navigation. Our GRG captures the…

Computer Vision and Pattern Recognition · Computer Science 2021-03-31 Xin Ye , Yezhou Yang

Among various branches of offline reinforcement learning (RL) methods, goal-conditioned supervised learning (GCSL) has gained increasing popularity as it formulates the offline RL problem as a sequential modeling task, therefore bypassing…

Machine Learning · Computer Science 2024-12-17 Guan Wang , Haoyi Niu , Jianxiong Li , Li Jiang , Jianming Hu , Xianyuan Zhan

Goal-conditioned Reinforcement Learning (RL) aims at learning optimal policies, given goals encoded in special command inputs. Here we study goal-conditioned neural nets (NNs) that learn to generate deep NN policies in form of…

Machine Learning · Computer Science 2022-07-05 Francesco Faccio , Vincent Herrmann , Aditya Ramesh , Louis Kirsch , Jürgen Schmidhuber

The integration of Generative AI (GenAI) into education is reshaping how students learn, making self-regulated learning (SRL) - the ability to plan, monitor, and adapt one's learning - more important than ever. To support learners in these…

Human-Computer Interaction · Computer Science 2025-08-15 Kaixun Yang , Yizhou Fan , Luzhen Tang , Mladen Raković , Xinyu Li , Dragan Gašević , Guanliang Chen

Recent progress towards learning from limited supervision has encouraged efforts towards designing models that can recognize novel classes at test time (generalized zero-shot learning or GZSL). GZSL approaches assume knowledge of all…

Computer Vision and Pattern Recognition · Computer Science 2022-03-31 Hari Chandana Kuchibhotla , Sumitra S Malagi , Shivam Chandhok , Vineeth N Balasubramanian

Unsupervised and self-supervised objectives, such as next token prediction, have enabled pre-training generalist models from large amounts of unlabeled data. In reinforcement learning (RL), however, finding a truly general and scalable…

Machine Learning · Computer Science 2024-05-28 Seohong Park , Tobias Kreiman , Sergey Levine

Offline Reinforcement learning (RL) has shown potent in many safe-critical tasks in robotics where exploration is risky and expensive. However, it still struggles to acquire skills in temporally extended tasks. In this paper, we study the…

Robotics · Computer Science 2022-05-25 Jinning Li , Chen Tang , Masayoshi Tomizuka , Wei Zhan

Despite the recent success on image classification, self-training has only achieved limited gains on structured prediction tasks such as neural machine translation (NMT). This is mainly due to the compositionality of the target space, where…

Computation and Language · Computer Science 2020-12-08 Minkai Xu , Mingxuan Wang , Zhouhan Lin , Hao Zhou , Weinan Zhang , Lei Li

In this work, we propose a hierarchical reinforcement learning (HRL) structure which is capable of performing autonomous vehicle planning tasks in simulated environments with multiple sub-goals. In this hierarchical structure, the network…

Robotics · Computer Science 2019-11-12 Zhiqian Qiao , Zachariah Tyree , Priyantha Mudalige , Jeff Schneider , John M. Dolan

This paper addresses the problem of inverse reinforcement learning (IRL) -- inferring the reward function of an agent from observing its behavior. IRL can provide a generalizable and compact representation for apprenticeship learning, and…

Machine Learning · Computer Science 2022-08-10 Marwa Abdulhai , Natasha Jaques , Sergey Levine

This study presents a novel approach to Generative Class Incremental Learning (GCIL) by introducing the forgetting mechanism, aimed at dynamically managing class information for better adaptation to streaming data. GCIL is one of the hot…

Computer Vision and Pattern Recognition · Computer Science 2024-03-28 Taro Togo , Ren Togo , Keisuke Maeda , Takahiro Ogawa , Miki Haseyama

In classic Reinforcement Learning (RL), the agent maximizes an additive objective of the visited states, e.g., a value function. Unfortunately, objectives of this type cannot model many real-world applications such as experiment design,…

Machine Learning · Computer Science 2024-07-16 Riccardo De Santi , Manish Prajapat , Andreas Krause

Supervised learning, characterized by both discriminative and generative learning, seeks to predict the values of single (or sometimes multiple) predefined target attributes based on a predefined set of predictor attributes. For…

Machine Learning · Computer Science 2020-11-13 Yuan Jin , Wray Buntine , Francois Petitjean , Geoffrey I. Webb

Class incremental learning (CIL) trains a network on sequential tasks with separated categories in each task but suffers from catastrophic forgetting, where models quickly lose previously learned knowledge when acquiring new tasks. The…

Machine Learning · Computer Science 2024-11-05 Huiping Zhuang , Yizhu Chen , Di Fang , Run He , Kai Tong , Hongxin Wei , Ziqian Zeng , Cen Chen

Goal-oriented reinforcement learning has recently been a practical framework for robotic manipulation tasks, in which an agent is required to reach a certain goal defined by a function on the state space. However, the sparsity of such…

Machine Learning · Computer Science 2019-12-19 Zhizhou Ren , Kefan Dong , Yuan Zhou , Qiang Liu , Jian Peng

Learning agile humanoid behaviors from human motion offers a powerful route to natural, coordinated control, but existing approaches face a persistent trade-off: reference-tracking policies are often brittle outside the demonstration…

Robotics · Computer Science 2026-02-25 Jiashun Wang , M. Eva Mungai , He Li , Jean Pierre Sleiman , Jessica Hodgins , Farbod Farshidian

Continual learning, the ability of a model to adapt to an ongoing sequence of tasks without forgetting earlier ones, is a central goal of artificial intelligence. To better understand its underlying mechanisms, we study the limitations of…

Machine Learning · Statistics 2026-04-21 Hossein Taheri , Avishek Ghosh , Arya Mazumdar