English
Related papers

Related papers: Goal-Oriented Skill Abstraction for Offline Multi-…

200 papers

While skill-centric approaches leverage foundation models to enhance generalization in compositional tasks, they often rely on fixed skill libraries, limiting adaptability to new tasks without manual intervention. To address this, we…

Robotics · Computer Science 2026-03-04 Senwei Xie , Yuntian Zhang , Ruiping Wang , Xilin Chen

Leveraging Large Language Models (LLMs) to automatically formulate and solve optimization problems from natural language has emerged as an efficient paradigm for automated optimization. However, existing methods still exhibit limited…

Artificial Intelligence · Computer Science 2026-05-29 Haochen Yang , Ke Zhao , Mengyuan Ma , Xingyu Lu , Xiangfeng Wang , Hong Qian

Hierarchical Imitation Learning is a powerful paradigm for acquiring complex robot behaviors from demonstrations. A central challenge, however, lies in discovering reusable skills from long-horizon, multi-task offline data, especially when…

Robotics · Computer Science 2026-02-03 Chongyu Zhu , Mithun Vanniasinghe , Jiayu Chen , Chi-Guhn Lee

Open-ended learning benefits immensely from the use of symbolic methods for goal representation as they offer ways to structure knowledge for efficient and transferable learning. However, the existing Hierarchical Reinforcement Learning…

Machine Learning · Computer Science 2024-12-20 Mehdi Zadem , Sergio Mover , Sao Mai Nguyen

Standard reinforcement learning algorithms with a single policy perform poorly on tasks in complex environments involving sparse rewards, diverse behaviors, or long-term planning. This led to the study of algorithms that incorporate…

Machine Learning · Computer Science 2024-07-23 Ranga Shaarad Ayyagari , Anurita Ghosh , Ambedkar Dukkipati

We consider the problem of sequential robotic manipulation of deformable objects using tools. Previous works have shown that differentiable physics simulators provide gradients to the environment state and help trajectory optimization to…

Machine Learning · Computer Science 2022-04-01 Xingyu Lin , Zhiao Huang , Yunzhu Li , Joshua B. Tenenbaum , David Held , Chuang Gan

Long-horizon tasks, usually characterized by complex subtask dependencies, present a significant challenge in manipulation planning. Skill chaining is a practical approach to solving unseen tasks by combining learned skill priors. However,…

Robotics · Computer Science 2024-01-09 Utkarsh A. Mishra , Shangjie Xue , Yongxin Chen , Danfei Xu

Modern LLM agents increasingly rely on reusable skills, and as they interact with personal applications, web browsers, and other interfaces, skill libraries can scale to thousands of skills. Scaling to larger skill sets introduces two key…

Artificial Intelligence · Computer Science 2026-05-28 Dawei Liu , Zongxia Li , Hongyang Du , Xiyang Wu , Shihang Gui , Yongbei Kuang , Lichao Sun

Offline reinforcement learning requires reconciling two conflicting aims: learning a policy that improves over the behavior policy that collected the dataset, while at the same time minimizing the deviation from the behavior policy so as to…

Machine Learning · Computer Science 2021-10-13 Ilya Kostrikov , Ashvin Nair , Sergey Levine

Offline reinforcement learning (RL) enables policy learning from static data but often suffers from poor coverage of the state-action space and distributional shift problems. This problem can be addressed by allowing limited online…

Machine Learning · Computer Science 2026-02-03 Soumyadeep Roy , Shashwat Kushwaha , Ambedkar Dukkipati

Goal-conditioned policies are used in order to break down complex reinforcement learning (RL) problems by using subgoals, which can be defined either in state space or in a latent feature space. This can increase the efficiency of learning…

Machine Learning · Computer Science 2020-06-04 Srinivas Venkattaramanujam , Eric Crawford , Thang Doan , Doina Precup

There has been significant recent progress in the area of unsupervised skill discovery, utilizing various information-theoretic objectives as measures of diversity. Despite these advances, challenges remain: current methods require…

Machine Learning · Computer Science 2024-06-24 Marin Vlastelica , Jin Cheng , Georg Martius , Pavel Kolev

Offline zero-shot reinforcement learning (RL) aims to learn agents that optimize unseen reward functions without additional environment interaction. The standard approach to this problem trains task-conditioned policies by sampling task…

Artificial Intelligence · Computer Science 2026-04-29 Nazim Bendib , Nicolas Perrin-Gilbert , Olivier Sigaud

Offline goal-conditioned reinforcement learning (GCRL) is a practical reinforcement learning paradigm that aims to learn goal-conditioned policies from reward-free offline data. Despite recent advances in hierarchical architectures such as…

Machine Learning · Computer Science 2026-04-13 Zhiqiang Dong , Teng Pang , Rongjian Xu , Guoqiang Wu

Multi-goal policy learning for robotic manipulation is challenging. Prior successes have used state-based representations of the objects or provided demonstration data to facilitate learning. In this paper, by hand-coding a high-level…

Robotics · Computer Science 2022-07-26 David Klee , Ondrej Biza , Robert Platt

Goal representation affects the performance of Hierarchical Reinforcement Learning (HRL) algorithms by decomposing the complex learning problem into easier subtasks. Recent studies show that representations that preserve temporally abstract…

Machine Learning · Computer Science 2024-12-24 Mehdi Zadem , Sergio Mover , Sao Mai Nguyen

Automated scoring of written constructed responses typically relies on separate models per task, straining computational resources, storage, and maintenance in real-world education settings. We propose UniMoE-Guided, a knowledge-distilled…

Machine Learning · Computer Science 2025-11-25 Luyang Fang , Tao Wang , Ping Ma , Xiaoming Zhai

Reinforcement learning in problems with symbolic state spaces is challenging due to the need for reasoning over long horizons. This paper presents a new approach that utilizes relational abstractions in conjunction with deep learning to…

Machine Learning · Computer Science 2022-04-28 Rushang Karia , Siddharth Srivastava

Intelligent agents rely heavily on prior experience when learning a new task, yet most modern reinforcement learning (RL) approaches learn every task from scratch. One approach for leveraging prior knowledge is to transfer skills learned on…

Machine Learning · Computer Science 2020-10-23 Karl Pertsch , Youngwoon Lee , Joseph J. Lim

The learning efficiency and generalization ability of an intelligent agent can be greatly improved by utilizing a useful set of skills. However, the design of robot skills can often be intractable in real-world applications due to the…

Robotics · Computer Science 2021-06-29 Kuan Fang , Yuke Zhu , Silvio Savarese , Li Fei-Fei