English
Related papers

Related papers: Think Small, Act Big: Primitive Prompt Learning fo…

200 papers

Learning from human involvement aims to incorporate the human subject to monitor and correct agent behavior errors. Although most interactive imitation learning methods focus on correcting the agent's action at the current state, they do…

Machine Learning · Computer Science 2025-10-17 Haoyuan Cai , Zhenghao Peng , Bolei Zhou

Building agentic systems that can autonomously self-improve from experience is a longstanding goal of AI. Large language models (LLMs) today primarily self-improve via two mechanisms: self-reflection for context updates, and reinforcement…

Artificial Intelligence · Computer Science 2026-02-26 Lunjun Zhang , Ryan Chen , Bradly C. Stadie

We explore beyond existing work on learning from demonstration by asking the question: Can robots learn to teach?, that is, can a robot autonomously learn an instructional policy from expert demonstration and use it to instruct or…

Robotics · Computer Science 2016-11-23 Harshal Maske , Emily Kieson , Girish Chowdhary , Charles Abramson

A fundamental objective in intelligent robotics is to move towards lifelong learning robot that can learn and adapt to unseen scenarios over time. However, continually learning new tasks would introduce catastrophic forgetting problems due…

Robotics · Computer Science 2025-09-16 Pengzhi Yang , Xinyu Wang , Ruipeng Zhang , Cong Wang , Frans A. Oliehoek , Jens Kober

Robot learning has proven to be a general and effective technique for programming manipulators. Imitation learning is able to teach robots solely from human demonstrations but is bottlenecked by the capabilities of the demonstrations.…

Robotics · Computer Science 2024-10-24 Zihan Zhou , Animesh Garg , Dieter Fox , Caelan Garrett , Ajay Mandlekar

This paper introduces a discrete-continuous action space to learn insertion primitives for robotic assembly tasks. Primitive is a sequence of elementary actions with certain exit conditions, such as "pushing down the peg until contact".…

Robotics · Computer Science 2021-10-26 Xiang Zhang , Shiyu Jin , Changhao Wang , Xinghao Zhu , Masayoshi Tomizuka

The development of a generalist agent with adaptive multiple manipulation skills has been a long-standing goal in the robotics community. In this paper, we explore a crucial task, skill-incremental learning, in robotic manipulation, which…

Robotics · Computer Science 2025-03-11 Zexin Zheng , Jia-Feng Cai , Xiao-Ming Wu , Yi-Lin Wei , Yu-Ming Tang , Wei-Shi Zheng

The objective of this work is to augment the basic abilities of a robot by learning to use new sensorimotor primitives to enable the solution of complex long-horizon problems. Solving long-horizon problems in complex domains requires…

Robotics · Computer Science 2018-08-14 Zi Wang , Caelan Reed Garrett , Leslie Pack Kaelbling , Tomás Lozano-Pérez

The pre-trained foundation models (PFMs) have become essential for facilitating large-scale multimodal learning. Researchers have effectively employed the ``pre-train, prompt, and predict'' paradigm through prompt learning to induce…

Computation and Language · Computer Science 2025-12-24 Xiang Chen , Yixin Ou , Quan Feng , Lei Li , Piji Li , Haibo Ye , Sheng-Jun Huang , Shuofei Qiao , Shumin Deng , Huajun Chen , Ningyu Zhang

Demonstration-guided reinforcement learning (RL) is a promising approach for learning complex behaviors by leveraging both reward feedback and a set of target task demonstrations. Prior approaches for demonstration-guided RL treat every new…

Machine Learning · Computer Science 2021-07-22 Karl Pertsch , Youngwoon Lee , Yue Wu , Joseph J. Lim

Recent robot learning methods commonly rely on imitation learning from massive robotic dataset collected with teleoperation. When facing a new task, such methods generally require collecting a set of new teleoperation data and finetuning…

Robotics · Computer Science 2025-05-28 Xiang Zhu , Yichen Liu , Hezhong Li , Jianyu Chen

The mainstream paradigm behind continual learning has been to adapt the model parameters to non-stationary data distributions, where catastrophic forgetting is the central challenge. Typical methods rely on a rehearsal buffer or known task…

Machine Learning · Computer Science 2022-03-23 Zifeng Wang , Zizhao Zhang , Chen-Yu Lee , Han Zhang , Ruoxi Sun , Xiaoqi Ren , Guolong Su , Vincent Perot , Jennifer Dy , Tomas Pfister

Intelligent agents rely heavily on prior experience when learning a new task, yet most modern reinforcement learning (RL) approaches learn every task from scratch. One approach for leveraging prior knowledge is to transfer skills learned on…

Machine Learning · Computer Science 2020-10-23 Karl Pertsch , Youngwoon Lee , Joseph J. Lim

While Pre-trained Language Models (PLMs) internalize a great amount of world knowledge, they have been shown incapable of recalling these knowledge to solve tasks requiring complex & multi-step reasoning. Similar to how humans develop a…

Computation and Language · Computer Science 2022-10-25 Boshi Wang , Xiang Deng , Huan Sun

Prompt-based continual learning methods fine-tune only a small set of additional learnable parameters while keeping the pre-trained model's parameters frozen. It enables efficient adaptation to new tasks while mitigating the risk of…

Computer Vision and Pattern Recognition · Computer Science 2026-05-11 Shengqin Jiang , Tianqi Kong , Yuankai Qi , Haokui Zhang , Lina Yao , Quan Z. Sheng , Qingshan Liu , Ming-Hsuan Yang

Movement primitives (MPs) are compact representations of robot skills that can be learned from demonstrations and combined into complex behaviors. However, merely equipping robots with a fixed set of innate MPs is insufficient to deploy…

Robotics · Computer Science 2024-10-28 Tilman Daab , Noémie Jaquier , Christian Dreher , Andre Meixner , Franziska Krebs , Tamim Asfour

Contemporary continual learning approaches typically select prompts from a pool, which function as supplementary inputs to a pre-trained model. However, this strategy is hindered by the inherent noise of its selection approach when handling…

Computer Vision and Pattern Recognition · Computer Science 2024-04-30 Yong Dai , Xiaopeng Hong , Yabin Wang , Zhiheng Ma , Dongmei Jiang , Yaowei Wang

Developing robotic agents that can perform well in diverse environments while showing a variety of behaviors is a key challenge in AI and robotics. Traditional reinforcement learning (RL) methods often create agents that specialize in…

Robotics · Computer Science 2025-03-25 Octi Zhang , Quanquan Peng , Rosario Scalise , Bryon Boots

One of the challenges of open-ended learning in robots is the need to autonomously discover goals and learn skills to achieve them. However, when in lifelong learning settings, it is always desirable to generate sub-goals with their…

A robot deployed in a home over long stretches of time faces a true lifelong learning problem. As it seeks to provide assistance to its users, the robot should leverage any accumulated experience to improve its own knowledge and…

Robotics · Computer Science 2023-11-07 Jorge Mendez-Mendez , Leslie Pack Kaelbling , Tomás Lozano-Pérez