English
Related papers

Related papers: Task-agnostic Lifelong Robot Learning with Retriev…

200 papers

Task-free continual learning (CL) aims to learn a non-stationary data stream without explicit task definitions and not forget previous knowledge. The widely adopted memory replay approach could gradually become less effective for long data…

Machine Learning · Computer Science 2022-08-23 Zhenyi Wang , Li Shen , Le Fang , Qiuling Suo , Tiehang Duan , Mingchen Gao

A fundamental requirement for intelligent systems is the ability to learn continuously under changing environments. However, models trained in this regime often suffer from catastrophic forgetting. Leveraging pre-trained models has recently…

Artificial Intelligence · Computer Science 2026-03-12 Tung Tran , Danilo Vasconcellos Vargas , Khoat Than

Lifelong language learning seeks to have models continuously learn multiple tasks in a sequential order without suffering from catastrophic forgetting. State-of-the-art approaches rely on sparse experience replay as the primary approach to…

Computation and Language · Computer Science 2022-10-04 Vladimir Araujo , Helena Balabin , Julio Hurtado , Alvaro Soto , Marie-Francine Moens

We treat the problem of autonomous acquisition of manipulation skills where problem-solving strategies are initially available only for a narrow range of situations. We propose to extend the range of solvable situations by autonomous…

Robotics · Computer Science 2017-06-28 Simon Hangl , Vedran Dunjko , Hans J. Briegel , Justus Piater

In the future, service robots are expected to be able to operate autonomously for long periods of time without human intervention. Many work striving for this goal have been emerging with the development of robotics, both hardware and…

Robotics · Computer Science 2023-01-23 Zhi Yan , Li Sun , Tomas Krajnik , Tom Duckett , Nicola Bellotto

Continual learning (CL) -- the ability to continuously learn, building on previously acquired knowledge -- is a natural requirement for long-lived autonomous reinforcement learning (RL) agents. While building such agents, one needs to…

Machine Learning · Computer Science 2021-10-29 Maciej Wołczyk , Michał Zając , Razvan Pascanu , Łukasz Kuciński , Piotr Miłoś

Contact-rich manipulation tasks are commonly found in modern manufacturing settings. However, manually designing a robot controller is considered hard for traditional control methods as the controller requires an effective combination of…

Robotics · Computer Science 2020-10-27 Yunlei Shi , Zhaopeng Chen , Hongxu Liu , Sebastian Riedel , Chunhui Gao , Qian Feng , Jun Deng , Jianwei Zhang

Current natural language processing models work well on a single task, yet they often fail to continuously learn new tasks without forgetting previous ones as they are re-trained throughout their lifetime, a challenge known as lifelong…

Computation and Language · Computer Science 2020-10-07 Zirui Wang , Sanket Vaibhav Mehta , Barnabás Póczos , Jaime Carbonell

Humans are highly effective at utilizing prior knowledge to adapt to novel tasks, a capability that standard machine learning models struggle to replicate due to their reliance on task-specific training. Meta-learning overcomes this…

Artificial Intelligence · Computer Science 2026-05-07 Björn Hoppmann , Christoph Scholz

Representation learning based on multi-task pretraining has become a powerful approach in many domains. In particular, task-aware representation learning aims to learn an optimal representation for a specific target task by sampling data…

Machine Learning · Computer Science 2023-06-16 Yifang Chen , Yingbing Huang , Simon S. Du , Kevin Jamieson , Guanya Shi

The transition to agile manufacturing, Industry 4.0, and high-mix-low-volume tasks require robot programming solutions that are flexible. However, most deployed robot solutions are still statically programmed and use stiff position control,…

Robotics · Computer Science 2023-08-29 Matthias Mayr , Faseeh Ahmad , Alexander Duerr , Volker Krueger

The creation of machine learning algorithms for intelligent agents capable of continuous, lifelong learning is a critical objective for algorithms being deployed on real-life systems in dynamic environments. Here we present an algorithm…

Machine Learning · Computer Science 2020-01-28 Andrew Brna , Ryan Brown , Patrick Connolly , Stephen Simons , Renee Shimizu , Mario Aguilar-Simon

Meta-learning approaches have been proposed to tackle the few-shot learning problem.Typically, a meta-learner is trained on a variety of tasks in the hopes of being generalizable to new tasks. However, the generalizability on new tasks of a…

Machine Learning · Computer Science 2018-05-22 Muhammad Abdullah Jamal , Guo-Jun Qi , Mubarak Shah

Meta-reinforcement learning algorithms provide a data-driven way to acquire policies that quickly adapt to many tasks with varying rewards or dynamics functions. However, learned meta-policies are often effective only on the exact task…

Machine Learning · Computer Science 2023-07-13 Anurag Ajay , Abhishek Gupta , Dibya Ghosh , Sergey Levine , Pulkit Agrawal

We propose a method for meta-learning reinforcement learning algorithms by searching over the space of computational graphs which compute the loss function for a value-based model-free RL agent to optimize. The learned algorithms are…

Machine Learning · Computer Science 2022-11-11 John D. Co-Reyes , Yingjie Miao , Daiyi Peng , Esteban Real , Sergey Levine , Quoc V. Le , Honglak Lee , Aleksandra Faust

Continual learning (CL) is concerned with learning multiple tasks sequentially without forgetting previously learned tasks. Despite substantial empirical advances over recent years, the theoretical development of CL remains in its infancy.…

Machine Learning · Computer Science 2026-04-27 Liangzu Peng , Uday Kiran Reddy Tadipatri , Ziqing Xu , Eric Eaton , René Vidal

Learning to manipulate objects efficiently, particularly those involving sustained contact (e.g., pushing, sliding) and articulated parts (e.g., drawers, doors), presents significant challenges. Traditional methods, such as robot-centric…

Robotics · Computer Science 2025-03-18 Shijie Fang , Wenchang Gao , Shivam Goel , Christopher Thierauf , Matthias Scheutz , Jivko Sinapov

Vision-language-action (VLA) models provide a promising foundation for general-purpose robotics. However, their successful deployment in real-world scenarios requires the ability to continually acquire new skills while retaining previously…

Robotics · Computer Science 2026-05-27 Jiarun Zhu , Yijun Hong , Xiaoquan Sun , Zetian Xu , Mingqi Yuan , Zhiyong Wang , Wenjun Zeng , Jiayu Chen

Continual learning refers to the capability of a machine learning model to learn and adapt to new information, without compromising its performance on previously learned tasks. Although several studies have investigated continual learning…

Information Retrieval · Computer Science 2024-06-21 Jingrui Hou , Georgina Cosma , Axel Finke