English
Related papers

Related papers: Incremental Learning of Retrievable Skills For Eff…

200 papers

Real-world applications require the classification model to adapt to new classes without forgetting old ones. Correspondingly, Class-Incremental Learning (CIL) aims to train a model with limited memory size to meet this requirement. Typical…

Machine Learning · Computer Science 2023-02-17 Da-Wei Zhou , Qi-Wei Wang , Han-Jia Ye , De-Chuan Zhan

In-context learning (ICL) enables large language models (LLMs) to adapt to new tasks during inference using only a few demonstrations. However, ICL performance is highly dependent on the selection of these demonstrations. Recent work…

Machine Learning · Computer Science 2025-05-27 Zheng Zhang , Shaocheng Lan , Lei Song , Jiang Bian , Yexin Li , Kan Ren

The remarkable ability of Large Language Models (LLMs) to understand and follow instructions has sometimes been limited by their in-context learning (ICL) performance in low-resource languages. To address this, we introduce a novel approach…

Computation and Language · Computer Science 2023-12-06 Xiaoqian Li , Ercong Nie , Sheng Liang

Imitation Learning (IL), also referred to as Learning from Demonstration (LfD), holds significant promise for capturing expert motor skills through efficient imitation, facilitating adept navigation of complex scenarios. A persistent…

Robotics · Computer Science 2024-04-01 Yingbai Hu , Fares J. Abu-Dakka , Fei Chen , Xiao Luo , Zheng Li , Alois Knoll , Weiping Ding

Recent advancements in video large multimodal models (LMMs) have significantly improved their video understanding and reasoning capabilities. However, their performance drops on out-of-distribution (OOD) tasks that are underrepresented in…

Computer Vision and Pattern Recognition · Computer Science 2024-12-04 Kangsan Kim , Geon Park , Youngwan Lee , Woongyeong Yeo , Sung Ju Hwang

Demonstrations are commonly used to speed up the learning process of Deep Reinforcement Learning algorithms. To cope with the difficulty of accessing multiple demonstrations, some algorithms have been developed to learn from a single…

Robotics · Computer Science 2024-02-15 Alexandre Chenu , Olivier Serris , Olivier Sigaud , Nicolas Perrin-Gilbert

Class-Incremental Learning (CIL) aims to sequentially learn new classes while mitigating catastrophic forgetting of previously learned knowledge. Conventional CIL approaches implicitly assume that classes are morphologically static,…

Machine Learning · Computer Science 2026-02-03 Zheng Zhang , Tao Hu , Xueheng Li , Yang Wang , Rui Li , Jie Zhang , Chengjun Xie

Imitation learning (IL) enables agents to acquire skills by observing and replicating the behavior of one or multiple experts. In recent years, advances in deep learning have significantly expanded the capabilities and scalability of…

Machine Learning · Computer Science 2025-11-06 Iason Chrysomallis , Georgios Chalkiadakis

Imitation Learning (IL) is an appealing approach to learn desirable autonomous behavior. However, directing IL to achieve arbitrary goals is difficult. In contrast, planning-based algorithms use dynamics models and reward functions to…

Machine Learning · Computer Science 2019-10-02 Nicholas Rhinehart , Rowan McAllister , Sergey Levine

Assistant AI agents should be capable of rapidly acquiring novel skills and adapting to new user preferences. Traditional frameworks like imitation learning and reinforcement learning do not facilitate this capability because they support…

Machine Learning · Computer Science 2023-10-23 Ruijie Zheng , Khanh Nguyen , Hal Daumé , Furong Huang , Karthik Narasimhan

Inverse Reinforcement Learning (IRL) aims to reconstruct the reward function from expert demonstrations to facilitate policy learning, and has demonstrated its remarkable success in imitation learning. To promote expert-like behavior,…

Machine Learning · Computer Science 2023-06-16 Shunyu Liu , Yunpeng Qing , Shuqi Xu , Hongyan Wu , Jiangtao Zhang , Jingyuan Cong , Tianhao Chen , Yunfu Liu , Mingli Song

Task-incremental continual learning refers to continually training a model in a sequence of tasks while overcoming the problem of catastrophic forgetting (CF). The issue arrives for the reason that the learned representations are forgotten…

Machine Learning · Computer Science 2023-05-23 Yun Luo , Xiaotian Lin , Zhen Yang , Fandong Meng , Jie Zhou , Yue Zhang

Class-Incremental Learning (CIL) aims to continuously acquire new categories while preserving previously learned knowledge. Recently, Contrastive Language-Image Pre-trained (CLIP) models have shown strong potential for CIL due to their…

Computer Vision and Pattern Recognition · Computer Science 2026-04-21 Tianqi Wang , Jingcai Guo

Class incremental semantic segmentation (CISS) aims to segment new classes during continual steps while preventing the forgetting of old knowledge. Existing methods alleviate catastrophic forgetting by replaying distributions of previously…

Computer Vision and Pattern Recognition · Computer Science 2024-12-18 Guilin Zhu , Dongyue Wu , Changxin Gao , Runmin Wang , Weidong Yang , Nong Sang

In-context imitation learning enables robots to adapt to new tasks from a small number of demonstrations without additional training. However, existing approaches typically condition only on state-action trajectories and lack explicit…

Robotics · Computer Science 2026-03-10 Toan Nguyen , Weiduo Yuan , Songlin Wei , Hui Li , Daniel Seita , Yue Wang

Instruction tuning effectively optimizes Large Language Models (LLMs) for downstream tasks. Due to the changing environment in real-life applications, LLMs necessitate continual task-specific adaptation without catastrophic forgetting.…

Computation and Language · Computer Science 2024-03-19 Yifan Wang , Yafei Liu , Chufan Shi , Haoling Li , Chen Chen , Haonan Lu , Yujiu Yang

Continual learning (CL) is the sub-field of machine learning concerned with accumulating knowledge in dynamic environments. So far, CL research has mainly focused on incremental classification tasks, where models learn to classify new…

Growing demands in today's industry results in increasingly stringent performance and throughput specifications. For accurate positioning of high-precision motion systems, feedforward control plays a crucial role. Nonetheless, conventional…

Systems and Control · Electrical Eng. & Systems 2023-03-28 Anantha Sai Hariharan Vinjarapu , Yorick Broens , Hans Butler , Roland Tóth

Class-incremental learning (CIL) aims to adapt to emerging new classes without forgetting old ones. Traditional CIL models are trained from scratch to continually acquire knowledge as data evolves. Recently, pre-training has achieved…

Machine Learning · Computer Science 2024-08-06 Da-Wei Zhou , Zi-Wen Cai , Han-Jia Ye , De-Chuan Zhan , Ziwei Liu

Autonomous driving systems need to handle complex scenarios such as lane following, avoiding collisions, taking turns, and responding to traffic signals. In recent years, approaches based on end-to-end behavioral cloning have demonstrated…

Robotics · Computer Science 2021-04-23 Keishi Ishihara , Anssi Kanervisto , Jun Miura , Ville Hautamäki