中文
相关论文

相关论文: Efficient Expansion and Gradient Based Task Infere…

200 篇论文

Exemplar-free Class Incremental Learning (EFCIL) aims to sequentially learn tasks with access only to data from the current one. EFCIL is of interest because it mitigates concerns about privacy and long-term storage of data, while at the…

计算机视觉与模式识别 · 计算机科学 2024-03-28 Xialei Liu , Jiang-Tian Zhai , Andrew D. Bagdanov , Ke Li , Ming-Ming Cheng

Purpose: We propose a novel method for continual learning based on the increasing depth of neural networks. This work explores whether extending neural network depth may be beneficial in a life-long learning setting. Methods: We propose a…

机器学习 · 计算机科学 2023-05-09 Jędrzej Kozal , Michał Woźniak

Continual learning aims to provide intelligent agents that are capable of learning continually a sequence of tasks, building on previously learned knowledge. A key challenge in this learning paradigm is catastrophically forgetting…

机器学习 · 计算机科学 2021-01-18 Ghada Sokar , Decebal Constantin Mocanu , Mykola Pechenizkiy

We target open-world feature extrapolation problem where the feature space of input data goes through expansion and a model trained on partially observed features needs to handle new features in test data without further retraining. The…

机器学习 · 计算机科学 2023-06-14 Qitian Wu , Chenxiao Yang , Junchi Yan

While robot learning has demonstrated promising results for enabling robots to automatically acquire new skills, a critical challenge in deploying learning-based systems is scale: acquiring enough data for the robot to effectively…

机器人学 · 计算机科学 2020-03-06 Avi Singh , Eric Jang , Alexander Irpan , Daniel Kappler , Murtaza Dalal , Sergey Levine , Mohi Khansari , Chelsea Finn

This paper studies the challenging continual learning (CL) setting of Class Incremental Learning (CIL). CIL learns a sequence of tasks consisting of disjoint sets of concepts or classes. At any time, a single model is built that can be…

机器学习 · 计算机科学 2023-06-23 Gyuhak Kim , Changnan Xiao , Tatsuya Konishi , Bing Liu

Model free reinforcement learning suffers from the high sampling complexity inherent to robotic manipulation or locomotion tasks. Most successful approaches typically use random sampling strategies which leads to slow policy convergence. In…

机器人学 · 计算机科学 2019-08-13 Miroslav Bogdanovic , Ludovic Righetti

Most artificial intelligence models have limiting ability to solve new tasks faster, without forgetting previously acquired knowledge. The recently emerging paradigm of continual learning aims to solve this issue, in which the model learns…

机器学习 · 计算机科学 2018-06-01 Ju Xu , Zhanxing Zhu

Incremental Learning (IL) aims to learn deep models on sequential tasks continually, where each new task includes a batch of new classes and deep models have no access to task-ID information at the inference time. Recent vast pre-trained…

计算机视觉与模式识别 · 计算机科学 2024-07-08 Qian Feng , Hanbin Zhao , Chao Zhang , Jiahua Dong , Henghui Ding , Yu-Gang Jiang , Hui Qian

Task-free continual learning (CL) aims to learn a non-stationary data stream without explicit task definitions and not forget previous knowledge. The widely adopted memory replay approach could gradually become less effective for long data…

机器学习 · 计算机科学 2022-08-23 Zhenyi Wang , Li Shen , Le Fang , Qiuling Suo , Tiehang Duan , Mingchen Gao

Humans are capable of learning new tasks without forgetting previous ones, while neural networks fail due to catastrophic forgetting between new and previously-learned tasks. We consider a class-incremental setting which means that the…

计算机视觉与模式识别 · 计算机科学 2020-04-21 Xialei Liu , Chenshen Wu , Mikel Menta , Luis Herranz , Bogdan Raducanu , Andrew D. Bagdanov , Shangling Jui , Joost van de Weijer

Large language models (LLMs) often suffer from catastrophic forgetting in continual learning: after learning new tasks sequentially, they perform worse on earlier tasks. Existing methods mitigate catastrophic forgetting by data replay,…

机器学习 · 计算机科学 2026-05-08 Yazheng Liu , Yuxuan Wan , Rui Xu , Xi Zhang , Sihong Xie , Hui Xiong

Class Incremental Learning (CIL) constitutes a pivotal subfield within continual learning, aimed at enabling models to progressively learn new classification tasks while retaining knowledge obtained from prior tasks. Although previous…

机器学习 · 计算机科学 2025-01-14 Jaeill Kim , Wonseok Lee , Moonjung Eo , Wonjong Rhee

Class Incremental Learning (CIL) based on pre-trained models offers a promising direction for open-world continual learning. Existing methods typically rely on correlation-based strategies, where an image's classification feature is used as…

计算机视觉与模式识别 · 计算机科学 2025-05-20 Libo Huang , Zhulin An , Chuanguang Yang , Boyu Diao , Fei Wang , Yan Zeng , Zhifeng Hao , Yongjun Xu

This work proposes a new method to sequentially train deep neural networks on multiple tasks without suffering catastrophic forgetting, while endowing it with the capability to quickly adapt to unseen tasks. Starting from existing work on…

计算机视觉与模式识别 · 计算机科学 2023-02-02 Dhrupad Bhardwaj , Julia Kempe , Artem Vysogorets , Angela M. Teng , Evaristus C. Ezekwem

Deep learning models generally display catastrophic forgetting when learning new data continuously. Many incremental learning approaches address this problem by reusing data from previous tasks while learning new tasks. However, the direct…

机器学习 · 计算机科学 2024-11-12 Young Jo Choi , Min Kyoon Yoo , Yu Rang Park

Continual Learning (CL) involves training a machine learning model in a sequential manner to learn new information while retaining previously learned tasks without the presence of previous training data. Although there has been significant…

计算机视觉与模式识别 · 计算机科学 2023-08-23 Anurag Roy , Vinay Kumar Verma , Sravan Voonna , Kripabandhu Ghosh , Saptarshi Ghosh , Abir Das

Continual learning methods used to force neural networks to process sequential tasks in isolation, preventing them from leveraging useful inter-task relationships and causing them to repeatedly relearn similar features or overly…

机器学习 · 计算机科学 2025-11-14 Hyung-Jun Moon , Sung-Bae Cho

This paper presents a practical and simple yet efficient method to effectively deal with the catastrophic forgetting for Class Incremental Learning (CIL) tasks. CIL tends to learn new concepts perfectly, but not at the expense of…

机器学习 · 计算机科学 2021-03-30 Bahram Mohammadi , Mohammad Sabokrou

Random delays weaken the temporal correspondence between actions and subsequent state feedback, making it difficult for agents to identify the true propagation process of action effects. In cross-task scenarios, changes in task objectives…

机器学习 · 计算机科学 2026-05-13 Chenran Zhao , Dianxi Shi , Yaowen Zhang , Chunping Qiu , Shaowu Yang