中文
相关论文

相关论文: FearNet: Brain-Inspired Model for Incremental Lear…

200 篇论文

Algorithm selection is commonly used to predict the best solver from a portfolio per per-instance. In many real scenarios, instances arrive in a stream: new instances become available over time, while the number of class labels can also…

机器学习 · 计算机科学 2025-06-03 Mate Botond Nemeth , Emma Hart , Kevin Sim , Quentin Renau

According to the Complementary Learning Systems (CLS) theory~\cite{mcclelland1995there} in neuroscience, humans do effective \emph{continual learning} through two complementary systems: a fast learning system centered on the hippocampus for…

人工智能 · 计算机科学 2023-07-11 Quang Pham , Chenghao Liu , Steven C. H. Hoi

Incremental Task learning (ITL) is a category of continual learning that seeks to train a single network for multiple tasks (one after another), where training data for each task is only available during the training of that task. Neural…

计算机视觉与模式识别 · 计算机科学 2022-07-20 Rakib Hyder , Ken Shao , Boyu Hou , Panos Markopoulos , Ashley Prater-Bennette , M. Salman Asif

Continual learning aims to learn continuously from a stream of tasks and data in an online-learning fashion, being capable of exploiting what was learned previously to improve current and future tasks while still being able to perform well…

机器学习 · 计算机科学 2020-07-31 Quang Pham , Doyen Sahoo , Chenghao Liu , Steven C. H Hoi

Privacy concerns associated with machine learning models have driven research into machine unlearning, which aims to erase the memory of specific target training data from already trained models. This issue also arises in federated…

机器学习 · 计算机科学 2025-03-14 Yuyuan Li , Jiaming Zhang , Yixiu Liu , Chaochao Chen

Continual learning (or class incremental learning) is a realistic learning scenario for computer vision systems, where deep neural networks are trained on episodic data, and the data from previous episodes are generally inaccessible to the…

计算机视觉与模式识别 · 计算机科学 2026-02-05 Aditya R. Bhattacharya , Debanjan Goswami , Shayok Chakraborty

Humans can continuously learn new knowledge. However, machine learning models suffer from drastic dropping in performance on previous tasks after learning new tasks. Cognitive science points out that the competition of similar knowledge is…

计算机视觉与模式识别 · 计算机科学 2022-11-01 Runqi Wang , Yuxiang Bao , Baochang Zhang , Jianzhuang Liu , Wentao Zhu , Guodong Guo

We propose Improved Memories Learning (IMeL), a novel algorithm that turns reinforcement learning (RL) into a supervised learning (SL) problem and delimits the role of neural networks (NN) to interpolation. IMeL consists of two components.…

机器学习 · 计算机科学 2020-08-25 Francesco Varoli , Guido Novati , Pantelis R. Vlachas , Petros Koumoutsakos

In the scenario of class-incremental learning (CIL), deep neural networks have to adapt their model parameters to non-stationary data distributions, e.g., the emergence of new classes over time. However, CIL models are challenged by the…

机器学习 · 计算机科学 2023-06-22 Depeng Li , Zhigang Zeng

Human intelligence gradually accepts new information and accumulates knowledge throughout the lifespan. However, deep learning models suffer from a catastrophic forgetting phenomenon, where they forget previous knowledge when acquiring new…

计算机视觉与模式识别 · 计算机科学 2023-05-10 Jisu Han , Jaemin Na , Wonjun Hwang

In class-incremental learning, the model is expected to learn new classes continually while maintaining knowledge on previous classes. The challenge here lies in preserving the model's ability to effectively represent prior classes in the…

计算机视觉与模式识别 · 计算机科学 2022-08-17 Arjun Ashok , K J Joseph , Vineeth Balasubramanian

It is an important yet challenging setting to continually learn new tasks from a few examples. Although numerous efforts have been devoted to either continual learning or few-shot learning, little work has considered this new setting of…

机器学习 · 计算机科学 2021-04-20 Liyuan Wang , Qian Li , Yi Zhong , Jun Zhu

Deep networks allow to obtain outstanding results in semantic segmentation, however they need to be trained in a single shot with a large amount of data. Continual learning settings where new classes are learned in incremental steps and…

计算机视觉与模式识别 · 计算机科学 2021-09-21 Andrea Maracani , Umberto Michieli , Marco Toldo , Pietro Zanuttigh

This work proposes a minimal computational model for learning structured memories of multiple object classes in an incremental setting. Our approach is based on establishing a closed-loop transcription between the classes and a…

计算机视觉与模式识别 · 计算机科学 2023-06-08 Shengbang Tong , Xili Dai , Ziyang Wu , Mingyang Li , Brent Yi , Yi Ma

Incremental Learning (IL) has been a long-standing problem in both vision and Natural Language Processing (NLP) communities. In recent years, as Pre-trained Language Models (PLMs) have achieved remarkable progress in various NLP downstream…

计算与语言 · 计算机科学 2024-08-09 Junhao Zheng , Shengjie Qiu , Qianli Ma

Class-Incremental Learning aims to update a deep classifier to learn new categories while maintaining or improving its accuracy on previously observed classes. Common methods to prevent forgetting previously learned classes include…

机器学习 · 计算机科学 2024-07-02 Elif Ceren Gok Yildirim , Murat Onur Yildirim , Mert Kilickaya , Joaquin Vanschoren

Continual learning (CL) aims to learn new tasks while retaining past knowledge, addressing the challenge of forgetting during task adaptation. Rehearsal-based methods, which replay previous samples, effectively mitigate forgetting. However,…

计算机视觉与模式识别 · 计算机科学 2025-03-31 Ruiqi Liu , Boyu Diao , Libo Huang , Hangda Liu , Chuanguang Yang , Zhulin An , Yongjun Xu

In Continual Learning, a Neural Network is trained on a stream of data whose distribution shifts over time. Under these assumptions, it is especially challenging to improve on classes appearing later in the stream while remaining accurate…

机器学习 · 计算机科学 2020-10-13 Pietro Buzzega , Matteo Boschini , Angelo Porrello , Simone Calderara

Scarcity of data and incremental learning of new tasks pose two major bottlenecks for many modern computer vision algorithms. The phenomenon of catastrophic forgetting, i.e., the model's inability to classify previously learned data after…

计算机视觉与模式识别 · 计算机科学 2023-09-06 Sanchar Palit , Biplab Banerjee , Subhasis Chaudhuri

Class incremental learning consists in training discriminative models to classify an increasing number of classes over time. However, doing so using only the newly added class data leads to the known problem of catastrophic forgetting of…

机器学习 · 计算机科学 2024-05-15 Quentin Ferdinand , Gilles Le Chenadec , Benoit Clement , Panagiotis Papadakis , Quentin Oliveau