中文
相关论文

相关论文: Understanding Imbalanced Forgetting in Rehearsal-B…

200 篇论文

Class-incremental learning (CIL) is a particularly challenging variant of continual learning, where the goal is to learn to discriminate between all classes presented in an incremental fashion. Existing approaches often suffer from…

机器学习 · 计算机科学 2024-03-12 Michał Zając , Tinne Tuytelaars , Gido M. van de Ven

Catastrophic forgetting is a significant challenge in the field of machine learning, particularly in neural networks. When a neural network learns to perform well on a new task, it often forgets its previously acquired knowledge or…

机器学习 · 计算机科学 2023-12-04 Nuri Korhan , Ceren Öner

This study focuses on incremental learning for image classification, exploring how to reduce catastrophic forgetting of all learned knowledge when access to old data is restricted. The challenge lies in balancing plasticity (learning new…

机器学习 · 计算机科学 2026-03-12 Zhiping Zhou , Xuchen Xie , Yiqiao Qiu , Run Lin , Weishi Zheng , Ruixuan Wang

Replaying past experiences has proven to be a highly effective approach for averting catastrophic forgetting in supervised continual learning. However, some crucial factors are still largely ignored, making it vulnerable to serious failure,…

机器学习 · 计算机科学 2023-11-21 Tiantian Zhang , Kevin Zehua Shen , Zichuan Lin , Bo Yuan , Xueqian Wang , Xiu Li , Deheng Ye

Continual learning (CL) aims to constantly learn new knowledge over time while avoiding catastrophic forgetting on old tasks. We focus on continual text classification under the class-incremental setting. Recent CL studies have identified…

计算与语言 · 计算机科学 2023-10-11 Yifan Song , Peiyi Wang , Weimin Xiong , Dawei Zhu , Tianyu Liu , Zhifang Sui , Sujian Li

Online continual learning is a challenging problem where models must learn from a non-stationary data stream while avoiding catastrophic forgetting. Inter-class imbalance during training has been identified as a major cause of forgetting,…

机器学习 · 计算机科学 2024-10-01 Zhehao Huang , Tao Li , Chenhe Yuan , Yingwen Wu , Xiaolin Huang

Incremental Task learning (ITL) is a category of continual learning that seeks to train a single network for multiple tasks (one after another), where training data for each task is only available during the training of that task. Neural…

计算机视觉与模式识别 · 计算机科学 2022-07-20 Rakib Hyder , Ken Shao , Boyu Hou , Panos Markopoulos , Ashley Prater-Bennette , M. Salman Asif

Multi-Class Incremental Learning (MCIL) aims to learn new concepts by incrementally updating a model trained on previous concepts. However, there is an inherent trade-off to effectively learning new concepts without catastrophic forgetting…

计算机视觉与模式识别 · 计算机科学 2021-04-06 Yaoyao Liu , Yuting Su , An-An Liu , Bernt Schiele , Qianru Sun

How to enable learnability for new classes while keeping the capability well on old classes has been a crucial challenge for class incremental learning. Beyond the normal case, long-tail class incremental learning and few-shot class…

机器学习 · 计算机科学 2023-08-04 Yibo Yang , Haobo Yuan , Xiangtai Li , Jianlong Wu , Lefei Zhang , Zhouchen Lin , Philip Torr , Dacheng Tao , Bernard Ghanem

Class-Incremental Learning (CIL) aims to train a reliable model with the streaming data, which emerges unknown classes sequentially. Different from traditional closed set learning, CIL has two main challenges: 1) Novel class detection. The…

机器学习 · 计算机科学 2020-09-01 Yang Yang , Zhen-Qiang Sun , HengShu Zhu , Yanjie Fu , Hui Xiong , Jian Yang

Class-incremental learning (CIL) aims to recognize new classes incrementally while maintaining the discriminability of old classes. Most existing CIL methods are exemplar-based, i.e., storing a part of old data for retraining. Without…

计算机视觉与模式识别 · 计算机科学 2024-07-22 Fei Zhu , Xu-Yao Zhang , Zhen Cheng , Cheng-Lin Liu

Class Incremental Learning (CIL) aims to handle the scenario where data of novel classes occur continuously and sequentially. The model should recognize the sequential novel classes while alleviating the catastrophic forgetting. In the…

计算机视觉与模式识别 · 计算机科学 2023-11-16 Xiaoshuang Chen , Zhongyi Sun , Ke Yan , Shouhong Ding , Hongtao Lu

Class-incremental learning in the context of limited personal labeled samples (few-shot) is critical for numerous real-world applications, such as smart home devices. A key challenge in these scenarios is balancing the trade-off between…

计算机视觉与模式识别 · 计算机科学 2025-01-28 Kirill Paramonov , Mete Ozay , Eunju Yang , Jijoong Moon , Umberto Michieli

Class-incremental learning (CIL) aims to adapt to continuously emerging new classes while preserving knowledge of previously learned ones. Few-shot class-incremental learning (FSCIL) presents a greater challenge that requires the model to…

人工智能 · 计算机科学 2025-08-19 Shiwon Kim , Dongjun Hwang , Sungwon Woo , Rita Singh

We propose Improved Memories Learning (IMeL), a novel algorithm that turns reinforcement learning (RL) into a supervised learning (SL) problem and delimits the role of neural networks (NN) to interpolation. IMeL consists of two components.…

机器学习 · 计算机科学 2020-08-25 Francesco Varoli , Guido Novati , Pantelis R. Vlachas , Petros Koumoutsakos

Continual learning (CL) is a setting in which an agent has to learn from an incoming stream of data sequentially. CL performance evaluates the model's ability to continually learn and solve new problems with incremental available…

机器学习 · 计算机科学 2022-05-04 Josh Andle , Salimeh Yasaei Sekeh

Class-Incremental learning (CIL) refers to the ability of artificial agents to integrate new classes as they appear in a stream. It is particularly interesting in evolving environments where agents have limited access to memory and…

计算机视觉与模式识别 · 计算机科学 2024-04-10 Eden Belouadah , Arnaud Dapogny , Kevin Bailly

Class-incremental learning (CIL) aims to train a model to learn new classes from non-stationary data streams without forgetting old ones. In this paper, we propose a new kind of connectionist model by tailoring neural unit dynamics that…

机器学习 · 计算机科学 2024-06-05 Depeng Li , Tianqi Wang , Junwei Chen , Wei Dai , Zhigang Zeng

Deep neural networks suffer from catastrophic forgetting, where performance on previous tasks degrades after training on a new task. This issue arises due to the model's tendency to overwrite previously acquired knowledge with new…

Modern computer vision applications suffer from catastrophic forgetting when incrementally learning new concepts over time. The most successful approaches to alleviate this forgetting require extensive replay of previously seen data, which…

计算机视觉与模式识别 · 计算机科学 2021-08-20 James Smith , Yen-Chang Hsu , Jonathan Balloch , Yilin Shen , Hongxia Jin , Zsolt Kira