中文
相关论文

相关论文: Balanced Destruction-Reconstruction Dynamics for M…

200 篇论文

The staple of human intelligence is the capability of acquiring knowledge in a continuous fashion. In stark contrast, Deep Networks forget catastrophically and, for this reason, the sub-field of Class-Incremental Continual Learning fosters…

机器学习 · 计算机科学 2022-09-20 Matteo Boschini , Lorenzo Bonicelli , Pietro Buzzega , Angelo Porrello , Simone Calderara

Continual learning has been a major problem in the deep learning community, where the main challenge is how to effectively learn a series of newly arriving tasks without forgetting the knowledge of previous tasks. Initiated by Learning…

机器学习 · 计算机科学 2021-07-06 Jong-Yeong Kim , Dong-Wan Choi

This paper introduces a novel perspective to significantly mitigate catastrophic forgetting in continuous learning (CL), which emphasizes models' capacity to preserve existing knowledge and assimilate new information. Current replay-based…

机器学习 · 计算机科学 2024-04-10 Jianshu Zhang , Yankai Fu , Ziheng Peng , Dongyu Yao , Kun He

Modulation recognition is a fundamental task in communication systems as the accurate identification of modulation schemes is essential for reliable signal processing, interference mitigation for coexistent communication technologies, and…

信号处理 · 电气工程与系统科学 2023-12-11 Ali Owfi , Ali Abbasi , Fatemeh Afghah , Jonathan Ashdown , Kurt Turck

Deep neural networks perform remarkably well in close-world scenarios. However, novel classes emerged continually in real applications, making it necessary to learn incrementally. Class-incremental learning (CIL) aims to gradually recognize…

计算机视觉与模式识别 · 计算机科学 2024-03-28 Wenzhuo Liu , Fei Zhu , Cheng-Lin Liu

Incremental learning aims to enable models to continuously acquire knowledge from evolving data streams while preserving previously learned capabilities. While current research predominantly focuses on unimodal incremental learning and…

机器学习 · 计算机科学 2025-04-21 Yaguang Song , Xiaoshan Yang , Dongmei Jiang , Yaowei Wang , Changsheng Xu

Class incremental learning consists in training discriminative models to classify an increasing number of classes over time. However, doing so using only the newly added class data leads to the known problem of catastrophic forgetting of…

机器学习 · 计算机科学 2024-05-15 Quentin Ferdinand , Gilles Le Chenadec , Benoit Clement , Panagiotis Papadakis , Quentin Oliveau

In federated healthcare systems, Federated Class-Incremental Learning (FCIL) has emerged as a key paradigm, enabling continuous adaptive model learning among distributed clients while safeguarding data privacy. However, in practical…

机器学习 · 计算机科学 2026-03-31 Tiantian Wang , Xiang Xiang , Simon S. Du

Class-Incremental Learning (CIL) struggles with catastrophic forgetting when learning new knowledge, and Data-Free CIL (DFCIL) is even more challenging without access to the training data of previously learned classes. Though recent DFCIL…

计算机视觉与模式识别 · 计算机科学 2022-07-22 Qiankun Gao , Chen Zhao , Bernard Ghanem , Jian Zhang

Continual learning, involving sequential training on diverse tasks, often faces catastrophic forgetting. While knowledge distillation-based approaches exhibit notable success in preventing forgetting, we pinpoint a limitation in their…

机器学习 · 计算机科学 2024-05-17 Zenglin Shi , Pei Liu , Tong Su , Yunpeng Wu , Kuien Liu , Yu Song , Meng Wang

We present a novel Balanced Incremental Model Agnostic Meta Learning system (BI-MAML) for learning multiple tasks. Our method implements a meta-update rule to incrementally adapt its model to new tasks without forgetting old tasks. Such a…

机器学习 · 计算机科学 2020-06-16 Yang Zheng , Jinlin Xiang , Kun Su , Eli Shlizerman

Continual learning (CL) aims to constantly learn new knowledge over time while avoiding catastrophic forgetting on old tasks. We focus on continual text classification under the class-incremental setting. Recent CL studies have identified…

计算与语言 · 计算机科学 2023-10-11 Yifan Song , Peiyi Wang , Weimin Xiong , Dawei Zhu , Tianyu Liu , Zhifang Sui , Sujian Li

Segment Anything Model (SAM) struggles in open-world scenarios with diverse domains. In such settings, naive fine-tuning with a well-designed learning module is inadequate and often causes catastrophic forgetting issue when learning…

计算机视觉与模式识别 · 计算机科学 2025-12-09 Zeqing Wang , Kangye Ji , Di Wang , Haibin Zhang , Fei Cheng

Continual Reinforcement Learning (CRL) aims to develop lifelong learning agents to continuously acquire knowledge across diverse tasks while mitigating catastrophic forgetting. This requires efficiently managing the stability-plasticity…

机器学习 · 计算机科学 2026-02-02 Yuxuan Li , Qijun He , Mingqi Yuan , Wen-Tse Chen , Jeff Schneider , Jiayu Chen

Intelligent fault diagnosis has made extraordinary advancements currently. Nonetheless, few works tackle class-incremental learning for fault diagnosis under limited fault data, i.e., imbalanced and long-tailed fault diagnosis, which brings…

机器学习 · 计算机科学 2023-02-14 Peng Peng , Hanrong Zhang , Mengxuan Li , Gongzhuang Peng , Hongwei Wang , Weiming Shen

Deep learning models suffer from catastrophic forgetting when learning new tasks incrementally. Incremental learning has been proposed to retain the knowledge of old classes while learning to identify new classes. A typical approach is to…

计算机视觉与模式识别 · 计算机科学 2022-07-14 Huitong Chen , Yu Wang , Qinghua Hu

Online Continual Learning (CL) solves the problem of learning the ever-emerging new classification tasks from a continuous data stream. Unlike its offline counterpart, in online CL, the training data can only be seen once. Most existing…

机器学习 · 计算机科学 2024-04-02 Maorong Wang , Nicolas Michel , Ling Xiao , Toshihiko Yamasaki

Continual Learning (CL) is a field dedicated to devise algorithms able to achieve lifelong learning. Overcoming the knowledge disruption of previously acquired concepts, a drawback affecting deep learning models and that goes by the name of…

计算机视觉与模式识别 · 计算机科学 2023-01-04 Francesco Pelosin

Deep learning systems are prone to catastrophic forgetting when learning from a sequence of tasks, as old data from previous tasks is unavailable when learning a new task. To address this, some methods propose replaying data from previous…

计算机视觉与模式识别 · 计算机科学 2025-03-11 Chenyang Wang , Junjun Jiang , Xingyu Hu , Xianming Liu , Xiangyang Ji

Many deep learning applications, like keyword spotting, require the incorporation of new concepts (classes) over time, referred to as Class Incremental Learning (CIL). The major challenge in CIL is catastrophic forgetting, i.e., preserving…

机器学习 · 计算机科学 2022-04-28 Dong Ma , Chi Ian Tang , Cecilia Mascolo