中文
相关论文

相关论文: ER-FSL: Experience Replay with Feature Subspace Le…

200 篇论文

Online Continual Learning (OCL) models continuously adapt to nonstationary data streams, usually without task information. These settings are complex and many traditional CL methods fail, while online methods (mainly replay-based) suffer…

机器学习 · 计算机科学 2025-02-05 Edoardo Urettini , Antonio Carta

Continual Learning enables models to learn and adapt to new tasks while retaining prior knowledge. Introducing new tasks, however, can naturally lead to feature entanglement across tasks, limiting the model's capability to distinguish…

机器学习 · 计算机科学 2025-01-14 Zhongyi Zhou , Yaxin Peng , Pin Yi , Minjie Zhu , Chaomin Shen

Continual learning aims to learn continuously from a stream of tasks and data in an online-learning fashion, being capable of exploiting what was learned previously to improve current and future tasks while still being able to perform well…

机器学习 · 计算机科学 2020-07-31 Quang Pham , Doyen Sahoo , Chenghao Liu , Steven C. H Hoi

Machine unlearning seeks to remove the influence of particular data or class from trained models to meet privacy, legal, or ethical requirements. Existing unlearning methods tend to forget shallowly: phenomenon of an unlearned model pretend…

机器学习 · 计算机科学 2025-07-23 Jaeheun Jung , Bosung Jung , Suhyun Bae , Donghun Lee

Continual learning (CL) refers to the ability to continually learn over time by accommodating new knowledge while retaining previously learned experience. While this concept is inherent in human learning, current machine learning methods…

机器学习 · 计算机科学 2024-08-15 Anna Vettoruzzo , Joaquin Vanschoren , Mohamed-Rafik Bouguelia , Thorsteinn Rögnvaldsson

Continual learning (CL) is designed to learn new tasks while preserving existing knowledge. Replaying samples from earlier tasks has proven to be an effective method to mitigate the forgetting of previously acquired knowledge. However, the…

计算机视觉与模式识别 · 计算机科学 2024-11-14 Ruiqi Liu , Boyu Diao , Libo Huang , Zijia An , Zhulin An , Yongjun Xu

Continual learning (CL) enables models to adapt to new tasks and environments without forgetting previously learned knowledge. While current CL setups have ignored the relationship between labels in the past task and the new task with or…

机器学习 · 计算机科学 2023-08-29 Byung Hyun Lee , Okchul Jung , Jonghyun Choi , Se Young Chun

The goal of continual learning is to provide intelligent agents that are capable of learning continually a sequence of tasks using the knowledge obtained from previous tasks while performing well on prior tasks. However, a key challenge in…

计算机视觉与模式识别 · 计算机科学 2023-02-03 Ya-nan Han , Jian-wei Liu

Continual Learning (CL) investigates how to train Deep Networks on a stream of tasks without incurring forgetting. CL settings proposed in literature assume that every incoming example is paired with ground-truth annotations. However, this…

Continual learning in online scenario aims to learn a sequence of new tasks from data stream using each data only once for training, which is more realistic than in offline mode assuming data from new task are all available. However, this…

计算机视觉与模式识别 · 计算机科学 2021-10-19 Jiangpeng He , Fengqing Zhu

We introduce a new training paradigm that enforces interval constraints on neural network parameter space to control forgetting. Contemporary Continual Learning (CL) methods focus on training neural networks efficiently from a stream of…

Despite remarkable successes achieved by modern neural networks in a wide range of applications, these networks perform best in domain-specific stationary environments where they are trained only once on large-scale controlled data…

神经与进化计算 · 计算机科学 2019-04-23 Pouya Bashivan , Martin Schrimpf , Robert Ajemian , Irina Rish , Matthew Riemer , Yuhai Tu

Deep neural networks are susceptible to catastrophic forgetting when trained on sequential tasks. Various continual learning (CL) methods often rely on exemplar buffers or/and network expansion for balancing model stability and plasticity,…

机器学习 · 计算机科学 2024-01-18 Depeng Li , Tianqi Wang , Junwei Chen , Qining Ren , Kenji Kawaguchi , Zhigang Zeng

Federated Continual Learning (FCL) has recently emerged as a crucial research area, as data from distributed clients typically arrives as a stream, requiring sequential learning. This paper explores a more practical and challenging FCL…

机器学习 · 计算机科学 2025-06-17 Minh-Duong Nguyen , Le-Tuan Nguyen , Quoc-Viet Pham

Continual learning (CL) is crucial for language models to dynamically adapt to the evolving real-world demands. To mitigate the catastrophic forgetting problem in CL, data replay has been proven a simple and effective strategy, and the…

计算与语言 · 计算机科学 2024-11-12 Jinghan He , Haiyun Guo , Kuan Zhu , Zihan Zhao , Ming Tang , Jinqiao Wang

Continual learning of new knowledge over time is one desirable capability for intelligent systems to recognize more and more classes of objects. Without or with very limited amount of old data stored, an intelligent system often…

计算机视觉与模式识别 · 计算机科学 2021-04-29 Zhuoyun Li , Changhong Zhong , Sijia Liu , Ruixuan Wang , Wei-Shi Zheng

Deep networks allow to obtain outstanding results in semantic segmentation, however they need to be trained in a single shot with a large amount of data. Continual learning settings where new classes are learned in incremental steps and…

计算机视觉与模式识别 · 计算机科学 2021-09-21 Andrea Maracani , Umberto Michieli , Marco Toldo , Pietro Zanuttigh

Deep neural networks suffer from the catastrophic forgetting problem in the field of continual learning (CL). To address this challenge, we propose MGSER-SAM, a novel memory replay-based algorithm specifically engineered to enhance the…

机器学习 · 计算机科学 2024-05-16 Xingyu Li , Bo Tang

In continual learning (CL), catastrophic forgetting often arises due to feature drift. This challenge is particularly prominent in the exemplar-free continual learning (EFCL) setting, where samples from previous tasks cannot be retained,…

机器学习 · 计算机科学 2025-04-01 Xuan Liu , Xiaobin Chang

Online Continual Learning (OCL) for image classification represents a challenging subset of Continual Learning, focusing on classifying images from a stream without assuming data independence and identical distribution (i.i.d). The primary…

机器学习 · 计算机科学 2026-03-24 Joe Khawand , David Colliaux