English
Related papers

Related papers: Online Analytic Exemplar-Free Continual Learning w…

200 papers

Online Continual Learning (OCL) models continuously adapt to nonstationary data streams, usually without task information. These settings are complex and many traditional CL methods fail, while online methods (mainly replay-based) suffer…

Machine Learning · Computer Science 2025-02-05 Edoardo Urettini , Antonio Carta

Graph contrastive learning (GCL) aims to learn representations from unlabeled graph data in a self-supervised manner and has developed rapidly in recent years. However, edgelevel contrasts are not well explored by most existing GCL methods.…

Machine Learning · Computer Science 2024-12-17 Yujun Li , Hongyuan Zhang , Yuan Yuan

Exemplar-free Class Incremental Learning (EFCIL) aims to learn from a sequence of tasks without having access to previous task data. In this paper, we consider the challenging Cold Start scenario in which insufficient data is available in…

Computer Vision and Pattern Recognition · Computer Science 2025-10-06 Simone Magistri , Tomaso Trinci , Albin Soutif-Cormerais , Joost van de Weijer , Andrew D. Bagdanov

Continual Learning (CL) aims to learn from a non-stationary data stream where the underlying distribution changes over time. While recent advances have produced efficient memory-free methods in the offline CL (offCL) setting, where tasks…

Machine Learning · Computer Science 2025-06-10 Nicolas Michel , Maorong Wang , Jiangpeng He , Toshihiko Yamasaki

This paper investigates a new, practical, but challenging problem named Non-exemplar Online Class-incremental continual Learning (NO-CL), which aims to preserve the discernibility of base classes without buffering data examples and…

Computer Vision and Pattern Recognition · Computer Science 2023-12-18 Fushuo Huo , Wenchao Xu , Jingcai Guo , Haozhao Wang , Yunfeng Fan , Song Guo

In order to achieve Continual Learning (CL), the problem of catastrophic forgetting, one that has plagued neural networks since their inception, must be overcome. The evaluation of continual learning methods relies on splitting a known…

Machine Learning · Computer Science 2025-11-12 Raphaël Bayle , Martial Mermillod , Robert M. French

Online Continual Learning (OCL) involves sequentially arriving data and is particularly challenged by catastrophic forgetting, which significantly impairs model performance. To address this issue, we introduce a novel framework, Online…

Machine Learning · Computer Science 2025-12-16 Congren Dai , Huichi Zhou , Jiahao Huang , Zhenxuan Zhang , Fanwen Wang , Yijian Gao , Guang Yang , Fei Ye

Adapting Automatic Speech Recognition (ASR) models to new domains leads to Catastrophic Forgetting (CF) of previously learned information. This paper addresses CF in the challenging context of Online Continual Learning (OCL), with tasks…

Audio and Speech Processing · Electrical Eng. & Systems 2026-01-22 Steven Vander Eeckt , Hugo Van hamme

Class incremental learning (CIL) trains a network on sequential tasks with separated categories in each task but suffers from catastrophic forgetting, where models quickly lose previously learned knowledge when acquiring new tasks. The…

Machine Learning · Computer Science 2024-11-05 Huiping Zhuang , Yizhu Chen , Di Fang , Run He , Kai Tong , Hongxin Wei , Ziqian Zeng , Cen Chen

Class incremental learning (CIL) requires an agent to learn distinct tasks consecutively with knowledge retention against forgetting. Problems impeding the practical applications of CIL methods are twofold: (1) non-i.i.d batch streams and…

Machine Learning · Computer Science 2025-10-27 Junda Wang , Minghui Hu , Ning Li , Abdulaziz Al-Ali , Ponnuthurai Nagaratnam Suganthan

We revisit the common practice of evaluating adaptation of Online Continual Learning (OCL) algorithms through the metric of online accuracy, which measures the accuracy of the model on the immediate next few samples. However, we show that…

Machine Learning · Computer Science 2023-05-17 Hasan Abed Al Kader Hammoud , Ameya Prabhu , Ser-Nam Lim , Philip H. S. Torr , Adel Bibi , Bernard Ghanem

General-purpose learning systems should improve themselves in open-ended fashion in ever-changing environments. Conventional learning algorithms for neural networks, however, suffer from catastrophic forgetting (CF), i.e., previously…

Machine Learning · Computer Science 2025-02-18 Kazuki Irie , Róbert Csordás , Jürgen Schmidhuber

Continual Learning (CL) aims to develop agents emulating the human ability to sequentially learn new tasks while being able to retain knowledge obtained from past experiences. In this paper, we introduce the novel problem of…

Computer Vision and Pattern Recognition · Computer Science 2022-01-13 Enrico Fini , Stéphane Lathuilière , Enver Sangineto , Moin Nabi , Elisa Ricci

Multi-Label Online Continual Learning (MOCL) requires models to learn continuously from endless multi-label data streams, facing complex challenges including persistent catastrophic forgetting, potential missing labels, and uncontrollable…

Machine Learning · Computer Science 2025-05-27 Xinrui Wang , Shao-yuan Li , Jiaqiang Zhang , Songcan Chen

Non-Exemplar Continual Graph Learning (NECGL) seeks to eliminate the privacy risks intrinsic to rehearsal-based paradigms by retaining solely class-level prototype representations rather than raw graph examples for mitigating catastrophic…

Machine Learning · Computer Science 2026-04-06 Lei Song , Shihan Guan , Youyong Kong

To imitate the ability of keeping learning of human, continual learning which can learn from a never-ending data stream has attracted more interests recently. In all settings, the online class incremental learning (OCIL), where incoming…

Computer Vision and Pattern Recognition · Computer Science 2023-10-20 Guoqiang Liang , Zhaojie Chen , Zhaoqiang Chen , Shiyu Ji , Yanning Zhang

In Continual Learning (CL), a neural network is trained on a stream of data whose distribution changes over time. In this context, the main problem is how to learn new information without forgetting old knowledge (i.e., Catastrophic…

Online continual learning aims to learn from a non-IID stream of data from a number of different tasks, where the learner is only allowed to consider data once. Methods are typically allowed to use a limited buffer to store some of the…

Computer Vision and Pattern Recognition · Computer Science 2021-07-09 Kai Wang , Luis Herranz , Joost van de Weijer

Exemplar-Free Class Incremental Learning (EFCIL) aims to learn from a sequence of tasks without having access to previous task data. In this paper, we consider the challenging Cold Start scenario in which insufficient data is available in…

Computer Vision and Pattern Recognition · Computer Science 2024-05-31 Simone Magistri , Tomaso Trinci , Albin Soutif-Cormerais , Joost van de Weijer , Andrew D. Bagdanov

Online Continual Learning (CL) solves the problem of learning the ever-emerging new classification tasks from a continuous data stream. Unlike its offline counterpart, in online CL, the training data can only be seen once. Most existing…

Machine Learning · Computer Science 2024-04-02 Maorong Wang , Nicolas Michel , Ling Xiao , Toshihiko Yamasaki