English
Related papers

Related papers: Replay-free Online Continual Learning with Self-Su…

200 papers

Traditional online continual learning (OCL) research has primarily focused on mitigating catastrophic forgetting with fixed and limited storage allocation throughout an agent's lifetime. However, a broad range of real-world applications are…

Computer Vision and Pattern Recognition · Computer Science 2023-11-03 Ameya Prabhu , Zhipeng Cai , Puneet Dokania , Philip Torr , Vladlen Koltun , Ozan Sener

Continual learning (CL) refers to a machine learning paradigm that learns continuously without forgetting previously acquired knowledge. Thereby, major difficulty in CL is catastrophic forgetting of preceding tasks, caused by shifts in data…

Machine Learning · Computer Science 2023-03-08 Stella Ho , Ming Liu , Lan Du , Longxiang Gao , Yong Xiang

This paper studies class incremental learning (CIL) of continual learning (CL). Many approaches have been proposed to deal with catastrophic forgetting (CF) in CIL. Most methods incrementally construct a single classifier for all classes of…

Machine Learning · Computer Science 2022-08-23 Gyuhak Kim , Zixuan Ke , Bing Liu

Continual learning (CL) aims to constantly learn new knowledge over time while avoiding catastrophic forgetting on old tasks. In this work, we focus on continual text classification under the class-incremental setting. Recent CL studies…

Computation and Language · Computer Science 2023-05-15 Yifan Song , Peiyi Wang , Dawei Zhu , Tianyu Liu , Zhifang Sui , Sujian Li

The data privacy constraint in online continual learning (OCL), where the data can be seen only once, complicates the catastrophic forgetting problem in streaming data. A common approach applied by the current SOTAs in OCL is with the use…

Machine Learning · Computer Science 2025-07-17 M. Anwar Ma'sum , Mahardhika Pratama , Savitha Ramasamy , Lin Liu , Habibullah Habibullah , Ryszard Kowalczyk

Continual learning (CL) aims to learn new tasks without forgetting previous tasks. However, existing CL methods require a large amount of raw data, which is often unavailable due to copyright considerations and privacy risks. Instead,…

Machine Learning · Computer Science 2024-09-13 Enneng Yang , Zhenyi Wang , Li Shen , Nan Yin , Tongliang Liu , Guibing Guo , Xingwei Wang , Dacheng Tao

Continual Learning (CL) investigates how to train Deep Networks on a stream of tasks without incurring forgetting. CL settings proposed in literature assume that every incoming example is paired with ground-truth annotations. However, this…

Machine Learning · Statistics 2022-08-30 Matteo Boschini , Pietro Buzzega , Lorenzo Bonicelli , Angelo Porrello , Simone Calderara

Continual learning (CL) aims to learn a sequence of tasks without forgetting the previously acquired knowledge. However, recent CL advances are restricted to supervised continual learning (SCL) scenarios. Consequently, they are not scalable…

Machine Learning · Computer Science 2022-04-06 Divyam Madaan , Jaehong Yoon , Yuanchun Li , Yunxin Liu , Sung Ju Hwang

Continual learning (CL) enables deep networks to acquire new knowledge while avoiding catastrophic forgetting. The powerful generalization ability of pre-trained models (PTMs), such as the Contrastive Language-Image Pre-training (CLIP)…

Computer Vision and Pattern Recognition · Computer Science 2025-12-22 Haodong Lu , Xinyu Zhang , Kristen Moore , Jason Xue , Lina Yao , Anton van den Hengel , Dong Gong

Continual Learning (CL) aims to learn new data while remembering previously acquired knowledge. In contrast to CL for image classification, CL for Object Detection faces additional challenges such as the missing annotations problem. In this…

Computer Vision and Pattern Recognition · Computer Science 2025-03-05 Riccardo De Monte , Davide Dalle Pezze , Marina Ceccon , Francesco Pasti , Francesco Paissan , Elisabetta Farella , Gian Antonio Susto , Nicola Bellotto

A wide variety of methods have been developed to enable lifelong learning in conventional deep neural networks. However, to succeed, these methods require a `batch' of samples to be available and visited multiple times during training.…

Machine Learning · Computer Science 2021-10-22 Soumya Banerjee , Vinay Kumar Verma , Toufiq Parag , Maneesh Singh , Vinay P. Namboodiri

Online Continual Learning (OCL) is a critical area in machine learning, focusing on enabling models to adapt to evolving data streams in real-time while addressing challenges such as catastrophic forgetting and the stability-plasticity…

Online class-incremental continual learning is a specific task of continual learning. It aims to continuously learn new classes from data stream and the samples of data stream are seen only once, which suffers from the catastrophic…

Computer Vision and Pattern Recognition · Computer Science 2023-04-11 Huiwei Lin , Baoquan Zhang , Shanshan Feng , Xutao Li , Yunming Ye

Continual learning (CL) provides a framework for training models in ever-evolving environments. Although re-occurrence of previously seen objects or tasks is common in real-world problems, the concept of repetition in the data stream is not…

Deep learning algorithms are known to experience destructive interference when instances violate the assumption of being independent and identically distributed (i.i.d). This violation, however, is ubiquitous in clinical settings where data…

Machine Learning · Computer Science 2020-12-01 Dani Kiyasseh , Tingting Zhu , David A. Clifton

Online continual learning (CL) studies the problem of learning continuously from a single-pass data stream while adapting to new data and mitigating catastrophic forgetting. Recently, by storing a small subset of old data, replay-based…

Computer Vision and Pattern Recognition · Computer Science 2023-08-02 Yujie Wei , Jiaxin Ye , Zhizhong Huang , Junping Zhang , Hongming Shan

In recent years, there has been remarkable progress in the field of digital pathology, driven by the ability to model complex tissue patterns using advanced deep-learning algorithms. However, the robustness of these models is often severely…

Image and Video Processing · Electrical Eng. & Systems 2024-09-11 Pratibha Kumari , Daniel Reisenbüchler , Lucas Luttner , Nadine S. Schaadt , Friedrich Feuerhake , Dorit Merhof

Humans learn all their life long. They accumulate knowledge from a sequence of learning experiences and remember the essential concepts without forgetting what they have learned previously. Artificial neural networks struggle to learn…

Machine Learning · Computer Science 2020-12-09 Timothée Lesort

Online continual learning (OCL) aims to enable model learning from a non-stationary data stream to continuously acquire new knowledge as well as retain the learnt one, under the constraints of having limited system size and computational…

Computer Vision and Pattern Recognition · Computer Science 2023-01-16 Sheng-Feng Yu , Wei-Chen Chiu

Nowadays, real-world applications often face streaming data, which requires the learning system to absorb new knowledge as data evolves. Continual Learning (CL) aims to achieve this goal and meanwhile overcome the catastrophic forgetting of…

Machine Learning · Computer Science 2024-04-24 Da-Wei Zhou , Hai-Long Sun , Jingyi Ning , Han-Jia Ye , De-Chuan Zhan