English
Related papers

Related papers: Online Prototype Learning for Online Continual Lea…

200 papers

Online Continual Learning (CL) solves the problem of learning the ever-emerging new classification tasks from a continuous data stream. Unlike its offline counterpart, in online CL, the training data can only be seen once. Most existing…

Machine Learning · Computer Science 2024-04-02 Maorong Wang , Nicolas Michel , Ling Xiao , Toshihiko Yamasaki

Continual learning (CL) refers to a machine learning paradigm that learns continuously without forgetting previously acquired knowledge. Thereby, major difficulty in CL is catastrophic forgetting of preceding tasks, caused by shifts in data…

Machine Learning · Computer Science 2023-03-08 Stella Ho , Ming Liu , Lan Du , Longxiang Gao , Yong Xiang

Online continual learning (OCL) refers to the ability of a system to learn over time from a continuous stream of data without having to revisit previously encountered training samples. Learning continually in a single data pass is crucial…

Machine Learning · Computer Science 2020-03-23 German I. Parisi , Vincenzo Lomonaco

Continual Learning (CL) aims to develop agents emulating the human ability to sequentially learn new tasks while being able to retain knowledge obtained from past experiences. In this paper, we introduce the novel problem of…

Computer Vision and Pattern Recognition · Computer Science 2022-01-13 Enrico Fini , Stéphane Lathuilière , Enver Sangineto , Moin Nabi , Elisa Ricci

Attaining prototypical features to represent class distributions is well established in representation learning. However, learning prototypes online from streaming data proves a challenging endeavor as they rapidly become outdated, caused…

Computer Vision and Pattern Recognition · Computer Science 2021-10-20 Matthias De Lange , Tinne Tuytelaars

Online Continual Learning (OCL) studies learning over a continuous data stream without observing any single example more than once, a setting that is closer to the experience of humans and systems that must learn "on-the-wild". Yet,…

Computation and Language · Computer Science 2021-02-02 Germán Kruszewski , Ionut-Teodor Sorodoc , Tomas Mikolov

Online continual learning (online CL) studies the problem of learning sequential tasks from an online data stream without task boundaries, aiming to adapt to new data while alleviating catastrophic forgetting on the past tasks. This paper…

Machine Learning · Computer Science 2022-07-28 Zhen Wang , Liu Liu , Yajing Kong , Jiaxian Guo , Dacheng Tao

The data privacy constraint in online continual learning (OCL), where the data can be seen only once, complicates the catastrophic forgetting problem in streaming data. A common approach applied by the current SOTAs in OCL is with the use…

Machine Learning · Computer Science 2025-07-17 M. Anwar Ma'sum , Mahardhika Pratama , Savitha Ramasamy , Lin Liu , Habibullah Habibullah , Ryszard Kowalczyk

In Continual learning (CL) balancing effective adaptation while combating catastrophic forgetting is a central challenge. Many of the recent best-performing methods utilize various forms of prior task data, e.g. a replay buffer, to tackle…

Machine Learning · Computer Science 2023-06-07 Nader Asadi , MohammadReza Davari , Sudhir Mudur , Rahaf Aljundi , Eugene Belilovsky

Online Continual learning is a challenging learning scenario where the model must learn from a non-stationary stream of data where each sample is seen only once. The main challenge is to incrementally learn while avoiding catastrophic…

Machine Learning · Computer Science 2022-06-24 Mattia Sangermano , Antonio Carta , Andrea Cossu , Davide Bacciu

Rehearsal-based continual learning (CL) mitigates catastrophic forgetting by maintaining a subset of samples from previous tasks for replay. Existing studies primarily focus on optimizing memory storage through coreset selection strategies.…

Machine Learning · Computer Science 2026-04-13 Minh-Duong Nguyen , Thien-Thanh Dao , Le-Tuan Nguyen , Dung D. Le , Kok-Seng Wong

Online continual learning requires the models to learn from constant, endless streams of data. While significant efforts have been made in this field, most were focused on mitigating the catastrophic forgetting issue to achieve better…

Machine Learning · Computer Science 2024-10-14 Xinrui Wang , Chuanxing Geng , Wenhai Wan , Shao-yuan Li , Songcan Chen

Traditional online continual learning (OCL) research has primarily focused on mitigating catastrophic forgetting with fixed and limited storage allocation throughout an agent's lifetime. However, a broad range of real-world applications are…

Computer Vision and Pattern Recognition · Computer Science 2023-11-03 Ameya Prabhu , Zhipeng Cai , Puneet Dokania , Philip Torr , Vladlen Koltun , Ozan Sener

Online continual learning (OCL) aims to enable model learning from a non-stationary data stream to continuously acquire new knowledge as well as retain the learnt one, under the constraints of having limited system size and computational…

Computer Vision and Pattern Recognition · Computer Science 2023-01-16 Sheng-Feng Yu , Wei-Chen Chiu

Continual learning (CL) is a new online learning technique over sequentially generated streaming data from different tasks, aiming to maintain a small forgetting loss on previously-learned tasks. Existing work focuses on reducing the…

Machine Learning · Computer Science 2024-12-25 Shugang Hao , Lingjie Duan

Continual learning (CL) addresses the problem of catastrophic forgetting in neural networks, which occurs when a trained model tends to overwrite previously learned information, when presented with a new task. CL aims to instill the…

Computer Vision and Pattern Recognition · Computer Science 2024-07-12 Shishir Muralidhara , Saqib Bukhari , Georg Schneider , Didier Stricker , René Schuster

Online Continual Learning (OCL) empowers machine learning models to acquire new knowledge online across a sequence of tasks. However, OCL faces a significant challenge: catastrophic forgetting, wherein the model learned in previous tasks is…

Machine Learning · Computer Science 2024-05-16 Fan Lyu , Daofeng Liu , Linglan Zhao , Zhang Zhang , Fanhua Shang , Fuyuan Hu , Wei Feng , Liang Wang

Data streams are rarely static in dynamic environments like Industry 4.0. Instead, they constantly change, making traditional offline models outdated unless they can quickly adjust to the new data. This need can be adequately addressed by…

The main challenge of continual learning is \textit{catastrophic forgetting}. Because of processing data in one pass, online continual learning (OCL) is one of the most difficult continual learning scenarios. To address catastrophic…

Machine Learning · Computer Science 2025-10-02 Aopeng Wang , Ke Deng , Yongli Ren , Jun Luo

We propose a novel approach for class incremental online learning in a limited data setting. This problem setting is challenging because of the following constraints: (1) Classes are given incrementally, which necessitates a class…

Machine Learning · Computer Science 2021-06-15 Mohammed Asad Karim , Vinay Kumar Verma , Pravendra Singh , Vinay Namboodiri , Piyush Rai
‹ Prev 1 2 3 10 Next ›