English
Related papers

Related papers: Online Continual Learning Without the Storage Cons…

200 papers

Continual learning in online scenario aims to learn a sequence of new tasks from data stream using each data only once for training, which is more realistic than in offline mode assuming data from new task are all available. However, this…

Computer Vision and Pattern Recognition · Computer Science 2021-10-19 Jiangpeng He , Fengqing Zhu

We focus on a relatively unexplored learning paradigm known as {\em Online Unsupervised Continual Learning} (O-UCL), where an agent receives a non-stationary, unlabeled data stream and progressively learns to identify an increasing number…

Machine Learning · Computer Science 2024-09-26 Cameron Taylor , Vassilis Vassiliades , Constantine Dovrolis

Continual learning (CL) is a technique that enables neural networks to constantly adapt to their dynamic surroundings. Despite being overlooked for a long time, this technology can considerably address the customized needs of users in edge…

Machine Learning · Computer Science 2025-03-11 Zeqing Wang , Fei Cheng , Kangye Ji , Bohu Huang

Online continual learning (online CL) studies the problem of learning sequential tasks from an online data stream without task boundaries, aiming to adapt to new data while alleviating catastrophic forgetting on the past tasks. This paper…

Machine Learning · Computer Science 2022-07-28 Zhen Wang , Liu Liu , Yajing Kong , Jiaxian Guo , Dacheng Tao

Online continual learning aims to get closer to a live learning experience by learning directly on a stream of data with temporally shifting distribution and by storing a minimum amount of data from that stream. In this empirical…

Continual Learning (CL) aims to sequentially train models on streams of incoming data that vary in distribution by preserving previous knowledge while adapting to new data. Current CL literature focuses on restricted access to previously…

The majority of online continual learning (CL) advocates single-epoch training and imposes restrictions on the size of replay memory. However, single-epoch training would incur a different amount of computations per CL algorithm, and the…

Machine Learning · Computer Science 2025-03-18 Minhyuk Seo , Hyunseo Koh , Jonghyun Choi

Online continual learning (OCL) aims to train neural networks incrementally from a non-stationary data stream with a single pass through data. Rehearsal-based methods attempt to approximate the observed input distributions over time with a…

Machine Learning · Computer Science 2022-11-15 Yaqian Zhang , Bernhard Pfahringer , Eibe Frank , Albert Bifet , Nick Jin Sean Lim , Yunzhe Jia

In Online Continual Learning (OCL) a learning system receives a stream of data and sequentially performs prediction and training steps. Important challenges in OCL are concerned with automatic adaptation to the particular non-stationary…

Machine Learning · Computer Science 2024-11-11 Michalis K. Titsias , Alexandre Galashov , Amal Rannen-Triki , Razvan Pascanu , Yee Whye Teh , Jorg Bornschein

Online continual learning requires the models to learn from constant, endless streams of data. While significant efforts have been made in this field, most were focused on mitigating the catastrophic forgetting issue to achieve better…

Machine Learning · Computer Science 2024-10-14 Xinrui Wang , Chuanxing Geng , Wenhai Wan , Shao-yuan Li , Songcan Chen

Catastrophic forgetting is a significant challenge in online continual learning (OCL), especially for non-stationary data streams that do not have well-defined task boundaries. This challenge is exacerbated by the memory constraints and…

Computer Vision and Pattern Recognition · Computer Science 2024-11-11 Xiwen Wei , Guihong Li , Radu Marculescu

Online Continual Learning (OCL) addresses the problem of training neural networks on a continuous data stream where multiple classification tasks emerge in sequence. In contrast to offline Continual Learning, data can be seen only once in…

Machine Learning · Computer Science 2024-06-06 Nicolas Michel , Maorong Wang , Ling Xiao , Toshihiko Yamasaki

Humans can learn incrementally, whereas neural networks forget previously acquired information catastrophically. Continual Learning (CL) approaches seek to bridge this gap by facilitating the transfer of knowledge to both previous tasks…

Continual learning is the problem of learning and retaining knowledge through time over multiple tasks and environments. Research has primarily focused on the incremental classification setting, where new tasks/classes are added at discrete…

Machine Learning · Computer Science 2021-09-23 Zhipeng Cai , Ozan Sener , Vladlen Koltun

In Continual Learning (CL), a neural network is trained on a stream of data whose distribution changes over time. In this context, the main problem is how to learn new information without forgetting old knowledge (i.e., Catastrophic…

Continual learning aims to learn continuously from a stream of tasks and data in an online-learning fashion, being capable of exploiting what was learned previously to improve current and future tasks while still being able to perform well…

Machine Learning · Computer Science 2020-07-31 Quang Pham , Doyen Sahoo , Chenghao Liu , Steven C. H Hoi

Online continual learning (OCL) seeks to learn new tasks from data streams that appear only once, while retaining knowledge of previously learned tasks. Most existing methods rely on replay, focusing on enhancing memory retention through…

Machine Learning · Computer Science 2024-12-25 Sihao Liu , Yibo Yang , Xiaojie Li , David A. Clifton , Bernard Ghanem

Online Continual Learning (OCL) involves sequentially arriving data and is particularly challenged by catastrophic forgetting, which significantly impairs model performance. To address this issue, we introduce a novel framework, Online…

Machine Learning · Computer Science 2025-12-16 Congren Dai , Huichi Zhou , Jiahao Huang , Zhenxuan Zhang , Fanwen Wang , Yijian Gao , Guang Yang , Fei Ye

Machine learning models for sensor-based human activity recognition (HAR) are expected to adapt post-deployment to recognize new activities and different ways of performing existing ones. To address this need, Online Continual Learning…

Computer Vision and Pattern Recognition · Computer Science 2025-11-11 Yao Zhang , Souza Leite Clayton , Yu Xiao

Vision systems mounted on home robots need to interact with unseen classes in changing environments. Robots have limited computational resources, labelled data and storage capability. These requirements pose some unique challenges: models…

Robotics · Computer Science 2023-07-20 Umberto Michieli , Mete Ozay