English
Related papers

Related papers: Evaluating Online Continual Learning with CALM

200 papers

Current evaluations of Continual Learning (CL) methods typically assume that there is no constraint on training time and computation. This is an unrealistic assumption for any real-world setting, which motivates us to propose: a practical…

Online continual learning requires the models to learn from constant, endless streams of data. While significant efforts have been made in this field, most were focused on mitigating the catastrophic forgetting issue to achieve better…

Machine Learning · Computer Science 2024-10-14 Xinrui Wang , Chuanxing Geng , Wenhai Wan , Shao-yuan Li , Songcan Chen

Learning from non-stationary data streams, also called Task-Free Continual Learning (TFCL) remains challenging due to the absence of explicit task information. Although recently some methods have been proposed for TFCL, they lack…

Computer Vision and Pattern Recognition · Computer Science 2022-10-14 Fei Ye , Adrian G. Bors

Online Continual Learning (OCL) for image classification represents a challenging subset of Continual Learning, focusing on classifying images from a stream without assuming data independence and identical distribution (i.i.d). The primary…

Machine Learning · Computer Science 2026-03-24 Joe Khawand , David Colliaux

Online Continual Learning (OCL) aims to learn from endless non\text{-}stationary data streams, yet most existing methods assume a flat label space and overlook the hierarchical organization of real\text{-}world concepts that evolves both…

Machine Learning · Computer Science 2026-05-13 Xinrui Wang , Shao-Yuan Li , Bartłomiej Twardowski , Alexandra Gomez-Villa , Songcan Chen

Continual learning (CL) is a learning paradigm that emulates the human capability of learning and accumulating knowledge continually without forgetting the previously learned knowledge and also transferring the learned knowledge to help…

Computation and Language · Computer Science 2023-05-12 Zixuan Ke , Bing Liu

Continual reinforcement learning (CRL) refers to a naturalistic setting where an agent needs to endlessly evolve, by trial and error, to solve multiple tasks that are presented sequentially. One of the largest obstacles to CRL is that the…

Machine Learning · Computer Science 2025-07-15 Zichen Liu , Guoji Fu , Chao Du , Wee Sun Lee , Min Lin

Continual learning aims to learn continuously from a stream of tasks and data in an online-learning fashion, being capable of exploiting what was learned previously to improve current and future tasks while still being able to perform well…

Machine Learning · Computer Science 2020-07-31 Quang Pham , Doyen Sahoo , Chenghao Liu , Steven C. H Hoi

We revisit the common practice of evaluating adaptation of Online Continual Learning (OCL) algorithms through the metric of online accuracy, which measures the accuracy of the model on the immediate next few samples. However, we show that…

Machine Learning · Computer Science 2023-05-17 Hasan Abed Al Kader Hammoud , Ameya Prabhu , Ser-Nam Lim , Philip H. S. Torr , Adel Bibi , Bernard Ghanem

Training large language representation models has become a standard in the natural language processing community. This allows for fine tuning on any number of specific tasks, however, these large high capacity models can continue to train…

Computation and Language · Computer Science 2020-04-09 Kristjan Arumae , Parminder Bhatia

Online Continual Learning (OCL) addresses the problem of training neural networks on a continuous data stream where multiple classification tasks emerge in sequence. In contrast to offline Continual Learning, data can be seen only once in…

Machine Learning · Computer Science 2024-06-06 Nicolas Michel , Maorong Wang , Ling Xiao , Toshihiko Yamasaki

Continual learning is the problem of learning and retaining knowledge through time over multiple tasks and environments. Research has primarily focused on the incremental classification setting, where new tasks/classes are added at discrete…

Machine Learning · Computer Science 2021-09-23 Zhipeng Cai , Ozan Sener , Vladlen Koltun

Continual learning aims to learn a sequence of tasks by leveraging the knowledge acquired in the past in an online-learning manner while being able to perform well on all previous tasks, this ability is crucial to the artificial…

Computer Vision and Pattern Recognition · Computer Science 2022-09-12 Ya-nan Han , Jian-wei Liu

Online Continual Learning (OCL) models continuously adapt to nonstationary data streams, usually without task information. These settings are complex and many traditional CL methods fail, while online methods (mainly replay-based) suffer…

Machine Learning · Computer Science 2025-02-05 Edoardo Urettini , Antonio Carta

Large Language Models (LMs) are known to encode world knowledge in their parameters as they pretrain on a vast amount of web corpus, which is often utilized for performing knowledge-dependent downstream tasks such as question answering,…

Computation and Language · Computer Science 2022-05-25 Joel Jang , Seonghyeon Ye , Sohee Yang , Joongbo Shin , Janghoon Han , Gyeonghun Kim , Stanley Jungkyu Choi , Minjoon Seo

Humans and animals learn throughout their lives from limited amounts of sensed data, both with and without supervision. Autonomous, intelligent robots of the future are often expected to do the same. The existing continual learning (CL)…

Machine Learning · Computer Science 2024-04-02 Elvin Hajizada , Balachandran Swaminathan , Yulia Sandamirskaya

Continual learning studies agents that learn from streams of tasks without forgetting previous ones while adapting to new ones. Two recent continual-learning scenarios have opened new avenues of research. In meta-continual learning, the…

Continual Learning (CL) investigates how to train Deep Networks on a stream of tasks without incurring forgetting. CL settings proposed in literature assume that every incoming example is paired with ground-truth annotations. However, this…

Machine Learning · Statistics 2022-08-30 Matteo Boschini , Pietro Buzzega , Lorenzo Bonicelli , Angelo Porrello , Simone Calderara

To accommodate real-world dynamics, artificial intelligence systems need to cope with sequentially arriving content in an online manner. Beyond regular Continual Learning (CL) attempting to address catastrophic forgetting with offline…

Machine Learning · Computer Science 2024-04-02 HongWei Yan , Liyuan Wang , Kaisheng Ma , Yi Zhong

Continual learning (CL) aims to enable learning systems to acquire new knowledge constantly without forgetting previously learned information. CL faces the challenge of mitigating catastrophic forgetting while maintaining interpretability…

Computer Vision and Pattern Recognition · Computer Science 2025-04-01 Lu Yu , Haoyu Han , Zhe Tao , Hantao Yao , Changsheng Xu