English
Related papers

Related papers: Streaming Continual Learning for Unified Adaptive …

200 papers

Continual learning aims to learn continuously from a stream of tasks and data in an online-learning fashion, being capable of exploiting what was learned previously to improve current and future tasks while still being able to perform well…

Machine Learning · Computer Science 2020-07-31 Quang Pham , Doyen Sahoo , Chenghao Liu , Steven C. H Hoi

Humans' continual learning (CL) ability is closely related to Stability Versus Plasticity Dilemma that describes how humans achieve ongoing learning capacity and preservation for learned information. The notion of CL has always been present…

Machine Learning · Computer Science 2021-11-24 Yifan Chang , Wenbo Li , Jian Peng , Bo Tang , Yu Kang , Yinjie Lei , Yuanmiao Gui , Qing Zhu , Yu Liu , Haifeng Li

Streaming Continual Learning (CL) typically converts a continuous stream into a sequence of discrete tasks through temporal partitioning. We argue that this temporal taskification step is not a neutral preprocessing choice, but a structural…

Machine Learning · Computer Science 2026-04-24 Nicolae Filat , Ahmed Hussain , Konstantinos Kalogiannis , Elena Burceanu

Lifelong learning or continual learning is the problem of training an AI agent continuously while also preventing it from forgetting its previously acquired knowledge. Streaming lifelong learning is a challenging setting of lifelong…

Machine Learning · Computer Science 2024-02-20 Soumya Banerjee , Vinay K. Verma , Avideep Mukherjee , Deepak Gupta , Vinay P. Namboodiri , Piyush Rai

Deep neural networks, despite their remarkable success, remain fundamentally limited in their ability to perform Continual Learning (CL). While most current methods aim to enhance the capabilities of a single model, Inspired by the…

Machine Learning · Computer Science 2025-08-01 Aojun Lu , Junchao Ke , Chunhui Ding , Jiahao Fan , Jiancheng Lv , Yanan Sun

Continual learning (CL) aims to learn new tasks without forgetting previous tasks. However, existing CL methods require a large amount of raw data, which is often unavailable due to copyright considerations and privacy risks. Instead,…

Machine Learning · Computer Science 2024-09-13 Enneng Yang , Zhenyi Wang , Li Shen , Nan Yin , Tongliang Liu , Guibing Guo , Xingwei Wang , Dacheng Tao

Continual learning (CL) studies the problem of learning a sequence of tasks, one at a time, such that the learning of each new task does not lead to the deterioration in performance on the previously seen ones while exploiting previously…

Machine Learning · Computer Science 2020-11-03 Ammar Shaker , Francesco Alesiani , Shujian Yu , Wenzhe Yin

In an era defined by rapid data evolution, traditional Machine Learning (ML) models often struggle to adapt to dynamic environments. Evolving Machine Learning (EML) has emerged as a pivotal paradigm, enabling continuous learning and…

Continual Learning (CL) investigates how to train Deep Networks on a stream of tasks without incurring forgetting. CL settings proposed in literature assume that every incoming example is paired with ground-truth annotations. However, this…

Machine Learning · Statistics 2022-08-30 Matteo Boschini , Pietro Buzzega , Lorenzo Bonicelli , Angelo Porrello , Simone Calderara

Continual learning (CL) is a branch of machine learning that aims to enable agents to adapt and generalise previously learned abilities so that these can be reapplied to new tasks or environments. This is particularly useful in multi-task…

Machine Learning · Computer Science 2025-11-20 Kim N. Nolle , Ivana Dusparic , Rhodri Cusack , Vinny Cahill

Continual learning (CL) enables models to adapt to evolving data streams. A major challenge of CL is catastrophic forgetting, where new knowledge will overwrite previously acquired knowledge. Traditional methods usually retain the past data…

Computer Vision and Pattern Recognition · Computer Science 2025-07-04 Baocai Yin , Ji Zhao , Huajie Jiang , Ningning Hou , Yongli Hu , Amin Beheshti , Ming-Hsuan Yang , Yuankai Qi

Attaining prototypical features to represent class distributions is well established in representation learning. However, learning prototypes online from streaming data proves a challenging endeavor as they rapidly become outdated, caused…

Computer Vision and Pattern Recognition · Computer Science 2021-10-20 Matthias De Lange , Tinne Tuytelaars

Continual learning (CL) refers to the ability of an algorithm to continuously and incrementally acquire new knowledge from its environment while retaining previously learned information. A model trained on one data modality often fails when…

Machine Learning · Computer Science 2025-08-22 Nilay Kushawaha , Egidio Falotico

Continual Learning (CL) is a field dedicated to devise algorithms able to achieve lifelong learning. Overcoming the knowledge disruption of previously acquired concepts, a drawback affecting deep learning models and that goes by the name of…

Computer Vision and Pattern Recognition · Computer Science 2023-01-04 Francesco Pelosin

Continual learning is an emerging subject in machine learning that aims to solve multiple tasks presented sequentially to the learner without forgetting previously learned tasks. Recently, many deep learning based approaches have been…

Machine Learning · Computer Science 2025-04-28 Liangzu Peng , René Vidal

In Continual Learning (CL), a neural network is trained on a stream of data whose distribution changes over time. In this context, the main problem is how to learn new information without forgetting old knowledge (i.e., Catastrophic…

Non-Centralized Continual Learning (NCCL) has become an emerging paradigm for enabling distributed devices such as vehicles and servers to handle streaming data from a joint non-stationary environment. To achieve high reliability and…

Machine Learning · Computer Science 2025-05-07 Yichen Li , Haozhao Wang , Wenchao Xu , Tianzhe Xiao , Hong Liu , Minzhu Tu , Yuying Wang , Xin Yang , Rui Zhang , Shui Yu , Song Guo , Ruixuan Li

Continual Learning (CL) aims to incrementally acquire new knowledge while mitigating catastrophic forgetting. Within this setting, Online Continual Learning (OCL) focuses on updating models promptly and incrementally from single or small…

Machine Learning · Computer Science 2025-12-19 Giovanni Donghi , Luca Pasa , Daniele Zambon , Cesare Alippi , Nicolò Navarin

Generative conversational interfaces powered by large language models (LLMs) typically stream output token-by-token at a rate determined by computational budget, often neglecting actual human reading speeds and the cognitive load associated…

Human-Computer Interaction · Computer Science 2025-07-25 Chang Xiao , Brenda Yang

When an agent acquires new information, ideally it would immediately be capable of using that information to understand its environment. This is not possible using conventional deep neural networks, which suffer from catastrophic forgetting…

Machine Learning · Computer Science 2020-04-20 Tyler L. Hayes , Christopher Kanan