English
Related papers

Related papers: Overcoming Domain Drift in Online Continual Learni…

200 papers

In continual learning (CL), catastrophic forgetting often arises due to feature drift. This challenge is particularly prominent in the exemplar-free continual learning (EFCL) setting, where samples from previous tasks cannot be retained,…

Machine Learning · Computer Science 2025-04-01 Xuan Liu , Xiaobin Chang

Although numerous machine learning models exist to detect issues like rolling bearing strain and deformation, typically caused by improper mounting, overloading, or poor lubrication, these models often struggle to isolate faults from the…

Machine Learning · Computer Science 2025-04-15 Diogo Risca , Afonso Lourenço , Goreti Marreiros

Continual reinforcement learning (CRL) refers to a naturalistic setting where an agent needs to endlessly evolve, by trial and error, to solve multiple tasks that are presented sequentially. One of the largest obstacles to CRL is that the…

Machine Learning · Computer Science 2025-07-15 Zichen Liu , Guoji Fu , Chao Du , Wee Sun Lee , Min Lin

Continual learning is a process that involves training learning agents to sequentially master a stream of tasks or classes without revisiting past data. The challenge lies in leveraging previously acquired knowledge to learn new tasks…

Machine Learning · Computer Science 2024-02-21 Marcus de Carvalho , Mahardhika Pratama , Jie Zhang , Chua Haoyan , Edward Yapp

Online Continual learning is a challenging learning scenario where the model must learn from a non-stationary stream of data where each sample is seen only once. The main challenge is to incrementally learn while avoiding catastrophic…

Machine Learning · Computer Science 2022-06-24 Mattia Sangermano , Antonio Carta , Andrea Cossu , Davide Bacciu

Online Continual Learning (OCL) is a critical area in machine learning, focusing on enabling models to adapt to evolving data streams in real-time while addressing challenges such as catastrophic forgetting and the stability-plasticity…

The ability of neural networks to continuously learn and adapt to new tasks while retaining prior knowledge is crucial for many applications. However, current neural networks tend to forget previously learned tasks when trained on new ones,…

Computer Vision and Pattern Recognition · Computer Science 2020-05-04 Sinan Özgür Özgün , Anne-Marie Rickmann , Abhijit Guha Roy , Christian Wachinger

Artificial neural networks, celebrated for their human-like cognitive learning abilities, often encounter the well-known catastrophic forgetting (CF) problem, where the neural networks lose the proficiency in previously acquired knowledge.…

Machine Learning · Computer Science 2024-05-14 Weiwei Weng , Mahardhika Pratama , Jie Zhang , Chen Chen , Edward Yapp Kien Yee , Ramasamy Savitha

Online Continual Learning (OCL) involves sequentially arriving data and is particularly challenged by catastrophic forgetting, which significantly impairs model performance. To address this issue, we introduce a novel framework, Online…

Machine Learning · Computer Science 2025-12-16 Congren Dai , Huichi Zhou , Jiahao Huang , Zhenxuan Zhang , Fanwen Wang , Yijian Gao , Guang Yang , Fei Ye

Domain incremental learning (DIL) poses a significant challenge in real-world scenarios, as models need to be sequentially trained on diverse domains over time, all the while avoiding catastrophic forgetting. Mitigating representation…

Machine Learning · Computer Science 2024-06-25 Kishaan Jeeveswaran , Elahe Arani , Bahram Zonooz

Continuous offline reinforcement learning (CORL) combines continuous and offline reinforcement learning, enabling agents to learn multiple tasks from static datasets without forgetting prior tasks. However, CORL faces challenges in…

Machine Learning · Computer Science 2024-04-09 Kaixin Huang , Li Shen , Chen Zhao , Chun Yuan , Dacheng Tao

In this work, we propose a new setting of continual learning: data-incremental continual offline reinforcement learning (DICORL), in which an agent is asked to learn a sequence of datasets of a single offline reinforcement learning (RL)…

Machine Learning · Computer Science 2024-12-17 Sibo Gai , Donglin Wang

Continual Learning (CL) aims to incrementally acquire new knowledge while mitigating catastrophic forgetting. Within this setting, Online Continual Learning (OCL) focuses on updating models promptly and incrementally from single or small…

Machine Learning · Computer Science 2025-12-19 Giovanni Donghi , Luca Pasa , Daniele Zambon , Cesare Alippi , Nicolò Navarin

To accommodate real-world dynamics, artificial intelligence systems need to cope with sequentially arriving content in an online manner. Beyond regular Continual Learning (CL) attempting to address catastrophic forgetting with offline…

Machine Learning · Computer Science 2024-04-02 HongWei Yan , Liyuan Wang , Kaisheng Ma , Yi Zhong

Catastrophic forgetting is one of the main obstacles for Online Continual Graph Learning (OCGL), where nodes arrive one by one, distribution drifts may occur at any time and offline training on task-specific subgraphs is not feasible. In…

Machine Learning · Computer Science 2025-10-09 Giovanni Donghi , Daniele Zambon , Luca Pasa , Cesare Alippi , Nicolò Navarin

Continual Learning (CL) considers the problem of training an agent sequentially on a set of tasks while seeking to retain performance on all previous tasks. A key challenge in CL is catastrophic forgetting, which arises when performance on…

Machine Learning · Computer Science 2022-03-16 Samuel Kessler , Jack Parker-Holder , Philip Ball , Stefan Zohren , Stephen J. Roberts

Neural networks tend to gradually forget the previously learned knowledge when learning multiple tasks sequentially from dynamic data distributions. This problem is called \textit{catastrophic forgetting}, which is a fundamental challenge…

Computation and Language · Computer Science 2022-03-21 Chenze Shao , Yang Feng

Online continual learning (online CL) studies the problem of learning sequential tasks from an online data stream without task boundaries, aiming to adapt to new data while alleviating catastrophic forgetting on the past tasks. This paper…

Machine Learning · Computer Science 2022-07-28 Zhen Wang , Liu Liu , Yajing Kong , Jiaxian Guo , Dacheng Tao

Catastrophic forgetting remains a critical challenge in continual learning for large language models (LLMs), where models struggle to retain performance on historical tasks when fine-tuning on new sequential data without access to past…

Machine Learning · Computer Science 2025-09-30 Zhixin Zhang , Zeming Wei , Meng Sun

Traditional online continual learning (OCL) research has primarily focused on mitigating catastrophic forgetting with fixed and limited storage allocation throughout an agent's lifetime. However, a broad range of real-world applications are…

Computer Vision and Pattern Recognition · Computer Science 2023-11-03 Ameya Prabhu , Zhipeng Cai , Puneet Dokania , Philip Torr , Vladlen Koltun , Ozan Sener