English
Related papers

Related papers: Shared and Private VAEs with Generative Replay for…

200 papers

Continual reinforcement learning challenges agents to acquire new skills while retaining previously learned ones with the goal of improving performance in both past and future tasks. Most existing approaches rely on model-free methods with…

Machine Learning · Computer Science 2026-05-19 Abdulaziz Alyahya , Abdallah Al Siyabi , Markus R. Ernst , Luke Yang , Levin Kuhlmann , Gideon Kowadlo

Catastrophic forgetting of previously learned knowledge while learning new tasks is a widely observed limitation of contemporary neural networks. Although many continual learning methods are proposed to mitigate this drawback, the main…

Computer Vision and Pattern Recognition · Computer Science 2021-09-07 Wojciech Masarczyk , Kamil Deja , Tomasz Trzciński

An intelligent system capable of continual learning is one that can process and extract knowledge from potentially infinitely long streams of pattern vectors. The major challenge that makes crafting such a system difficult is known as…

Machine Learning · Computer Science 2024-02-21 Hitesh Vaidya , Travis Desell , Ankur Mali , Alexander Ororbia

Continual learning seeks to enable machine learning systems to solve an increasing corpus of tasks sequentially. A critical challenge for continual learning is forgetting, where the performance on previously learned tasks decreases as new…

Machine Learning · Computer Science 2025-06-06 Yasaman Mahdaviyeh , James Lucas , Mengye Ren , Andreas S. Tolias , Richard Zemel , Toniann Pitassi

With the emergence of Transformers and Vision-Language Models (VLMs) such as CLIP, fine-tuning large pre-trained models has recently become a prevalent strategy in Continual Learning. This has led to the development of numerous prompting…

Computer Vision and Pattern Recognition · Computer Science 2024-10-29 Emanuele Frascaroli , Aniello Panariello , Pietro Buzzega , Lorenzo Bonicelli , Angelo Porrello , Simone Calderara

People learn throughout life. However, incrementally updating conventional neural networks leads to catastrophic forgetting. A common remedy is replay, which is inspired by how the brain consolidates memory. Replay involves fine-tuning a…

Machine Learning · Computer Science 2020-07-14 Tyler L. Hayes , Kushal Kafle , Robik Shrestha , Manoj Acharya , Christopher Kanan

Continual learning is the process of training machine learning models on a sequence of tasks where data distributions change over time. A well-known obstacle in this setting is catastrophic forgetting, a phenomenon in which a model…

Machine Learning · Computer Science 2025-02-18 Andrii Krutsylo

Continual learning, the setting where a learning agent is faced with a never ending stream of data, continues to be a great challenge for modern machine learning systems. In particular the online or "single-pass through the data" setting…

Machine Learning · Computer Science 2019-10-31 Rahaf Aljundi , Lucas Caccia , Eugene Belilovsky , Massimo Caccia , Min Lin , Laurent Charlin , Tinne Tuytelaars

Deep Neural Networks (DNNs) suffer from a rapid decrease in performance when trained on a sequence of tasks where only data of the most recent task is available. This phenomenon, known as catastrophic forgetting, prevents DNNs from…

Machine Learning · Computer Science 2021-04-22 Felix Wiewel , Bin Yang

Continual learning (CL) aims to learn a sequence of tasks without forgetting prior knowledge, but gradient updates for a new task often overwrite the weights learned earlier, causing catastrophic forgetting (CF). We propose…

Machine Learning · Computer Science 2025-05-19 Neil De La Fuente , Maria Pilligua , Daniel Vidal , Albin Soutiff , Cecilia Curreli , Daniel Cremers , Andrey Barsky

We propose incremental (re)training of a neural network model to cope with a continuous flow of new data in inference during model serving. As such, this is a life-long learning process. We address two challenges of life-long retraining:…

Machine Learning · Computer Science 2020-04-30 Diego Klabjan , Xiaofeng Zhu

The ability of deep neural networks to continually learn and adapt to a sequence of tasks has remained challenging due to catastrophic forgetting of previously learned tasks. Humans, on the other hand, have a remarkable ability to acquire,…

Computer Vision and Pattern Recognition · Computer Science 2023-05-09 Kishaan Jeeveswaran , Prashant Bhat , Bahram Zonooz , Elahe Arani

Learning new tasks continuously without forgetting on a constantly changing data distribution is essential for real-world problems but extremely challenging for modern deep learning. In this work we propose HCL, a Hybrid…

Replaying past experiences has proven to be a highly effective approach for averting catastrophic forgetting in supervised continual learning. However, some crucial factors are still largely ignored, making it vulnerable to serious failure,…

Machine Learning · Computer Science 2023-11-21 Tiantian Zhang , Kevin Zehua Shen , Zichuan Lin , Bo Yuan , Xueqian Wang , Xiu Li , Deheng Ye

Data streams are rarely static in dynamic environments like Industry 4.0. Instead, they constantly change, making traditional offline models outdated unless they can quickly adjust to the new data. This need can be adequately addressed by…

Continual learning strives to ensure stability in solving previously seen tasks while demonstrating plasticity in a novel domain. Recent advances in continual learning are mostly confined to a supervised learning setting, especially in NLP…

Machine Learning · Computer Science 2024-06-03 Stella Ho , Ming Liu , Shang Gao , Longxiang Gao

Continual or incremental learning holds tremendous potential in deep learning with different challenges including catastrophic forgetting. The advent of powerful foundation and generative models has propelled this paradigm even further,…

Computer Vision and Pattern Recognition · Computer Science 2025-05-29 Victor Enescu , Hichem Sahbi

Learning a set of tasks over time, also known as continual learning (CL), is one of the most challenging problems in artificial intelligence. While recent approaches achieve some degree of CL in deep neural networks, they either (1) grow…

Machine Learning · Computer Science 2019-07-15 Blake Camp , Jaya Krishna Mandivarapu , Rolando Estrada

We focus on the problem of learning without forgetting from multiple tasks arriving sequentially, where each task is defined using a few-shot episode of novel or already seen classes. We approach this problem using the recently published…

Machine Learning · Computer Science 2024-08-20 Max Vladymyrov , Andrey Zhmoginov , Mark Sandler

Deep learning models are prone to forgetting information learned in the past when trained on new data. This problem becomes even more pronounced in the context of federated learning (FL), where data is decentralized and subject to…

Machine Learning · Computer Science 2023-07-19 Sara Babakniya , Zalan Fabian , Chaoyang He , Mahdi Soltanolkotabi , Salman Avestimehr