English
Related papers

Related papers: Continual Learning with Deep Generative Replay

200 papers

Deep neural networks are used in many state-of-the-art systems for machine perception. Once a network is trained to do a specific task, e.g., bird classification, it cannot easily be trained to do new tasks, e.g., incrementally learning to…

Artificial Intelligence · Computer Science 2017-11-10 Ronald Kemker , Marc McClure , Angelina Abitino , Tyler Hayes , Christopher Kanan

Addressing catastrophic forgetting is one of the key challenges in continual learning where machine learning systems are trained with sequential or streaming tasks. Despite recent remarkable progress in state-of-the-art deep learning, deep…

Machine Learning · Computer Science 2019-05-22 Xilai Li , Yingbo Zhou , Tianfu Wu , Richard Socher , Caiming Xiong

The continual learning capability of large language models (LLMs) is crucial for advancing artificial general intelligence. However, continual fine-tuning LLMs across various domains often suffers from catastrophic forgetting, characterized…

Computation and Language · Computer Science 2025-08-07 Yunan Zhang , Shuoran Jiang , Mengchen Zhao , Yuefeng Li , Yang Fan , Xiangping Wu , Qingcai Chen

Temporal knowledge graph (TKG) completion models typically rely on having access to the entire graph during training. However, in real-world scenarios, TKG data is often received incrementally as events unfold, leading to a dynamic…

Machine Learning · Computer Science 2023-05-31 Mehrnoosh Mirtaheri , Mohammad Rostami , Aram Galstyan

We consider the problem of building a state representation model in a continual fashion. As the environment changes, the aim is to efficiently compress the sensory state's information without losing past knowledge. The learned features are…

Machine Learning · Computer Science 2018-12-12 Hugo Caselles-Dupré , Michael Garcia-Ortiz , David Filliat

The ability of machine learning systems to learn continually is hindered by catastrophic forgetting, the tendency of neural networks to overwrite previously acquired knowledge when learning a new task. Existing methods mitigate this problem…

Artificial neural networks thrive in solving the classification problem for a particular rigid task, acquiring knowledge through generalized learning behaviour from a distinct training phase. The resulting network resembles a static entity…

Computer Vision and Pattern Recognition · Computer Science 2021-04-19 Matthias De Lange , Rahaf Aljundi , Marc Masana , Sarah Parisot , Xu Jia , Ales Leonardis , Gregory Slabaugh , Tinne Tuytelaars

Continual learning-the ability to learn many tasks in sequence-is critical for artificial learning systems. Yet standard training methods for deep networks often suffer from catastrophic forgetting, where learning new tasks erases knowledge…

Machine Learning · Statistics 2021-07-12 Sebastian Lee , Sebastian Goldt , Andrew Saxe

Learning a sequence of tasks without access to i.i.d. observations is a widely studied form of continual learning (CL) that remains challenging. In principle, Bayesian learning directly applies to this setting, since recursive and one-off…

Continual learning refers to the problem where the training data is available in sequential chunks, termed "tasks". The majority of progress in continual learning has been stunted by the problem of catastrophic forgetting, which is caused…

Computer Vision and Pattern Recognition · Computer Science 2023-11-07 Rajas Chitale , Ankit Vaidya , Aditya Kane , Archana Ghotkar

Although substantial efforts have been made to mitigate catastrophic forgetting in continual learning, the intrinsic mechanisms are not well understood. In this work, we demonstrate the existence of "pseudo forgetting": the performance…

Machine Learning · Computer Science 2025-06-10 Huashan Sun , Yizhe Yang , Yinghao Li , Jiawei Li , Yang Gao

Deep Neural networks forget previously learnt tasks when they are faced with learning new tasks. This is called catastrophic forgetting. Rehearsing the neural network with the training data of the previous task can protect the network from…

Machine Learning · Computer Science 2020-04-29 Bhasker Sri Harsha Suri , Kalidas Yeturu

Generally intelligent agents exhibit successful behavior across problems in several settings. Endemic in approaches to realize such intelligence in machines is catastrophic forgetting: sequential learning corrupts knowledge obtained earlier…

Artificial Intelligence · Computer Science 2018-04-13 Shawn L. E. Beaulieu , Sam Kriegman , Josh C. Bongard

In class-incremental learning, the objective is to learn a number of classes sequentially without having access to the whole training data. However, due to a problem known as catastrophic forgetting, neural networks suffer substantial…

Machine Learning · Computer Science 2021-06-01 Sobirdzhon Bobiev , Adil Khan , Syed Muhammad Ahsan Raza Kazmi

Continual learning refers to the capability of a machine learning model to learn and adapt to new information, without compromising its performance on previously learned tasks. Although several studies have investigated continual learning…

Information Retrieval · Computer Science 2024-06-21 Jingrui Hou , Georgina Cosma , Axel Finke

In the present work we propose a Deep Feed Forward network architecture which can be trained according to a sequential learning paradigm, where tasks of increasing difficulty are learned sequentially, yet avoiding catastrophic forgetting.…

Neural and Evolutionary Computing · Computer Science 2017-11-29 Guglielmo Montone , J. Kevin O'Regan , Alexander V. Terekhov

Recent Continual Learning (CL)-based Temporal Knowledge Graph Reasoning (TKGR) methods focus on significantly reducing computational cost and mitigating catastrophic forgetting caused by fine-tuning models with new data. However, existing…

Information Retrieval · Computer Science 2025-06-05 Zhiyu Zhang , Wei Chen , Youfang Lin , Huaiyu Wan

Loss of plasticity is one of the main challenges in continual learning with deep neural networks, where neural networks trained via backpropagation gradually lose their ability to adapt to new tasks and perform significantly worse than…

Machine Learning · Computer Science 2025-03-27 Jiuqi Wang , Rohan Chandra , Shangtong Zhang

A lifelong learning agent is able to continually learn from potentially infinite streams of pattern sensory data. One major historic difficulty in building agents that adapt in this way is that neural systems struggle to retain…

Machine Learning · Computer Science 2021-12-10 Hitesh Vaidya , Travis Desell , Alexander Ororbia

Continual Learning (CL) for malware classification tackles the rapidly evolving nature of malware threats and the frequent emergence of new types. Generative Replay (GR)-based CL systems utilize a generative model to produce synthetic…

Cryptography and Security · Computer Science 2025-01-03 Jimin Park , AHyun Ji , Minji Park , Mohammad Saidur Rahman , Se Eun Oh