English
Related papers

Related papers: Experience Replay for Continual Learning

200 papers

A primary focus area in continual learning research is alleviating the "catastrophic forgetting" problem in neural networks by designing new algorithms that are more robust to the distribution shifts. While the recent progress in continual…

Machine Learning · Computer Science 2022-07-15 Seyed Iman Mirzadeh , Arslan Chaudhry , Dong Yin , Huiyi Hu , Razvan Pascanu , Dilan Gorur , Mehrdad Farajtabar

Conventional deep learning models have limited capacity in learning multiple tasks sequentially. The issue of forgetting the previously learned tasks in continual learning is known as catastrophic forgetting or interference. When the input…

Machine Learning · Computer Science 2020-07-14 Honglin Li , Payam Barnaghi , Shirin Enshaeifar , Frieder Ganz

Many real-world applications require machine-learning models to be able to deal with non-stationary data distributions and thus learn autonomously over an extended period of time, often in an online setting. One of the main challenges in…

Machine Learning · Computer Science 2025-07-22 Giuseppe Serra , Ben Werner , Florian Buettner

Future deep learning models will be distinguished by systems that perpetually learn through interaction, imagination, and cooperation, blurring the line between training and inference. This makes continual learning a critical challenge, as…

Machine Learning · Computer Science 2025-05-20 Truman Hickok

Temporal knowledge graph (TKG) completion models typically rely on having access to the entire graph during training. However, in real-world scenarios, TKG data is often received incrementally as events unfold, leading to a dynamic…

Machine Learning · Computer Science 2023-05-31 Mehrnoosh Mirtaheri , Mohammad Rostami , Aram Galstyan

Continual learning aims to learn a sequence of tasks from dynamic data distributions. Without accessing to the old training samples, knowledge transfer from the old tasks to each new task is difficult to determine, which might be either…

Machine Learning · Computer Science 2021-11-08 Liyuan Wang , Mingtian Zhang , Zhongfan Jia , Qian Li , Chenglong Bao , Kaisheng Ma , Jun Zhu , Yi Zhong

Catastrophic forgetting, the tendency of neural networks to forget previously learned knowledge when learning new tasks, has been a major challenge in continual learning (CL). To tackle this challenge, CL methods have been proposed and…

Machine Learning · Computer Science 2026-03-04 Zhanwang Liu , Yuting Li , Haoyuan Gao , Yexin Li , Linghe Kong , Lichao Sun , Weiran Huang

Catastrophic forgetting has been a significant problem hindering the deployment of deep learning algorithms in the continual learning setting. Numerous methods have been proposed to address the catastrophic forgetting problem where an agent…

Machine Learning · Computer Science 2022-09-07 Marcus de Carvalho , Mahardhika Pratama , Jie Zhang , Yajuan San

Continual learning (CL) aims to develop techniques by which a single model adapts to an increasing number of tasks encountered sequentially, thereby potentially leveraging learnings across tasks in a resource-efficient manner. A major…

Machine Learning · Computer Science 2022-04-18 Rishabh Tiwari , Krishnateja Killamsetty , Rishabh Iyer , Pradeep Shenoy

General-purpose learning systems should improve themselves in open-ended fashion in ever-changing environments. Conventional learning algorithms for neural networks, however, suffer from catastrophic forgetting (CF), i.e., previously…

Machine Learning · Computer Science 2025-02-18 Kazuki Irie , Róbert Csordás , Jürgen Schmidhuber

Simultaneous localization and mapping (SLAM) with implicit neural representations has received extensive attention due to the expressive representation power and the innovative paradigm of continual learning. However, deploying such a…

Computer Vision and Pattern Recognition · Computer Science 2024-07-19 Baicheng Li , Zike Yan , Dong Wu , Hanqing Jiang , Hongbin Zha

Continual learning, focused on sequentially learning multiple tasks, has gained significant attention recently. Despite the tremendous progress made in the past, the theoretical understanding, especially factors contributing to catastrophic…

Machine Learning · Computer Science 2024-05-29 Meng Ding , Kaiyi Ji , Di Wang , Jinhui Xu

Neural networks have achieved remarkable success in many cognitive tasks. However, when they are trained sequentially on multiple tasks without access to old data, their performance on early tasks tend to drop significantly. This problem is…

Machine Learning · Computer Science 2021-02-10 Dong Yin , Mehrdad Farajtabar , Ang Li , Nir Levine , Alex Mott

As a means to balance the growth of the AI industry with the need for privacy protection, machine unlearning plays a crucial role in realizing the ``right to be forgotten'' in artificial intelligence. This technique enables AI systems to…

Machine Learning · Computer Science 2026-04-22 Eun-Ju Park , Youjin Shin , Simon S. Woo

Task-incremental continual learning refers to continually training a model in a sequence of tasks while overcoming the problem of catastrophic forgetting (CF). The issue arrives for the reason that the learned representations are forgotten…

Machine Learning · Computer Science 2023-05-23 Yun Luo , Xiaotian Lin , Zhen Yang , Fandong Meng , Jie Zhou , Yue Zhang

Deep neural networks are used in many state-of-the-art systems for machine perception. Once a network is trained to do a specific task, e.g., bird classification, it cannot easily be trained to do new tasks, e.g., incrementally learning to…

Artificial Intelligence · Computer Science 2017-11-10 Ronald Kemker , Marc McClure , Angelina Abitino , Tyler Hayes , Christopher Kanan

Federated Class Continual Learning (FCCL) merges the challenges of distributed client learning with the need for seamless adaptation to new classes without forgetting old ones. The key challenge in FCCL is catastrophic forgetting, an issue…

Machine Learning · Computer Science 2024-09-05 Jinglin Liang , Jin Zhong , Hanlin Gu , Zhongqi Lu , Xingxing Tang , Gang Dai , Shuangping Huang , Lixin Fan , Qiang Yang

Continual learning is crucial for applying machine learning in challenging, dynamic, and often resource-constrained environments. However, catastrophic forgetting - overwriting previously learned knowledge when new information is acquired -…

Machine Learning · Computer Science 2025-05-30 Filip Szatkowski , Yaoyue Zheng , Fei Yang , Bartłomiej Twardowski , Tomasz Trzciński , Joost van de Weijer

A human brain is capable of continual learning by nature; however the current mainstream deep neural networks suffer from a phenomenon named catastrophic forgetting (i.e., learning a new set of patterns suddenly and completely would result…

Machine Learning · Computer Science 2019-03-11 Zhenfeng Cao

Sequential learning in physical networks is hindered by catastrophic forgetting, where training a new task erases solutions to earlier ones. We show that we can significantly enhance memory of previous tasks by introducing a hard threshold…

Disordered Systems and Neural Networks · Physics 2025-12-04 Purba Chatterjee , Marcelo Guzman , Andrea J. Liu
‹ Prev 1 8 9 10 Next ›