English
Related papers

Related papers: Predicting the Susceptibility of Examples to Catas…

200 papers

Continual learning-the ability to learn many tasks in sequence-is critical for artificial learning systems. Yet standard training methods for deep networks often suffer from catastrophic forgetting, where learning new tasks erases knowledge…

Machine Learning · Statistics 2021-07-12 Sebastian Lee , Sebastian Goldt , Andrew Saxe

In continual learning, a model learns incrementally over time while minimizing interference between old and new tasks. One of the most widely used approaches in continual learning is referred to as replay. Replay methods support interleaved…

Computer Vision and Pattern Recognition · Computer Science 2024-05-13 Truman Hickok , Dhireesha Kudithipudi

Artificial neural networks (ANNs) suffer from catastrophic forgetting when trained on a sequence of tasks. While this phenomenon was studied in the past, there is only very limited recent research on this phenomenon. We propose a method for…

Machine Learning · Computer Science 2019-06-07 Felix Wiewel , Bin Yang

Time-dependent data-generating distributions have proven to be difficult for gradient-based training of neural networks, as the greedy updates result in catastrophic forgetting of previously learned knowledge. Despite the progress in the…

Machine Learning · Computer Science 2023-04-03 Matthias De Lange , Gido van de Ven , Tinne Tuytelaars

It has been observed that neural networks perform poorly when the data or tasks are presented sequentially. Unlike humans, neural networks suffer greatly from catastrophic forgetting, making it impossible to perform life-long learning. To…

Machine Learning · Computer Science 2023-01-31 Longhui Yu , Tianyang Hu , Lanqing Hong , Zhen Liu , Adrian Weller , Weiyang Liu

Catastrophic forgetting is a major problem in continual learning, and lots of approaches arise to reduce it. However, most of them are evaluated through task accuracy, which ignores the internal model structure. Recent research suggests…

Machine Learning · Computer Science 2026-03-06 Yunqin Zhu , Jun Jin

Deep Reinforcement Learning agents often suffer from catastrophic forgetting, forgetting previously found solutions in parts of the input space when training on new data. Replay Memories are a common solution to the problem, decorrelating…

Machine Learning · Computer Science 2023-08-29 Muhammad Burhan Hafez , Tilman Immisch , Tom Weber , Stefan Wermter

Catastrophic forgetting/interference is a critical problem for lifelong learning machines, which impedes the agents from maintaining their previously learned knowledge while learning new tasks. Neural networks, in particular, suffer plenty…

Neural and Evolutionary Computing · Computer Science 2019-03-15 Soheil Kolouri , Nicholas Ketz , Xinyun Zou , Jeffrey Krichmar , Praveen Pilly

Generally intelligent agents exhibit successful behavior across problems in several settings. Endemic in approaches to realize such intelligence in machines is catastrophic forgetting: sequential learning corrupts knowledge obtained earlier…

Artificial Intelligence · Computer Science 2018-04-13 Shawn L. E. Beaulieu , Sam Kriegman , Josh C. Bongard

End-to-end training of Spoken Language Models (SLMs) commonly involves adapting pre-trained text-based Large Language Models (LLMs) to the speech modality through multi-stage training on diverse tasks such as ASR, TTS and spoken question…

Computation and Language · Computer Science 2025-05-26 Chi-Yuan Hsiao , Ke-Han Lu , Kai-Wei Chang , Chih-Kai Yang , Wei-Chih Chen , Hung-yi Lee

Artificial neural networks often struggle with catastrophic forgetting when learning multiple tasks sequentially, as training on new tasks degrades the performance on previously learned tasks. Recent theoretical work has addressed this…

Machine Learning · Computer Science 2025-09-10 Francesco Mori , Stefano Sarao Mannelli , Francesca Mignacco

Current training regimes for deep learning usually involve exposure to a single task / dataset at a time. Here we start from the observation that in this context the trained model is not given any knowledge of anything outside its…

Artificial Intelligence · Computer Science 2020-02-11 Giacomo Spigler

In continual learning, there is a serious problem of catastrophic forgetting, in which previous knowledge is forgotten when a model learns new tasks. Various methods have been proposed to solve this problem. Replay methods which replay data…

Computer Vision and Pattern Recognition · Computer Science 2024-09-18 Kotaro Nagata , Hiromu Ono , Kazuhiro Hotta

In Continual Learning, a Neural Network is trained on a stream of data whose distribution shifts over time. Under these assumptions, it is especially challenging to improve on classes appearing later in the stream while remaining accurate…

Machine Learning · Computer Science 2020-10-13 Pietro Buzzega , Matteo Boschini , Angelo Porrello , Simone Calderara

Continual learning aims to provide intelligent agents capable of learning multiple tasks sequentially with neural networks. One of its main challenging, catastrophic forgetting, is caused by the neural networks non-optimal ability to learn…

Machine Learning · Computer Science 2021-01-29 Ghada Sokar , Decebal Constantin Mocanu , Mykola Pechenizkiy

Not so long ago, a method was discovered that successfully overcomes the catastrophic forgetting in neural networks. Although we know about the cases of using this method to preserve skills when adapting pre-trained networks to particular…

Machine Learning · Computer Science 2021-06-07 Alexey Kutalev

Continual learning, focused on sequentially learning multiple tasks, has gained significant attention recently. Despite the tremendous progress made in the past, the theoretical understanding, especially factors contributing to catastrophic…

Machine Learning · Computer Science 2024-05-29 Meng Ding , Kaiyi Ji , Di Wang , Jinhui Xu

In this paper, we propose a new method to overcome catastrophic forgetting by adding generative regularization to Bayesian inference framework. Bayesian method provides a general framework for continual learning. We could further construct…

Machine Learning · Computer Science 2021-06-22 Patrick H. Chen , Wei Wei , Cho-jui Hsieh , Bo Dai

Sequential Bayesian inference can be used for continual learning to prevent catastrophic forgetting of past tasks and provide an informative prior when learning new tasks. We revisit sequential Bayesian inference and test whether having…

Machine Learning · Computer Science 2025-01-09 Samuel Kessler , Adam Cobb , Tim G. J. Rudner , Stefan Zohren , Stephen J. Roberts

Humans can naturally learn new and varying tasks in a sequential manner. Continual learning is a class of learning algorithms that updates its learned model as it sees new data (on potentially new tasks) in a sequence. A key challenge in…

Machine Learning · Computer Science 2025-03-04 Masih Eskandar , Tooba Imtiaz , Davin Hill , Zifeng Wang , Jennifer Dy