English
Related papers

Related papers: Complementary Learning for Overcoming Catastrophic…

200 papers

We study continual offline reinforcement learning, a practical paradigm that facilitates forward transfer and mitigates catastrophic forgetting to tackle sequential offline tasks. We propose a dual generative replay framework that retains…

Machine Learning · Computer Science 2024-04-19 Jinmei Liu , Wenbin Li , Xiangyu Yue , Shilin Zhang , Chunlin Chen , Zhi Wang

People learn throughout life. However, incrementally updating conventional neural networks leads to catastrophic forgetting. A common remedy is replay, which is inspired by how the brain consolidates memory. Replay involves fine-tuning a…

Machine Learning · Computer Science 2020-07-14 Tyler L. Hayes , Kushal Kafle , Robik Shrestha , Manoj Acharya , Christopher Kanan

Deep neural networks have shown superior performance in many regimes to remember familiar patterns with large amounts of data. However, the standard supervised deep learning paradigm is still limited when facing the need to learn new…

Machine Learning · Computer Science 2018-11-16 Jing Shi , Jiaming Xu , Yiqun Yao , Bo Xu

Federated Class Continual Learning (FCCL) merges the challenges of distributed client learning with the need for seamless adaptation to new classes without forgetting old ones. The key challenge in FCCL is catastrophic forgetting, an issue…

Machine Learning · Computer Science 2024-09-05 Jinglin Liang , Jin Zhong , Hanlin Gu , Zhongqi Lu , Xingxing Tang , Gang Dai , Shuangping Huang , Lixin Fan , Qiang Yang

Learning new information without forgetting prior knowledge is central to human intelligence. In contrast, neural network models suffer from catastrophic forgetting: a significant degradation in performance on previously learned tasks when…

Machine Learning · Computer Science 2025-07-16 James P Jun , Vijay Marupudi , Raj Sanjay Shah , Sashank Varma

Catastrophic forgetting in deep neural networks occurs when learning new tasks degrades performance on previously learned tasks due to knowledge overwriting. Among the approaches to mitigate this issue, regularization techniques aim to…

Machine Learning · Computer Science 2025-07-14 Idan Mashiach , Oren Glickman , Tom Tirer

Sample-efficient online reinforcement learning often uses replay buffers to store experience for reuse when updating the value function. However, uniform replay is inefficient, since certain classes of transitions can be more relevant to…

Machine Learning · Computer Science 2025-05-12 Renhao Wang , Kevin Frans , Pieter Abbeel , Sergey Levine , Alexei A. Efros

Deep learning has emerged as a powerful method for extracting valuable information from large volumes of data. However, when new training data arrives continuously (i.e., is not fully available from the beginning), incremental training…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-06-06 Thomas Bouvier , Bogdan Nicolae , Hugo Chaugier , Alexandru Costan , Ian Foster , Gabriel Antoniu

In this paper, we show that Generative Adversarial Networks (GANs) suffer from catastrophic forgetting even when they are trained to approximate a single target distribution. We show that GAN training is a continual learning problem in…

Machine Learning · Computer Science 2020-03-24 Hoang Thanh-Tung , Truyen Tran

The problem of a deep learning model losing performance on a previously learned task when fine-tuned to a new one is a phenomenon known as Catastrophic forgetting. There are two major ways to mitigate this problem: either preserving…

Computer Vision and Pattern Recognition · Computer Science 2019-07-24 Shivangi Srivastava , Maxim Berman , Matthew B. Blaschko , Devis Tuia

We address catastrophic forgetting issues in graph learning as incoming data transits from one to another graph distribution. Whereas prior studies primarily tackle one setting of graph continual learning such as incremental node…

Machine Learning · Computer Science 2023-08-29 Thanh Duc Hoang , Do Viet Tung , Duy-Hung Nguyen , Bao-Sinh Nguyen , Huy Hoang Nguyen , Hung Le

Catastrophic forgetting is a problem faced by many machine learning models and algorithms. When trained on one task, then trained on a second task, many machine learning models "forget" how to perform the first task. This is widely believed…

Machine Learning · Statistics 2015-03-05 Ian J. Goodfellow , Mehdi Mirza , Da Xiao , Aaron Courville , Yoshua Bengio

We explore the behavior of a standard convolutional neural net in a continual-learning setting that introduces visual classification tasks sequentially and requires the net to master new tasks while preserving mastery of previously learned…

Machine Learning · Computer Science 2020-04-01 Guy Davidson , Michael C. Mozer

In real-world applications, data do not reflect the ones commonly used for neural networks training, since they are usually few, unlabeled and can be available as a stream. Hence many existing deep learning solutions suffer from a limited…

Machine Learning · Computer Science 2020-11-18 Alessia Bertugli , Stefano Vincenzi , Simone Calderara , Andrea Passerini

While neural networks are powerful function approximators, they suffer from catastrophic forgetting when the data distribution is not stationary. One particular formalism that studies learning under non-stationary distribution is provided…

Machine Learning · Statistics 2019-06-13 Xu He , Jakub Sygnowski , Alexandre Galashov , Andrei A. Rusu , Yee Whye Teh , Razvan Pascanu

Catastrophic forgetting - the tendency of neural networks to forget previously learned data when learning new information - remains a central challenge in continual learning. In this work, we adopt a behavioral approach, observing a…

Machine Learning · Computer Science 2025-07-08 Guy Hacohen , Tinne Tuytelaars

Humans learn to recognize and manipulate new objects in lifelong settings without forgetting the previously gained knowledge under non-stationary and sequential conditions. In autonomous systems, the agents also need to mitigate similar…

Robotics · Computer Science 2022-01-25 Krishnakumar Santhakumar , Hamidreza Kasaei

In this paper, we propose a new method to overcome catastrophic forgetting by adding generative regularization to Bayesian inference framework. Bayesian method provides a general framework for continual learning. We could further construct…

Machine Learning · Computer Science 2021-06-22 Patrick H. Chen , Wei Wei , Cho-jui Hsieh , Bo Dai

This paper proposes a deep representation learning using an information-theoretic loss with an aim to increase the inter-class distances as well as within-class similarity in the embedded space. Tasks such as anomaly and out-of-distribution…

Machine Learning · Computer Science 2022-02-08 Shin Ando

Deep Neural Network (DNN) has achieved great success on datasets of closed class set. However, new classes, like new categories of social media topics, are continuously added to the real world, making it necessary to incrementally learn.…

Computer Vision and Pattern Recognition · Computer Science 2023-08-07 Wenzhuo Liu , Xinjian Wu , Fei Zhu , Mingming Yu , Chuang Wang , Cheng-Lin Liu