English
Related papers

Related papers: Mitigating Catastrophic Forgetting in Streaming Ge…

200 papers

Addressing catastrophic forgetting is one of the key challenges in continual learning where machine learning systems are trained with sequential or streaming tasks. Despite recent remarkable progress in state-of-the-art deep learning, deep…

Machine Learning · Computer Science 2019-05-22 Xilai Li , Yingbo Zhou , Tianfu Wu , Richard Socher , Caiming Xiong

The problem of catastrophic forgetting occurs in deep learning models trained on multiple databases in a sequential manner. Recently, generative replay mechanisms (GRM), have been proposed to reproduce previously learned knowledge aiming to…

Computer Vision and Pattern Recognition · Computer Science 2020-07-21 Fei Ye , Adrian G. Bors

Artificial neural networks (ANNs) show limited performance with scarce or imbalanced training data and face challenges with continuous learning, such as forgetting previously learned data after new tasks training. In contrast, the human…

Machine Learning · Computer Science 2024-10-22 Anthony Bazhenov , Pahan Dewasurendra , Giri P. Krishnan , Jean Erik Delanois

In clinical practice, a segmentation network is often required to continually learn on a sequential data stream from multiple sites rather than a consolidated set, due to the storage cost and privacy restriction. However, during the…

Image and Video Processing · Electrical Eng. & Systems 2022-06-28 Jingyang Zhang , Peng Xue , Ran Gu , Yuning Gu , Mianxin Liu , Yongsheng Pan , Zhiming Cui , Jiawei Huang , Lei Ma , Dinggang Shen

The continual learning capability of large language models (LLMs) is crucial for advancing artificial general intelligence. However, continual fine-tuning LLMs across various domains often suffers from catastrophic forgetting, characterized…

Computation and Language · Computer Science 2025-08-07 Yunan Zhang , Shuoran Jiang , Mengchen Zhao , Yuefeng Li , Yang Fan , Xiangping Wu , Qingcai Chen

Inference-time guidance is essential for steering generative robot policies toward dynamic objectives without retraining, yet existing methods are largely confined to chunk-based architectures that exhibit high latency and lack the…

Robotics · Computer Science 2026-05-12 Puming Jiang , Meiyi Wang , Kelvin Lin , Ce Hao , Harold Soh

We introduce GUIDE, a novel continual learning approach that directs diffusion models to rehearse samples at risk of being forgotten. Existing generative strategies combat catastrophic forgetting by randomly sampling rehearsal examples from…

Machine Learning · Computer Science 2024-06-03 Bartosz Cywiński , Kamil Deja , Tomasz Trzciński , Bartłomiej Twardowski , Łukasz Kuciński

Deep networks allow to obtain outstanding results in semantic segmentation, however they need to be trained in a single shot with a large amount of data. Continual learning settings where new classes are learned in incremental steps and…

Computer Vision and Pattern Recognition · Computer Science 2021-09-21 Andrea Maracani , Umberto Michieli , Marco Toldo , Pietro Zanuttigh

The ability of intelligent agents to learn and remember multiple tasks sequentially is crucial to achieving artificial general intelligence. Many continual learning (CL) methods have been proposed to overcome catastrophic forgetting which…

Machine Learning · Computer Science 2020-09-15 Gehui Shen , Song Zhang , Xiang Chen , Zhi-Hong Deng

Experience replay is a core ingredient of modern deep reinforcement learning, yet its benefits in policy optimization are poorly understood beyond empirical heuristics. This paper develops a novel theoretical framework for experience replay…

Machine Learning · Computer Science 2026-02-04 Hua Zheng , Wei Xie , M. Ben Feng

In continual learning, where task data arrives in a sequence, fine-tuning on later tasks will often lead to performance degradation on earlier tasks. This is especially pronounced when these tasks come from diverse domains. In this setting,…

Machine Learning · Computer Science 2025-01-13 Anat Kleiman , Gintare Karolina Dziugaite , Jonathan Frankle , Sham Kakade , Mansheej Paul

Continual learning, focused on sequentially learning multiple tasks, has gained significant attention recently. Despite the tremendous progress made in the past, the theoretical understanding, especially factors contributing to catastrophic…

Machine Learning · Computer Science 2024-05-29 Meng Ding , Kaiyi Ji , Di Wang , Jinhui Xu

Hybrid architectures combining state-space models with attention have achieved strong efficiency-quality tradeoffs, yet existing approaches either apply attention uniformly or learn static sparse patterns. This misses a key opportunity:…

Machine Learning · Computer Science 2026-02-13 Ibne Farabi Shihab , Sanjeda Akter , Anuj Sharma

The movement of large quantities of data during the training of a Deep Neural Network presents immense challenges for machine learning workloads. To minimize this overhead, especially on the movement and calculation of gradient information,…

Machine Learning · Computer Science 2020-04-28 Siyuan Huang , Brian D. Hoskins , Matthew W. Daniels , Mark D. Stiles , Gina C. Adam

Large language models exhibit remarkable performance across diverse tasks through pre-training and fine-tuning paradigms. However, continual fine-tuning on sequential tasks induces catastrophic forgetting, where newly acquired knowledge…

Machine Learning · Computer Science 2026-01-27 Olaf Yunus Laitinen Imanov

Neural networks suffer from catastrophic forgetting in class-incremental learning (CIL) settings. Rehearsal$\unicode{x2013}$replaying a subset of past samples$\unicode{x2013}$is a well-established mitigation strategy. However, recent…

Machine Learning · Computer Science 2026-05-15 Alberto Tamajo , Srinandan Dasmahapatra , Rahman Attar

A wide variety of methods have been developed to enable lifelong learning in conventional deep neural networks. However, to succeed, these methods require a `batch' of samples to be available and visited multiple times during training.…

Machine Learning · Computer Science 2021-10-22 Soumya Banerjee , Vinay Kumar Verma , Toufiq Parag , Maneesh Singh , Vinay P. Namboodiri

Conventional replay-based approaches to continual learning (CL) require, for each learning phase with new data, the replay of samples representing all of the previously learned knowledge in order to avoid catastrophic forgetting. Since the…

Machine Learning · Computer Science 2023-03-24 Alexander Krawczyk , Alexander Gepperth

Recent studies on catastrophic forgetting during sequential learning typically focus on fixing the accuracy of the predictions for a previously learned task. In this paper we argue that the outputs of neural networks are subject to rapid…

Machine Learning · Computer Science 2020-02-14 Yuwen Xiong , Mengye Ren , Raquel Urtasun

In the study of human learning, there is broad evidence that our ability to retain information improves with repeated exposure and decays with delay since last exposure. This plays a crucial role in the design of educational software,…

Artificial Intelligence · Computer Science 2016-06-09 Siddharth Reddy , Igor Labutov , Siddhartha Banerjee , Thorsten Joachims