English
Related papers

Related papers: TRGP: Trust Region Gradient Projection for Continu…

200 papers

Learning from changing tasks and sequential experience without forgetting the obtained knowledge is a challenging problem for artificial neural networks. In this work, we focus on two challenging problems in the paradigm of Continual…

Computer Vision and Pattern Recognition · Computer Science 2022-11-29 Tao Feng , Hangjie Yuan , Mang Wang , Ziyuan Huang , Ang Bian , Jianzhou Zhang

A major obstacle to developing artificial intelligence applications capable of true lifelong learning is that artificial neural networks quickly or catastrophically forget previously learned tasks when trained on a new one. Numerous methods…

Machine Learning · Computer Science 2019-04-18 Gido M. van de Ven , Andreas S. Tolias

Catastrophic forgetting in neural networks is a significant problem for continual learning. A majority of the current methods replay previous data during training, which violates the constraints of an ideal continual learning system.…

Machine Learning · Computer Science 2021-02-24 Prakhar Kaushik , Alex Gain , Adam Kortylewski , Alan Yuille

The ability of artificial agents to increment their capabilities when confronted with new data is an open challenge in artificial intelligence. The main challenge faced in such cases is catastrophic forgetting, i.e., the tendency of neural…

Machine Learning · Computer Science 2020-12-16 Eden Belouadah , Adrian Popescu , Ioannis Kanellos

A common challenge in continual learning (CL) is catastrophic forgetting, where the performance on old tasks drops after new, additional tasks are learned. In this paper, we propose a novel framework called ReCL to slow down forgetting in…

Machine Learning · Computer Science 2025-03-04 Pascal Janetzky , Tobias Schlagenhauf , Stefan Feuerriegel

Despite huge success, deep networks are unable to learn effectively in sequential multitask learning settings as they forget the past learned tasks after learning new tasks. Inspired from complementary learning systems theory, we address…

Machine Learning · Computer Science 2019-06-04 Mohammad Rostami , Soheil Kolouri , Praveen K. Pilly

Trust region methods are a popular tool in reinforcement learning as they yield robust policy updates in continuous and discrete action spaces. However, enforcing such trust regions in deep reinforcement learning is difficult. Hence, many…

Machine Learning · Computer Science 2021-03-10 Fabian Otto , Philipp Becker , Ngo Anh Vien , Hanna Carolin Ziesche , Gerhard Neumann

Task-incremental continual learning refers to continually training a model in a sequence of tasks while overcoming the problem of catastrophic forgetting (CF). The issue arrives for the reason that the learned representations are forgotten…

Machine Learning · Computer Science 2023-05-23 Yun Luo , Xiaotian Lin , Zhen Yang , Fandong Meng , Jie Zhou , Yue Zhang

Continual learning is a promising machine learning paradigm to learn new tasks while retaining previously learned knowledge over streaming training data. Till now, rehearsal-based methods, keeping a small part of data from old tasks as a…

Machine Learning · Computer Science 2023-08-04 Quanziang Wang , Renzhen Wang , Yuexiang Li , Dong Wei , Kai Ma , Yefeng Zheng , Deyu Meng

Modern pre-trained architectures struggle to retain previous information while undergoing continuous fine-tuning on new tasks. Despite notable progress in continual classification, systems designed for complex vision tasks such as detection…

Computer Vision and Pattern Recognition · Computer Science 2024-07-16 Gaurav Bhatt , James Ross , Leonid Sigal

Humans learn adaptively and efficiently throughout their lives. However, incrementally learning tasks causes artificial neural networks to overwrite relevant information learned about older tasks, resulting in 'Catastrophic Forgetting'.…

Machine Learning · Computer Science 2021-02-04 Gobinda Saha , Isha Garg , Aayush Ankit , Kaushik Roy

One notable weakness of current machine learning algorithms is the poor ability of models to solve new problems without forgetting previously acquired knowledge. The Continual Learning paradigm has emerged as a protocol to systematically…

Machine Learning · Computer Science 2022-11-16 Heinke Hihn , Daniel A. Braun

To mitigate forgetting, existing lifelong event detection methods typically maintain a memory module and replay the stored memory data during the learning of a new task. However, the simple combination of memory data and new-task samples…

Computation and Language · Computer Science 2024-04-04 Chengwei Qin , Ruirui Chen , Ruochen Zhao , Wenhan Xia , Shafiq Joty

Contrastive representation learning has emerged as a promising technique for continual learning as it can learn representations that are robust to catastrophic forgetting and generalize well to unseen future tasks. Previous work in…

Computer Vision and Pattern Recognition · Computer Science 2023-11-06 Rouzbeh Meshkinnejad , Jie Mei , Daniel Lizotte , Yalda Mohsenzadeh

Catastrophic forgetting poses a substantial challenge for managing intelligent agents controlled by a large model, causing performance degradation when these agents face new tasks. In our work, we propose a novel solution - the Progressive…

Machine Learning · Computer Science 2025-09-04 Zhiyuan Wang , Xiaoyang Qu , Jing Xiao , Bokui Chen , Jianzong Wang

Multimodal continual instruction tuning enables multimodal large language models to sequentially adapt to new tasks while building upon previously acquired knowledge. However, this continual learning paradigm faces the significant challenge…

Computer Vision and Pattern Recognition · Computer Science 2026-03-23 Songze Li , Mingyu Gao , Tonghua Su , Xu-Yao Zhang , Zhongjie Wang

To enable learning on edge devices with fast convergence and low memory, we present a novel backpropagation-free optimization algorithm dubbed Target Projection Stochastic Gradient Descent (tpSGD). tpSGD generalizes direct random target…

Machine Learning · Computer Science 2022-09-19 Michael Lomnitz , Zachary Daniels , David Zhang , Michael Piacentino

Continual learning algorithms which keep the parameters of new tasks close to that of previous tasks, are popular in preventing catastrophic forgetting in sequential task learning settings. However, 1) the performance for the new continual…

Machine Learning · Computer Science 2023-07-21 Wei Cong , Yang Cong , Gan Sun , Yuyang Liu , Jiahua Dong

In the context of continual learning, acquiring new knowledge while maintaining previous knowledge presents a significant challenge. Existing methods often use experience replay techniques that store a small portion of previous task data…

Machine Learning · Computer Science 2025-12-24 Minsu Kim , Seong-Hyeon Hwang , Steven Euijong Whang

Catastrophic forgetting is a major problem in continual learning, and lots of approaches arise to reduce it. However, most of them are evaluated through task accuracy, which ignores the internal model structure. Recent research suggests…

Machine Learning · Computer Science 2026-03-06 Yunqin Zhu , Jun Jin