English
Related papers

Related papers: Does Continual Learning Equally Forget All Paramet…

200 papers

Catastrophic forgetting affects the training of neural networks, limiting their ability to learn multiple tasks sequentially. From the perspective of the well established plasticity-stability dilemma, neural networks tend to be overly…

Machine Learning · Computer Science 2020-06-15 Seyed Iman Mirzadeh , Mehrdad Farajtabar , Razvan Pascanu , Hassan Ghasemzadeh

Incrementally fine-tuning foundational models on new tasks or domains is now the de facto approach in NLP. A known pitfall of this approach is the \emph{catastrophic forgetting} of prior knowledge that happens during fine-tuning. A common…

Machine Learning · Computer Science 2025-02-12 Andrew Bai , Chih-Kuan Yeh , Cho-Jui Hsieh , Ankur Taly

Most Continual Learning (CL) methods maintain performance on earlier tasks by storing exemplars in a replay buffer, introducing memory overhead that scales with the number of tasks and raising privacy concerns in regulated domains. We…

Machine Learning · Computer Science 2026-05-11 Mohammad Ali Vahedifar , Qi Zhang

Existing Continual Learning (CL) approaches have focused on addressing catastrophic forgetting by leveraging regularization methods, replay buffers, and task-specific components. However, realistic CL solutions must be shaped not only by…

Machine Learning · Computer Science 2023-10-11 Jinyung Hong , Theodore P. Pavlic

Modern language models are powerful, but typically static after deployment. A major obstacle to building models that continually learn over time is catastrophic forgetting, where updating on new data erases previously acquired capabilities.…

Computation and Language · Computer Science 2025-10-20 Jessy Lin , Luke Zettlemoyer , Gargi Ghosh , Wen-Tau Yih , Aram Markosyan , Vincent-Pierre Berges , Barlas Oğuz

Large language models (LLMs) often suffer from catastrophic forgetting in continual learning: after learning new tasks sequentially, they perform worse on earlier tasks. Existing methods mitigate catastrophic forgetting by data replay,…

Machine Learning · Computer Science 2026-05-08 Yazheng Liu , Yuxuan Wan , Rui Xu , Xi Zhang , Sihong Xie , Hui Xiong

Existing research on task incremental learning in continual learning has primarily focused on preventing catastrophic forgetting (CF). Although several techniques have achieved learning with no CF, they attain it by letting each task…

Machine Learning · Computer Science 2023-06-27 Tatsuya Konishi , Mori Kurokawa , Chihiro Ono , Zixuan Ke , Gyuhak Kim , Bing Liu

Recent years have witnessed a burgeoning interest in federated learning (FL). However, the contexts in which clients engage in sequential learning remain under-explored. Bridging FL and continual learning (CL) gives rise to a challenging…

Machine Learning · Computer Science 2025-02-21 Abudukelimu Wuerkaixi , Sen Cui , Jingfeng Zhang , Kunda Yan , Bo Han , Gang Niu , Lei Fang , Changshui Zhang , Masashi Sugiyama

Catastrophic forgetting is a challenge issue in continual learning when a deep neural network forgets the knowledge acquired from the former task after learning on subsequent tasks. However, existing methods try to find the joint…

Machine Learning · Computer Science 2018-12-06 Jian Peng , Jiang Hao , Zhuo Li , Enqiang Guo , Xiaohong Wan , Deng Min , Qing Zhu , Haifeng Li

Continual post-training (CPT) is a popular and effective technique for adapting foundation models like multimodal large language models to specific and ever-evolving downstream tasks. While existing research has primarily concentrated on…

Machine Learning · Computer Science 2026-01-22 Song Lai , Haohan Zhao , Rong Feng , Changyi Ma , Wenzhuo Liu , Hongbo Zhao , Xi Lin , Dong Yi , Qingfu Zhang , Hongbin Liu , Gaofeng Meng , Fei Zhu

Human beings are able to master a variety of knowledge and skills with ongoing learning. By contrast, dramatic performance degradation is observed when new tasks are added to an existing neural network model. This phenomenon, termed as…

Machine Learning · Computer Science 2019-10-25 Xin Yao , Tianchi Huang , Chenglei Wu , Rui-Xiao Zhang , Lifeng Sun

In this paper, we propose a general framework in continual learning for generative models: Feature-oriented Continual Learning (FoCL). Unlike previous works that aim to solve the catastrophic forgetting problem by introducing regularization…

Computer Vision and Pattern Recognition · Computer Science 2020-03-10 Qicheng Lao , Mehrzad Mortazavi , Marzieh Tahaei , Francis Dutil , Thomas Fevens , Mohammad Havaei

Continual Learning (CL) methods aim to enable machine learning models to learn new tasks without catastrophic forgetting of those that have been previously mastered. Existing CL approaches often keep a buffer of previously-seen samples,…

Machine Learning · Computer Science 2022-02-22 Dong Gong , Qingsen Yan , Yuhang Liu , Anton van den Hengel , Javen Qinfeng Shi

General-purpose learning systems should improve themselves in open-ended fashion in ever-changing environments. Conventional learning algorithms for neural networks, however, suffer from catastrophic forgetting (CF), i.e., previously…

Machine Learning · Computer Science 2025-02-18 Kazuki Irie , Róbert Csordás , Jürgen Schmidhuber

Large language models (LLMs) with one or more fine-tuning phases have become a necessary step to unlock various capabilities, enabling LLMs to follow natural language instructions or align with human preferences. However, it carries the…

Computation and Language · Computer Science 2024-04-30 Tingfeng Hui , Zhenyu Zhang , Shuohuan Wang , Weiran Xu , Yu Sun , Hua Wu

Continual learning (CL) is a setting in which an agent has to learn from an incoming stream of data sequentially. CL performance evaluates the model's ability to continually learn and solve new problems with incremental available…

Machine Learning · Computer Science 2022-05-04 Josh Andle , Salimeh Yasaei Sekeh

Catastrophic Forgetting (CF) means models forgetting previously acquired knowledge when learning new data. It compromises the effectiveness of large language models (LLMs) during fine-tuning, yet the underlying causes have not been…

Computation and Language · Computer Science 2024-06-10 Hongyu Li , Liang Ding , Meng Fang , Dacheng Tao

Neural networks encounter the challenge of Catastrophic Forgetting (CF) in continual learning, where new task learning interferes with previously learned knowledge. Existing data fine-tuning and regularization methods necessitate task…

Machine Learning · Computer Science 2024-05-17 Yuwei Sun , Ippei Fujisawa , Arthur Juliani , Jun Sakuma , Ryota Kanai

The intrinsic capability to continuously learn a changing data stream is a desideratum of deep neural networks (DNNs). However, current DNNs suffer from catastrophic forgetting, which interferes with remembering past knowledge. To mitigate…

Machine Learning · Computer Science 2026-02-03 Nghia D. Nguyen , Hieu Trung Nguyen , Ang Li , Hoang Pham , Viet Anh Nguyen , Khoa D. Doan

In continual learning, where task data arrives in a sequence, fine-tuning on later tasks will often lead to performance degradation on earlier tasks. This is especially pronounced when these tasks come from diverse domains. In this setting,…

Machine Learning · Computer Science 2025-01-13 Anat Kleiman , Gintare Karolina Dziugaite , Jonathan Frankle , Sham Kakade , Mansheej Paul