English
Related papers

Related papers: SEEKR: Selective Attention-Guided Knowledge Retent…

200 papers

Continual Learning is a burgeoning domain in next-generation AI, focusing on training neural networks over a sequence of tasks akin to human learning. While CL provides an edge over traditional supervised learning, its central challenge…

Machine Learning · Computer Science 2023-10-09 Guangji Bai , Qilong Zhao , Xiaoyang Jiang , Yifei Zhang , Liang Zhao

Continual learning, involving sequential training on diverse tasks, often faces catastrophic forgetting. While knowledge distillation-based approaches exhibit notable success in preventing forgetting, we pinpoint a limitation in their…

Machine Learning · Computer Science 2024-05-17 Zenglin Shi , Pei Liu , Tong Su , Yunpeng Wu , Kuien Liu , Yu Song , Meng Wang

Large language models (LLMs) can adapt to new tasks via in-context learning (ICL) without parameter updates, making them powerful learning engines for fast adaptation. While extensive research has examined ICL as a few-shot learner, whether…

Machine Learning · Computer Science 2025-09-30 Liuwang Kang , Fan Wang , Shaoshan Liu , Hung-Chyun Chou , Chuan Lin , Ning Ding

Continual Learning (CL) investigates how to train Deep Networks on a stream of tasks without incurring forgetting. CL settings proposed in literature assume that every incoming example is paired with ground-truth annotations. However, this…

Machine Learning · Statistics 2022-08-30 Matteo Boschini , Pietro Buzzega , Lorenzo Bonicelli , Angelo Porrello , Simone Calderara

The continual learning capability of large language models (LLMs) is crucial for advancing artificial general intelligence. However, continual fine-tuning LLMs across various domains often suffers from catastrophic forgetting, characterized…

Computation and Language · Computer Science 2025-08-07 Yunan Zhang , Shuoran Jiang , Mengchen Zhao , Yuefeng Li , Yang Fan , Xiangping Wu , Qingcai Chen

We present a novel class incremental learning approach based on deep neural networks, which continually learns new tasks with limited memory for storing examples in the previous tasks. Our algorithm is based on knowledge distillation and…

Machine Learning · Computer Science 2022-04-05 Minsoo Kang , Jaeyoo Park , Bohyung Han

While Large Language Models (LLMs) acquire vast knowledge during pre-training, they often lack domain-specific, new, or niche information. Continual pre-training (CPT) attempts to address this gap but suffers from catastrophic forgetting…

Computation and Language · Computer Science 2025-04-09 Oded Ovadia , Meni Brief , Rachel Lemberg , Eitam Sheetrit

The ability to learn in dynamic, nonstationary environments without forgetting previous knowledge, also known as Continual Learning (CL), is a key enabler for scalable and trustworthy deployments of adaptive solutions. While the importance…

Machine Learning · Computer Science 2021-03-25 Andrea Cossu , Antonio Carta , Davide Bacciu

Continual learning (CL) aims to empower models to learn new tasks without forgetting previously acquired knowledge. Most prior works concentrate on the techniques of architectures, replay data, regularization, \etc. However, the category…

Computer Vision and Pattern Recognition · Computer Science 2024-03-26 Bolin Ni , Hongbo Zhao , Chenghao Zhang , Ke Hu , Gaofeng Meng , Zhaoxiang Zhang , Shiming Xiang

The goal of continual learning (CL) is to learn a sequence of tasks without suffering from the phenomenon of catastrophic forgetting. Previous work has shown that leveraging memory in the form of a replay buffer can reduce performance…

Computer Vision and Pattern Recognition · Computer Science 2021-05-04 Sayna Ebrahimi , Suzanne Petryk , Akash Gokul , William Gan , Joseph E. Gonzalez , Marcus Rohrbach , Trevor Darrell

Deep learning architectures have shown remarkable results in scene understanding problems, however they exhibit a critical drop of performances when they are required to learn incrementally new tasks without forgetting old ones. This…

Computer Vision and Pattern Recognition · Computer Science 2021-01-22 Umberto Michieli , Pietro Zanuttigh

Continual fine-tuning of large language models (LLMs) is becoming increasingly crucial as these models are deployed in dynamic environments where tasks and data distributions evolve over time. While strong adaptability enables rapid…

Machine Learning · Computer Science 2026-03-11 Yiyang Lu , Yu He , Jianlong Chen , Hongyuan Zha

The continual learning (CL) ability is vital for deploying large language models (LLMs) in the dynamic world. Existing methods devise the learning module to acquire task-specific knowledge with parameter-efficient tuning (PET) block and the…

Computation and Language · Computer Science 2024-06-07 Weixiang Zhao , Shilong Wang , Yulin Hu , Yanyan Zhao , Bing Qin , Xuanyu Zhang , Qing Yang , Dongliang Xu , Wanxiang Che

Large language models (LLMs) often suffer from catastrophic forgetting in continual learning: after learning new tasks sequentially, they perform worse on earlier tasks. Existing methods mitigate catastrophic forgetting by data replay,…

Machine Learning · Computer Science 2026-05-08 Yazheng Liu , Yuxuan Wan , Rui Xu , Xi Zhang , Sihong Xie , Hui Xiong

Incremental Learning (IL) has been a long-standing problem in both vision and Natural Language Processing (NLP) communities. In recent years, as Pre-trained Language Models (PLMs) have achieved remarkable progress in various NLP downstream…

Computation and Language · Computer Science 2024-08-09 Junhao Zheng , Shengjie Qiu , Qianli Ma

Continual Learning (CL) aims to develop agents emulating the human ability to sequentially learn new tasks while being able to retain knowledge obtained from past experiences. In this paper, we introduce the novel problem of…

Computer Vision and Pattern Recognition · Computer Science 2022-01-13 Enrico Fini , Stéphane Lathuilière , Enver Sangineto , Moin Nabi , Elisa Ricci

Online Continual learning is a challenging learning scenario where the model must learn from a non-stationary stream of data where each sample is seen only once. The main challenge is to incrementally learn while avoiding catastrophic…

Machine Learning · Computer Science 2022-06-24 Mattia Sangermano , Antonio Carta , Andrea Cossu , Davide Bacciu

Lifelong language learning seeks to have models continuously learn multiple tasks in a sequential order without suffering from catastrophic forgetting. State-of-the-art approaches rely on sparse experience replay as the primary approach to…

Computation and Language · Computer Science 2022-10-04 Vladimir Araujo , Helena Balabin , Julio Hurtado , Alvaro Soto , Marie-Francine Moens

End-to-end training of Spoken Language Models (SLMs) commonly involves adapting pre-trained text-based Large Language Models (LLMs) to the speech modality through multi-stage training on diverse tasks such as ASR, TTS and spoken question…

Computation and Language · Computer Science 2025-05-26 Chi-Yuan Hsiao , Ke-Han Lu , Kai-Wei Chang , Chih-Kai Yang , Wei-Chih Chen , Hung-yi Lee

Over the past years, semantic segmentation, as many other tasks in computer vision, benefited from the progress in deep neural networks, resulting in significantly improved performance. However, deep architectures trained with…

Computer Vision and Pattern Recognition · Computer Science 2022-02-02 Guanglei Yang , Enrico Fini , Dan Xu , Paolo Rota , Mingli Ding , Hao Tang , Xavier Alameda-Pineda , Elisa Ricci