English
Related papers

Related papers: Continual Learning in Vision-Language Models via A…

200 papers

Fine-tuning pre-trained language models has become the prevalent paradigm for building downstream NLP models. Oftentimes fine-tuned models are readily available but their training data is not, due to data privacy or intellectual property…

Computation and Language · Computer Science 2025-05-23 Xisen Jin , Xiang Ren , Daniel Preotiuc-Pietro , Pengxiang Cheng

Model merging (e.g., via interpolation or task arithmetic) fuses multiple models trained on different tasks to generate a multi-task solution. The technique has been proven successful in previous studies, where the models are trained on…

Computer Vision and Pattern Recognition · Computer Science 2023-10-12 Yi-Lin Sung , Linjie Li , Kevin Lin , Zhe Gan , Mohit Bansal , Lijuan Wang

Vision-Language Models (VLMs) represent a significant breakthrough in artificial intelligence by integrating visual and textual modalities to achieve impressive zero-shot capabilities. However, VLMs are susceptible to catastrophic…

Computer Vision and Pattern Recognition · Computer Science 2026-03-12 Haoyuan Gao , Zicong Zhang , Yuqi Wei , Linglan Zhao , Guilin Li , Yexin Li , Bo Wang , Linghe Kong , Weiran Huang

The ability to learn in dynamic, nonstationary environments without forgetting previous knowledge, also known as Continual Learning (CL), is a key enabler for scalable and trustworthy deployments of adaptive solutions. While the importance…

Machine Learning · Computer Science 2021-03-25 Andrea Cossu , Antonio Carta , Davide Bacciu

Continual learning allows the system to learn and adapt to new tasks while retaining the knowledge acquired from previous tasks. However, deep learning models suffer from catastrophic forgetting of knowledge learned from earlier tasks while…

Machine Learning · Computer Science 2024-12-17 Dupati Srikar Chandra , P. K. Srijith , Dana Rezazadegan , Chris McCarthy

Model merging combines the parameters of multiple neural networks into a single model without additional training. As fine-tuned large language models (LLMs) proliferate, merging offers a computationally efficient alternative to ensembles…

Computation and Language · Computer Science 2026-03-31 Mingyang Song , Mao Zheng

Meta continual learning algorithms seek to train a model when faced with similar tasks observed in a sequential manner. Despite promising methodological advancements, there is a lack of theoretical frameworks that enable analysis of…

Machine Learning · Computer Science 2020-10-12 R. Krishnan , Prasanna Balaprakash

This paper considers continual learning of large-scale pretrained neural machine translation model without accessing the previous training data or introducing model separation. We argue that the widely used regularization-based methods,…

Computation and Language · Computer Science 2022-11-07 Shuhao Gu , Bojie Hu , Yang Feng

Continual learning is a promising machine learning paradigm to learn new tasks while retaining previously learned knowledge over streaming training data. Till now, rehearsal-based methods, keeping a small part of data from old tasks as a…

Machine Learning · Computer Science 2023-08-04 Quanziang Wang , Renzhen Wang , Yuexiang Li , Dong Wei , Kai Ma , Yefeng Zheng , Deyu Meng

The intrinsic difficulty in adapting deep learning models to non-stationary environments limits the applicability of neural networks to real-world tasks. This issue is critical in practical supervised learning settings, such as the ones in…

Machine Learning · Computer Science 2023-06-09 Simone Marullo , Matteo Tiezzi , Marco Gori , Stefano Melacci , Tinne Tuytelaars

Humans can naturally learn new and varying tasks in a sequential manner. Continual learning is a class of learning algorithms that updates its learned model as it sees new data (on potentially new tasks) in a sequence. A key challenge in…

Machine Learning · Computer Science 2025-03-04 Masih Eskandar , Tooba Imtiaz , Davin Hill , Zifeng Wang , Jennifer Dy

While most current approaches rely on further training techniques, such as fine-tuning or reinforcement learning, to enhance model capacities, model merging stands out for its ability of improving models without requiring any additional…

Computation and Language · Computer Science 2025-05-26 Zehua Liu , Han Wu , Yuxuan Yao , Ruifeng She , Xiongwei Han , Tao Zhong , Mingxuan Yuan

Continual learning aims to sequentially learn new tasks without forgetting previous tasks' knowledge (catastrophic forgetting). One factor that can cause forgetting is the interference between the gradients on losses from different tasks.…

Computation and Language · Computer Science 2025-12-01 Xueying Bai , Jinghuan Shang , Yifan Sun , Niranjan Balasubramanian

Continual learning is the ability to sequentially learn over time by accommodating knowledge while retaining previously learned experiences. Neural networks can learn multiple tasks when trained on them jointly, but cannot maintain…

Machine Learning · Computer Science 2018-10-26 Frantzeska Lavda , Jason Ramapuram , Magda Gregorova , Alexandros Kalousis

Vision-Language Models (VLMs) combine visual perception with the general capabilities, such as reasoning, of Large Language Models (LLMs). However, the mechanisms by which these two abilities can be combined and contribute remain poorly…

Computation and Language · Computer Science 2025-07-16 Shiqi Chen , Jinghan Zhang , Tongyao Zhu , Wei Liu , Siyang Gao , Miao Xiong , Manling Li , Junxian He

Previous studies on continual knowledge learning (CKL) in large language models (LLMs) have predominantly focused on approaches such as regularization, architectural modifications, and rehearsal techniques to mitigate catastrophic…

Computation and Language · Computer Science 2025-02-06 Yeongbin Seo , Dongha Lee , Jinyoung Yeo

Fine-tuning large language models (LLMs) with Low-Rank adaption (LoRA) is widely acknowledged as an effective approach for continual learning for new tasks. However, it often suffers from catastrophic forgetting when dealing with multiple…

Computation and Language · Computer Science 2024-10-01 Jialin Liu , Jianhua Wu , Jie Liu , Yutai Duan

Future deep learning models will be distinguished by systems that perpetually learn through interaction, imagination, and cooperation, blurring the line between training and inference. This makes continual learning a critical challenge, as…

Machine Learning · Computer Science 2025-05-20 Truman Hickok

Most existing works on continual learning (CL) focus on overcoming the catastrophic forgetting (CF) problem, with dynamic models and replay methods performing exceptionally well. However, since current works tend to assume exclusivity or…

Computer Vision and Pattern Recognition · Computer Science 2022-10-13 Sijia Wang , Yoojin Choi , Junya Chen , Mostafa El-Khamy , Ricardo Henao

One weakness of machine learning algorithms is the poor ability of models to solve new problems without forgetting previously acquired knowledge. The Continual Learning (CL) paradigm has emerged as a protocol to systematically investigate…

Machine Learning · Computer Science 2022-03-02 Heinke Hihn , Daniel A. Braun