English
Related papers

Related papers: Continual Pre-Training Mitigates Forgetting in Lan…

200 papers

Neural networks struggle in continual learning settings from catastrophic forgetting: when trials are blocked, new learning can overwrite the learning from previous blocks. Humans learn effectively in these settings, in some cases even…

Neurons and Cognition · Quantitative Biology 2022-11-07 Jacob Russin , Maryam Zolfaghar , Seongmin A. Park , Erie Boorman , Randall C. O'Reilly

Continual learning is conventionally tackled through sequential fine-tuning, a process that, while enabling adaptation, inherently favors plasticity over the stability needed to retain prior knowledge. While existing approaches attempt to…

Computer Vision and Pattern Recognition · Computer Science 2025-06-05 Ghada Sokar , Gintare Karolina Dziugaite , Anurag Arnab , Ahmet Iscen , Pablo Samuel Castro , Cordelia Schmid

Language models (LMs) trained on vast quantities of unlabelled data have greatly advanced the field of natural language processing (NLP). In this study, we re-visit the widely accepted notion in NLP that continued pre-training LMs on…

Computation and Language · Computer Science 2023-10-09 Zhengxiang Shi , Aldo Lipani

Continual learning refers to the capability of a machine learning model to learn and adapt to new information, without compromising its performance on previously learned tasks. Although several studies have investigated continual learning…

Information Retrieval · Computer Science 2024-06-21 Jingrui Hou , Georgina Cosma , Axel Finke

Pre-trained language models learn informative word representations on a large-scale text corpus through self-supervised learning, which has achieved promising performance in fields of natural language processing (NLP) after fine-tuning.…

Computation and Language · Computer Science 2023-10-31 Jian Yang , Xinyu Hu , Gang Xiao , Yulong Shen

Continual learning (CL) learns a sequence of tasks incrementally with the goal of achieving two main objectives: overcoming catastrophic forgetting (CF) and encouraging knowledge transfer (KT) across tasks. However, most existing techniques…

Computation and Language · Computer Science 2021-12-21 Zixuan Ke , Bing Liu , Nianzu Ma , Hu Xu , Lei Shu

In this paper, we study how the intrinsic nature of pre-training data contributes to the fine-tuned downstream performance. To this end, we pre-train different transformer-based masked language models on several corpora with certain…

Computation and Language · Computer Science 2020-12-23 Cheng-Han Chiang , Hung-yi Lee

In the present era of deep learning, continual learning research is mainly focused on mitigating forgetting when training a neural network with stochastic gradient descent on a non-stationary stream of data. On the other hand, in the more…

Machine Learning · Computer Science 2024-05-30 Soochan Lee , Hyeonseong Jeon , Jaehyeon Son , Gunhee Kim

It has been observed that neural networks perform poorly when the data or tasks are presented sequentially. Unlike humans, neural networks suffer greatly from catastrophic forgetting, making it impossible to perform life-long learning. To…

Machine Learning · Computer Science 2023-01-31 Longhui Yu , Tianyang Hu , Lanqing Hong , Zhen Liu , Adrian Weller , Weiyang Liu

Large language models (LMs) have rapidly become a mainstay in Natural Language Processing. These models are known to acquire rich linguistic knowledge from training on large amounts of text. In this paper, we investigate if pre-training on…

Computation and Language · Computer Science 2022-10-25 Avinash Madasu , Shashank Srivastava

Language models (LMs) have been instrumental for the rapid advance of natural language processing. This paper studies continual pre-training of LMs, in particular, continual domain-adaptive pre-training (or continual DAP-training). Existing…

Computation and Language · Computer Science 2023-04-13 Zixuan Ke , Yijia Shao , Haowei Lin , Tatsuya Konishi , Gyuhak Kim , Bing Liu

Continual learning (CL) aims to incrementally learn different tasks (such as classification) in a non-stationary data stream without forgetting old ones. Most CL works focus on tackling catastrophic forgetting under a learning-from-scratch…

Machine Learning · Computer Science 2024-01-17 Mark D. McDonnell , Dong Gong , Amin Parveneh , Ehsan Abbasnejad , Anton van den Hengel

Large pre-trained language models help to achieve state of the art on a variety of natural language processing (NLP) tasks, nevertheless, they still suffer from forgetting when incrementally learning a sequence of tasks. To alleviate this…

Computation and Language · Computer Science 2023-03-03 Mingxu Tao , Yansong Feng , Dongyan Zhao

Continual learning aims to enable models to adapt to new datasets without losing performance on previously learned data, often assuming that prior data is no longer available. However, in many practical scenarios, both old and new data are…

Machine Learning · Computer Science 2025-03-03 Eli Verwimp , Guy Hacohen , Tinne Tuytelaars

The emergence of Pre-trained Language Models (PLMs) has achieved tremendous success in the field of Natural Language Processing (NLP) by learning universal representations on large corpora in a self-supervised manner. The pre-trained models…

Information Retrieval · Computer Science 2023-09-14 Peng Liu , Lemei Zhang , Jon Atle Gulla

Continual learning aims to train a model incrementally on a sequence of tasks without forgetting previous knowledge. Although continual learning has been widely studied in computer vision, its application to Vision+Language tasks is not…

Machine Learning · Computer Science 2024-01-23 Mavina Nikandrou , Lu Yu , Alessandro Suglia , Ioannis Konstas , Verena Rieser

Continual learning (CL) is an approach to address catastrophic forgetting, which refers to forgetting previously learned knowledge by neural networks when trained on new tasks or data distributions. The adversarial robustness has decomposed…

Machine Learning · Computer Science 2023-07-04 Hikmat Khan , Nidhal C. Bouaynaya , Ghulam Rasool

Substantial improvements have been made in machine reading comprehension, where the machine answers questions based on a given context. Current state-of-the-art models even surpass human performance on several benchmarks. However, their…

Computation and Language · Computer Science 2021-05-11 Wei-Cheng Huang , Chien-yu Huang , Hung-yi Lee

The Contrastive Language-Image Pre-training (CLIP) Model is a recently proposed large-scale pre-train model which attracts increasing attention in the computer vision community. Benefiting from its gigantic image-text training set, the CLIP…

Computer Vision and Pattern Recognition · Computer Science 2022-07-21 Yuxuan Ding , Lingqiao Liu , Chunna Tian , Jingyuan Yang , Haoxuan Ding

Predictive learning ideally builds the world model of physical processes in one or more given environments. Typical setups assume that we can collect data from all environments at all times. In practice, however, different prediction tasks…

Computer Vision and Pattern Recognition · Computer Science 2022-04-13 Geng Chen , Wendong Zhang , Han Lu , Siyu Gao , Yunbo Wang , Mingsheng Long , Xiaokang Yang