English
Related papers

Related papers: Examining Forgetting in Continual Pre-training of …

200 papers

As open-weight large language models (LLMs) achieve ever more impressive performances across a wide range of tasks in English, practitioners aim to adapt these models to different languages. However, such language adaptation is often…

Machine Learning · Computer Science 2024-07-17 Anton Alexandrov , Veselin Raychev , Mark Niklas Müller , Ce Zhang , Martin Vechev , Kristina Toutanova

Recent advancements in Large Language Models (LLMs) have showcased their remarkable capabilities in text understanding and generation. However, even stronger LLMs are susceptible to acquiring erroneous or obsolete information from the…

Computation and Language · Computer Science 2024-02-19 Shiwen Ni , Dingwei Chen , Chengming Li , Xiping Hu , Ruifeng Xu , Min Yang

Large Language Models (LLMs) demonstrate exceptional capabilities in a multitude of NLP tasks. However, the efficacy of such models to languages other than English is often limited. Prior works have shown that encoder-only models such as…

Computation and Language · Computer Science 2025-05-22 Divyanshu Aggarwal , Ashutosh Sathe , Sunayana Sitaram

Despite the increasing prevalence of large language models (LLMs), we still have a limited understanding of how their representational spaces are structured. This limits our ability to interpret how and what they learn or relate them to…

While Large Language Models (LLMs) have demonstrated exceptional multitasking abilities, fine-tuning these models on downstream, domain-specific datasets is often necessary to yield superior performance on test sets compared to their…

Computation and Language · Computer Science 2024-03-15 Haoran Yang , Yumeng Zhang , Jiaqi Xu , Hongyuan Lu , Pheng Ann Heng , Wai Lam

Large Language Models (LLMs) are known for their expensive and time-consuming training. Thus, oftentimes, LLMs are fine-tuned to address a specific task, given the pretrained weights of a pre-trained LLM considered a foundation model. In…

Computation and Language · Computer Science 2025-12-05 Eshed Gal , Moshe Eliasof , Javier Turek , Uri Ascher , Eran Treister , Eldad Haber

Recently, foundation language models (LMs) have marked significant achievements in the domains of natural language processing (NLP) and computer vision (CV). Unlike traditional neural network models, foundation LMs obtain a great ability…

Computation and Language · Computer Science 2024-12-02 Yutao Yang , Jie Zhou , Xuanwen Ding , Tianyu Huai , Shunyu Liu , Qin Chen , Yuan Xie , Liang He

Catastrophic forgetting remains a major challenge when fine-tuning large language models (LLMs) on narrow, task-specific data, often degrading their general knowledge and reasoning abilities. We propose SA-SFT, a lightweight…

Computation and Language · Computer Science 2026-02-25 Yutao Sun , Mingshuai Chen , Tiancheng Zhao , Phillip Miao , Zilun Zhang , Haozhan Shen , Ruizhe Zhu , Jianwei Yin

Pretraining language models on large text corpora is a common practice in natural language processing. Fine-tuning of these models is then performed to achieve the best results on a variety of tasks. In this paper, we investigate the…

Computation and Language · Computer Science 2024-04-03 Philip Kenneweg , Alexander Schulz , Sarah Schröder , Barbara Hammer

Neural machine translation (NMT) models usually suffer from catastrophic forgetting during continual training where the models tend to gradually forget previously learned knowledge and swing to fit the newly added data which may have a…

Computation and Language · Computer Science 2020-12-01 Shuhao Gu , Yang Feng

Foundation Models (FMs) have become the hallmark of modern AI, however, these models are trained on massive data, leading to financially expensive training. Updating FMs as new data becomes available is important, however, can lead to…

Machine Learning · Computer Science 2024-04-22 James Seale Smith , Lazar Valkov , Shaunak Halbe , Vyshnavi Gutta , Rogerio Feris , Zsolt Kira , Leonid Karlinsky

Scaled post-training now drives many of the largest capability gains in language models (LMs), yet its effect on pretrained knowledge remains poorly understood. Not all forgetting is equal: Forgetting one fact (e.g., a U.S. president or an…

Machine Learning · Computer Science 2025-10-21 Jackson Harmon , Andreas Hochlehnert , Matthias Bethge , Ameya Prabhu

Fine-tuning pre-trained large language models (LLMs) on a diverse array of tasks has become a common approach for building models that can solve various natural language processing (NLP) tasks. However, where and to what extent these models…

Computation and Language · Computer Science 2024-10-29 Zheng Zhao , Yftah Ziser , Shay B. Cohen

As new knowledge rapidly accumulates, language models (LMs) with pretrained knowledge quickly become obsolete. A common approach to updating LMs is fine-tuning them directly on new knowledge. However, recent studies have shown that…

Computation and Language · Computer Science 2025-02-28 Howard Chen , Jiayi Geng , Adithya Bhaskar , Dan Friedman , Danqi Chen

Traditional Large Language Model (LLM) pretraining relies on autoregressive language modeling with randomly sampled data from web-scale datasets. Inspired by human learning techniques like spaced repetition, we hypothesize that random…

Computation and Language · Computer Science 2025-01-30 Neha Prakriya , Jui-Nan Yen , Cho-Jui Hsieh , Jason Cong

Despite the remarkable capabilities of modern large language models (LLMs), the mechanisms behind their problem-solving abilities remain elusive. In this work, we aim to better understand how the learning dynamics of LLM finetuning shapes…

Machine Learning · Computer Science 2024-11-19 Katie Kang , Amrith Setlur , Dibya Ghosh , Jacob Steinhardt , Claire Tomlin , Sergey Levine , Aviral Kumar

In recent years, Large Language Models (LLMs) have made significant strides towards Artificial General Intelligence. However, training these models from scratch requires substantial computational resources and vast amounts of text data. In…

Computation and Language · Computer Science 2024-10-03 Wenzhen Zheng , Wenbo Pan , Xu Xu , Libo Qin , Li Yue , Ming Zhou

Pre-trained language models (PLMs) have become a prevalent technique in deep learning for code, utilizing a two-stage pre-training and fine-tuning procedure to acquire general knowledge about code and specialize in a variety of downstream…

Software Engineering · Computer Science 2024-01-05 Martin Weyssow , Xin Zhou , Kisub Kim , David Lo , Houari Sahraoui

Large Language Models (LLMs) for public use require continuous pre-training to remain up-to-date with the latest data. The models also need to be fine-tuned with specific instructions to maintain their ability to follow instructions…

Computation and Language · Computer Science 2024-10-15 Ishan Jindal , Chandana Badrinath , Pranjal Bharti , Lakkidi Vinay , Sachin Dev Sharma

Existing research has shown that large language models (LLMs) exhibit remarkable performance in language understanding and generation. However, when LLMs are continuously fine-tuned on complex and diverse domain-specific downstream tasks,…

Machine Learning · Computer Science 2024-03-01 Weijieying Ren , Xinlong Li , Lei Wang , Tianxiang Zhao , Wei Qin