English
Related papers

Related papers: Exploring Forgetting in Large Language Model Pre-T…

200 papers

In contrast to children, language models (LMs) exhibit considerably inferior data efficiency when acquiring language. In this submission to the BabyLM Challenge (Warstadt et al., 2023), we test the hypothesis that this data efficiency gap…

Computation and Language · Computer Science 2024-02-29 Theodor Amariucai , Alex Warstadt

Pretraining large language models (LLMs) on vast and heterogeneous datasets is crucial for achieving state-of-the-art performance across diverse downstream tasks. However, current training paradigms treat all samples equally, overlooking…

Machine Learning · Computer Science 2025-02-11 Daouda Sow , Herbert Woisetschläger , Saikiran Bulusu , Shiqiang Wang , Hans-Arno Jacobsen , Yingbin Liang

Unlearning seeks to remove specific knowledge from large language models (LLMs), but its effectiveness remains contested. On one side, "forgotten" knowledge can often be recovered through interventions such as light fine-tuning; on the…

Computation and Language · Computer Science 2025-09-30 Qingjie Zhang , Haoting Qian , Zhicong Huang , Cheng Hong , Minlie Huang , Ke Xu , Chao Zhang , Han Qiu

Large Language Models (LLMs) have demonstrated significant potential in medicine, with many studies adapting them through continued pre-training or fine-tuning on medical data to enhance domain-specific accuracy and safety. However, a key…

Large language models (LLMs) hold promise for generating plans for complex tasks, but their effectiveness is limited by sequential execution, lack of control flow models, and difficulties in skill retrieval. Addressing these issues is…

Computation and Language · Computer Science 2024-10-18 Andrei Cosmin Redis , Mohammadreza Fani Sani , Bahram Zarrin , Andrea Burattin

Large pre-trained language models help to achieve state of the art on a variety of natural language processing (NLP) tasks, nevertheless, they still suffer from forgetting when incrementally learning a sequence of tasks. To alleviate this…

Computation and Language · Computer Science 2023-03-03 Mingxu Tao , Yansong Feng , Dongyan Zhao

The leakage of benchmark data into the training data has emerged as a significant challenge for evaluating the capabilities of large language models (LLMs). In this work, we challenge the common assumption that small-scale contamination…

Machine Learning · Computer Science 2025-06-17 Sebastian Bordt , Suraj Srinivas , Valentyn Boreiko , Ulrike von Luxburg

This paper considers continual learning of large-scale pretrained neural machine translation model without accessing the previous training data or introducing model separation. We argue that the widely used regularization-based methods,…

Computation and Language · Computer Science 2022-11-07 Shuhao Gu , Bojie Hu , Yang Feng

Through their transfer learning abilities, highly-parameterized large pre-trained language models have dominated the NLP landscape for a multitude of downstream language tasks. Though linguistically proficient, the inability of these models…

Computation and Language · Computer Science 2022-11-07 Mandar Sharma , Nikhil Muralidhar , Naren Ramakrishnan

Machine unlearning is a process to remove specific data points from a trained model while maintaining the performance on the retain data, addressing privacy or legal requirements. Despite its importance, existing unlearning evaluations tend…

Machine Learning · Computer Science 2026-01-30 Yongwoo Kim , Sungmin Cha , Donghyun Kim

Large Language Models (LLMs) are prevalent in modern applications but often memorize training data, leading to privacy breaches and copyright issues. Existing research has mainly focused on posthoc analyses, such as extracting memorized…

Machine Learning · Computer Science 2025-01-10 Tarun Ram Menta , Susmit Agrawal , Chirag Agarwal

Foundation Models (FMs) have become the hallmark of modern AI, however, these models are trained on massive data, leading to financially expensive training. Updating FMs as new data becomes available is important, however, can lead to…

Machine Learning · Computer Science 2024-04-22 James Seale Smith , Lazar Valkov , Shaunak Halbe , Vyshnavi Gutta , Rogerio Feris , Zsolt Kira , Leonid Karlinsky

Large Language Models (LLMs) demand significant computational resources, making it essential to enhance their capabilities without retraining from scratch. A key challenge in this domain is \textit{catastrophic forgetting} (CF), which…

Machine Learning · Computer Science 2025-01-31 Haichao Wei , Yunxiang Ren , Zhoutong Fu , Aman Lunia , Yi-Lin Chen , Alice Leung , Ya Xu

Modern large-scale Pre-trained Language Models (PLMs) have achieved tremendous success on a wide range of downstream tasks. However, most of the LM pre-training objectives only focus on text reconstruction, but have not sought to learn…

Computation and Language · Computer Science 2022-10-28 Liliang Ren , Zixuan Zhang , Han Wang , Clare R. Voss , Chengxiang Zhai , Heng Ji

Large language models (LMs) have been shown to memorize parts of their training data, and when prompted appropriately, they will emit the memorized training data verbatim. This is undesirable because memorization violates privacy (exposing…

Machine Learning · Computer Science 2023-03-07 Nicholas Carlini , Daphne Ippolito , Matthew Jagielski , Katherine Lee , Florian Tramer , Chiyuan Zhang

Neural language models are black-boxes--both linguistic patterns and factual knowledge are distributed across billions of opaque parameters. This entangled encoding makes it difficult to reliably inspect, verify, or update specific facts.…

The continual learning capability of large language models (LLMs) is crucial for advancing artificial general intelligence. However, continual fine-tuning LLMs across various domains often suffers from catastrophic forgetting, characterized…

Computation and Language · Computer Science 2025-08-07 Yunan Zhang , Shuoran Jiang , Mengchen Zhao , Yuefeng Li , Yang Fan , Xiangping Wu , Qingcai Chen

The field of Math-NLP has witnessed significant growth in recent years, motivated by the desire to expand LLM performance to the learning of non-linguistic notions (numerals, and subsequently, arithmetic reasoning). However, non-linguistic…

Computation and Language · Computer Science 2023-05-16 Mandar Sharma , Nikhil Muralidhar , Naren Ramakrishnan

The extensive memory footprint of language model (LM) fine-tuning poses a challenge for both researchers and practitioners. LMs use an embedding matrix to represent extensive vocabularies, forming a substantial proportion of the model…

Computation and Language · Computer Science 2025-03-26 Miles Williams , Nikolaos Aletras

Multi-Task Learning (MTL) is widely-accepted in Natural Language Processing as a standard technique for learning multiple related tasks in one model. Training an MTL model requires having the training data for all tasks available at the…

Computation and Language · Computer Science 2023-02-23 Sudipta Kar , Giuseppe Castellucci , Simone Filice , Shervin Malmasi , Oleg Rokhlenko