English
Related papers

Related papers: Memorization in Fine-Tuned Large Language Models

200 papers

Large language models (LLMs) are often fine-tuned for use on downstream tasks, though this can degrade capabilities learned during previous training. This phenomenon, often referred to as catastrophic forgetting, has important potential…

Computation and Language · Computer Science 2024-12-30 Megan Ung , Alicia Sun , Samuel J. Bell , Bhaktipriya Radharapu , Levent Sagun , Adina Williams

Training and fine-tuning large language models (LLMs) come with challenges related to memory and computational requirements due to the increasing size of the model weights and the optimizer states. Various techniques have been developed to…

Machine Learning · Computer Science 2025-12-09 Yehonathan Refael , Jonathan Svirsky , Boris Shustin , Wasim Huleihel , Ofir Lindenbaum

Large language models have been shown to memorize significant portions of their training data, which they can reproduce when appropriately prompted. This work investigates the impact of simple pruning techniques on this behavior. Our…

Machine Learning · Computer Science 2025-02-25 Mansi Gupta , Nikhar Waghela , Sarthak Gupta , Shourya Goel , Sanjif Shanmugavelu

While Large Language Models (LLMs) achieve remarkable performance through training on massive datasets, they can exhibit concerning behaviors such as verbatim reproduction of training data rather than true generalization. This memorization…

Computation and Language · Computer Science 2025-05-07 Albérick Euraste Djiré , Abdoul Kader Kaboré , Earl T. Barr , Jacques Klein , Tegawendé F. Bissyandé

Large Language Models (LLMs) have significantly advanced natural language processing with exceptional task generalization capabilities. Low-Rank Adaption (LoRA) offers a cost-effective fine-tuning solution, freezing the original model…

Machine Learning · Computer Science 2025-03-18 Jun Zhang , Jue Wang , Huan Li , Lidan Shou , Ke Chen , Yang You , Guiming Xie , Xuejian Gong , Kunlong Zhou

Large language models, trained on massive corpora, are prone to verbatim memorization of training data, creating significant privacy and copyright risks. While previous works have proposed various definitions for memorization, many exhibit…

Computation and Language · Computer Science 2025-11-27 Trung Cuong Dang , David Mohaisen

Large Language Models (LLMs) memorize, and thus, among huge amounts of uncontrolled data, may memorize Personally Identifiable Information (PII), which should not be stored and, consequently, not leaked. In this paper, we introduce Private…

Cryptography and Security · Computer Science 2025-08-22 Elena Sofia Ruzzetti , Giancarlo A. Xompero , Davide Venditti , Fabio Massimo Zanzotto

While Large Language Models (LLMs) have demonstrated exceptional multitasking abilities, fine-tuning these models on downstream, domain-specific datasets is often necessary to yield superior performance on test sets compared to their…

Computation and Language · Computer Science 2024-03-15 Haoran Yang , Yumeng Zhang , Jiaqi Xu , Hongyuan Lu , Pheng Ann Heng , Wai Lam

Training data memorization in NLP can both be beneficial (e.g., closed-book QA) and undesirable (personal data extraction). In any case, successful model training requires a non-trivial amount of memorization to store word spellings,…

Computation and Language · Computer Science 2021-12-03 Eugene Kharitonov , Marco Baroni , Dieuwke Hupkes

Large Language Models (LLMs) have transformed both everyday life and scientific research. However, adapting LLMs from general-purpose models to specialized tasks remains challenging, particularly in resource-constrained environments.…

Machine Learning · Computer Science 2025-09-12 Hao Zhang , Bo Huang , Zhenjia Li , Xi Xiao , Hui Yi Leong , Zumeng Zhang , Xinwei Long , Tianyang Wang , Hao Xu

The impressive capabilities of large language models (LLMs) have sparked debate over whether these models genuinely generalize to unseen tasks or predominantly rely on memorizing vast amounts of pretraining data. To explore this issue, we…

Computation and Language · Computer Science 2025-03-04 Xinyi Wang , Antonis Antoniades , Yanai Elazar , Alfonso Amayuelas , Alon Albalak , Kexun Zhang , William Yang Wang

We conduct a behavioral exploration of LoRA fine-tuned LLMs for Passage Reranking to understand how relevance signals are learned and deployed by Large Language Models. By fine-tuning Mistral-7B, LLaMA3.1-8B, and Pythia-6.9B on MS MARCO…

Information Retrieval · Computer Science 2025-08-12 Atharva Nijasure , Tanya Chowdhury , James Allan

Fine-tuning large language models (LLMs) aims to adapt pre-trained models to specific tasks using relatively small and domain-specific datasets. Among Parameter-Efficient Fine-Tuning (PEFT) methods, Low-Rank Adaptation (LoRA) stands out by…

Computation and Language · Computer Science 2026-04-16 Yarui Cao , Kai Liu

Large language models (LLMs) store vast amounts of knowledge, which often requires updates to correct factual errors, incorporate newly acquired information, or adapt model behavior. Model editing methods have emerged as efficient solutions…

Computation and Language · Computer Science 2025-10-27 Fufang Wen , Shichang Zhang

The advancement of Large Language Models (LLMs) for domain applications in fields such as materials science and engineering depends on the development of fine-tuning strategies that adapt models for specialized, technical capabilities. In…

Computation and Language · Computer Science 2024-09-06 Wei Lu , Rachel K. Luu , Markus J. Buehler

Although large language models excel across many tasks, they can memorise training data and thereby expose private or copyrighted text. Most defences target the pre-training stage, leaving memorisation during fine-tuning, especially for…

Computation and Language · Computer Science 2025-10-14 Dean L. Slack , Noura Al Moubayed

The surge in interest and application of large language models (LLMs) has sparked a drive to fine-tune these models to suit specific applications, such as finance and medical science. However, concerns regarding data privacy have emerged,…

Machine Learning · Computer Science 2024-06-04 Xiao-Yang Liu , Rongyi Zhu , Daochen Zha , Jiechao Gao , Shan Zhong , Matt White , Meikang Qiu

Effective biomedical data integration depends on automated term normalization, the mapping of natural language biomedical terms to standardized identifiers. This linking of terms to identifiers is essential for semantic interoperability.…

Computation and Language · Computer Science 2025-10-23 Suswitha Pericharla , Daniel B. Hier , Tayo Obafemi-Ajayi

Federated learning (FL) enables collaborative training without raw data sharing, but still risks training data memorization. Existing FL memorization detection techniques focus on one sample at a time, underestimating more subtle risks of…

As large language models (LLMs) become progressively more embedded in clinical decision-support, documentation, and patient-information systems, ensuring their privacy and trustworthiness has emerged as an imperative challenge for the…

Cryptography and Security · Computer Science 2025-10-22 Alexander Nemecek , Zebin Yun , Zahra Rahmani , Yaniv Harel , Vipin Chaudhary , Mahmood Sharif , Erman Ayday