English
Related papers

Related papers: Impact of Fine-Tuning Methods on Memorization in L…

200 papers

It is commonplace to produce application-specific models by fine-tuning large pre-trained models using a small bespoke dataset. The widespread availability of foundation model checkpoints on the web poses considerable risks, including the…

Cryptography and Security · Computer Science 2024-04-02 Yuxin Wen , Leo Marchyok , Sanghyun Hong , Jonas Geiping , Tom Goldstein , Nicholas Carlini

The rapid advancement of large language models (LLMs) has revolutionized natural language processing, enabling applications in diverse domains such as healthcare, finance and education. However, the growing reliance on extensive data for…

Cryptography and Security · Computer Science 2024-12-10 Guoshenghui Zhao , Eric Song

Large language models (LLMs) are becoming a popular tool as they have significantly advanced in their capability to tackle a wide range of language-based tasks. However, LLMs applications are highly vulnerable to prompt injection attacks,…

Computation and Language · Computer Science 2024-11-11 Md Abdur Rahman , Fan Wu , Alfredo Cuzzocrea , Sheikh Iqbal Ahamed

Fine-tuning enables large language models (LLMs) to adapt to specific domains, but often compromises their previously established safety alignment. To mitigate the degradation of model safety during fine-tuning, we introduce LookAhead…

Computation and Language · Computer Science 2025-12-22 Kangwei Liu , Mengru Wang , Yujie Luo , Lin Yuan , Mengshu Sun , Lei Liang , Zhiqiang Zhang , Jun Zhou , Bryan Hooi , Shumin Deng

The current literature on memorization in Natural Language Models, especially Large Language Models (LLMs), poses severe security and privacy risks, as models tend to memorize personally identifying information (PIIs) from training data. We…

Computation and Language · Computer Science 2026-02-19 Kunj Joshi , David A. Smith

Natural language processing models have experienced a significant upsurge in recent years, with numerous applications being built upon them. Many of these applications require fine-tuning generic base models on customized, proprietary…

Machine Learning · Computer Science 2024-03-14 Guy Amit , Abigail Goldsteen , Ariel Farkash

The meanings of words and phrases depend not only on where they are used (contexts) but also on who use them (writers). Pretrained language models (PLMs) are powerful tools for capturing context, but they are typically pretrained and…

Computation and Language · Computer Science 2023-09-15 Daisuke Oba , Naoki Yoshinaga , Masashi Toyoda

With the widespread adoption of Large Language Models (LLMs) and increasingly stringent privacy regulations, protecting data privacy in LLMs has become essential, especially for privacy-sensitive applications. Membership Inference Attacks…

Cryptography and Security · Computer Science 2026-01-30 Md Tasnim Jawad , Mingyan Xiao , Yanzhao Wu

Large language models (LLMs) have become the backbone of modern natural language processing but pose privacy concerns about leaking sensitive training data. Membership inference attacks (MIAs), which aim to infer whether a sample is…

Machine Learning · Computer Science 2025-06-03 Toan Tran , Ruixuan Liu , Li Xiong

Large pre-trained language models (PLMs) have demonstrated strong performance on natural language understanding (NLU) tasks through fine-tuning. However, fine-tuned models still suffer from overconfident predictions, especially in…

Computation and Language · Computer Science 2023-05-31 Guande He , Jianfei Chen , Jun Zhu

The discourse on privacy risks in Large Language Models (LLMs) has disproportionately focused on verbatim memorization of training data, while a constellation of more immediate and scalable privacy threats remain underexplored. This…

Cryptography and Security · Computer Science 2025-10-03 Niloofar Mireshghallah , Tianshi Li

Many capable large language models (LLMs) are developed via self-supervised pre-training followed by a reinforcement-learning fine-tuning phase, often based on human or AI feedback. During this stage, models may be guided by their inductive…

Fine-tuning is a prominent technique to adapt a pre-trained language model to downstream scenarios. In parameter-efficient fine-tuning, only a small subset of modules are trained over the downstream datasets, while leaving the rest of the…

Computation and Language · Computer Science 2023-12-27 Xicong Shen , Yang Liu , Huiqi Liu , Jue Hong , Bing Duan , Zirui Huang , Yunlong Mao , Ye Wu , Di Wu

The pre-training and fine-tuning paradigm has demonstrated its effectiveness and has become the standard approach for tailoring language models to various tasks. Currently, community-based platforms offer easy access to various pre-trained…

Cryptography and Security · Computer Science 2024-09-17 Ruixuan Liu , Tianhao Wang , Yang Cao , Li Xiong

Instruction tuning has proven effective in enhancing Large Language Models' (LLMs) performance on downstream tasks. However, real-world fine-tuning faces inherent conflicts between model providers' intellectual property protection, clients'…

Machine Learning · Computer Science 2025-01-22 Haonan Shi , Tu Ouyang , An Wang

The pervasive deployment of deep learning models across critical domains has concurrently intensified privacy concerns due to their inherent propensity for data memorization. While Membership Inference Attacks (MIAs) serve as the gold…

Machine Learning · Computer Science 2026-04-16 Chihan Huang , Huaijin Wang , Shuai Wang

Large language models (LLMs) are increasingly trained on tabular data, which, unlike unstructured text, often contains personally identifiable information (PII) in a highly structured and explicit format. As a result, privacy risks arise,…

Cryptography and Security · Computer Science 2025-07-24 Eyal German , Sagiv Antebi , Daniel Samira , Asaf Shabtai , Yuval Elovici

Context-based fine-tuning methods, including prompting, in-context learning, soft prompting (also known as prompt tuning), and prefix-tuning, have gained popularity due to their ability to often match the performance of full fine-tuning…

Machine Learning · Computer Science 2024-04-10 Aleksandar Petrov , Philip H. S. Torr , Adel Bibi

Automated Program Repair (APR) uses various tools and techniques to help developers achieve functional and error-free code faster. In recent years, Large Language Models (LLMs) have gained popularity as components in APR tool chains because…

Software Engineering · Computer Science 2025-07-29 Roman Macháček , Anastasiia Grishina , Max Hort , Leon Moonen

Large language models (LLMs) are often fine-tuned for use on downstream tasks, though this can degrade capabilities learned during previous training. This phenomenon, often referred to as catastrophic forgetting, has important potential…

Computation and Language · Computer Science 2024-12-30 Megan Ung , Alicia Sun , Samuel J. Bell , Bhaktipriya Radharapu , Levent Sagun , Adina Williams