English
Related papers

Related papers: Impact of Fine-Tuning Methods on Memorization in L…

200 papers

Large scale adoption of large language models has introduced a new era of convenient knowledge transfer for a slew of natural language processing tasks. However, these models also run the risk of undermining user trust by exposing unwanted…

Computation and Language · Computer Science 2022-04-21 Richard Plant , Valerio Giuffrida , Dimitra Gkatzia

Large language models (LLMs) with one or more fine-tuning phases have become a necessary step to unlock various capabilities, enabling LLMs to follow natural language instructions or align with human preferences. However, it carries the…

Computation and Language · Computer Science 2024-04-30 Tingfeng Hui , Zhenyu Zhang , Shuohuan Wang , Weiran Xu , Yu Sun , Hua Wu

Large language models (LLMs) are increasingly used for decision-making tasks under uncertainty; however, their risk profiles and how they are influenced by prompting and alignment methods remain underexplored. Existing studies have…

Artificial Intelligence · Computer Science 2025-10-08 Yikai Wang , Xiaocheng Li , Guanting Chen

We study the privacy implications of training recurrent neural networks (RNNs) with sensitive training datasets. Considering membership inference attacks (MIAs), which aim to infer whether or not specific data records have been used in…

Cryptography and Security · Computer Science 2023-01-23 Yunhao Yang , Parham Gohari , Ufuk Topcu

Machine learning models are known to leak sensitive information, as they inevitably memorize (parts of) their training data. More alarmingly, large language models (LLMs) are now trained on nearly all available data, which amplifies the…

Machine Learning · Computer Science 2025-10-10 Jiashu Tao , Reza Shokri

Large language models (LLMs) acquire substantial world knowledge during pre-training, which is further shaped by post-training techniques such as supervised fine-tuning (SFT). However, the impact of SFT on a model's knowledge remains…

Computation and Language · Computer Science 2026-02-11 Junjie Ye , Yuming Yang , Yang Nan , Shuo Li , Qi Zhang , Tao Gui , Xuanjing Huang , Peng Wang , Zhongchao Shi , Jianping Fan

Membership inference attacks (MIAs) are widely used to assess the privacy risks associated with machine learning models. However, when these attacks are applied to pre-trained large language models (LLMs), they encounter significant…

Cryptography and Security · Computer Science 2026-05-26 Meng Tong , Yuntao Du , Kejiang Chen , Weiming Zhang , Ninghui Li

In this paper we develop state-of-the-art privacy attacks against Large Language Models (LLMs), where an adversary with some access to the model tries to learn something about the underlying training data. Our headline results are new…

Cryptography and Security · Computer Science 2024-07-16 Jeffrey G. Wang , Jason Wang , Marvin Li , Seth Neel

Large language models (LLMs) exhibit cognitive biases -- systematic tendencies of irrational decision-making, similar to those seen in humans. Prior work has found that these biases vary across models and can be amplified by instruction…

Computation and Language · Computer Science 2025-07-15 Itay Itzhak , Yonatan Belinkov , Gabriel Stanovsky

In recent years, large language models (LLMs) have significantly advanced the field of natural language processing (NLP). By fine-tuning LLMs with data from specific scenarios, these foundation models can better adapt to various downstream…

Computation and Language · Computer Science 2024-11-05 Jiaqi Wu , Simin Chen , Yuzhe Yang , Yijiang Li , Shiyue Hou , Rui Jing , Zehua Wang , Wei Chen , Zijian Tian

Membership Inference Attacks (MIAs) are widely used to quantify training data memorization and assess privacy risks. Standard evaluation requires repeated retraining, which is computationally costly for large models. One-run methods (single…

Machine Learning · Computer Science 2026-02-06 Mathieu Even , Clément Berenfeld , Linus Bleistein , Tudor Cebere , Julie Josse , Aurélien Bellet

Machine learning (ML) models have been widely applied to various applications, including image classification, text generation, audio recognition, and graph data analysis. However, recent studies have shown that ML models are vulnerable to…

Machine Learning · Computer Science 2022-02-04 Hongsheng Hu , Zoran Salcic , Lichao Sun , Gillian Dobbie , Philip S. Yu , Xuyun Zhang

Large Language Models (LLMs) demonstrate remarkable capabilities in question answering (QA), but metrics for assessing their reliance on memorization versus retrieval remain underdeveloped. Moreover, while finetuned models are…

Machine Learning · Computer Science 2025-06-17 Peter Carragher , Abhinand Jha , R Raghav , Kathleen M. Carley

Prompt Learning has recently gained great popularity in bridging the gap between pretraining tasks and various downstream tasks. It freezes Pretrained Language Models (PLMs) and only tunes a few task-related parameters (prompts) for…

Computation and Language · Computer Science 2022-06-07 Yuezihan Jiang , Hao Yang , Junyang Lin , Hanyu Zhao , An Yang , Chang Zhou , Hongxia Yang , Zhi Yang , Bin Cui

Prompt serves as a crucial link in interacting with large language models (LLMs), widely impacting the accuracy and interpretability of model outputs. However, acquiring accurate and high-quality responses necessitates precise prompts,…

Cryptography and Security · Computer Science 2024-08-20 Xiongtao Sun , Gan Liu , Zhipeng He , Hui Li , Xiaoguang Li

Membership inference attacks (MIAs) aim to determine whether specific data were used to train a model. While extensively studied on classification models, their impact on time series forecasting remains largely unexplored. We address this…

Machine Learning · Computer Science 2026-02-13 Nicolas Johansson , Tobias Olsson , Daniel Nilsson , Johan Östman , Fazeleh Hoseini

Prompt learning is a crucial technique for adapting pre-trained multimodal language models (MLLMs) to user tasks. Federated prompt personalization (FPP) is further developed to address data heterogeneity and local overfitting, however, it…

Cryptography and Security · Computer Science 2025-05-29 Sizai Hou , Songze Li , Baturalp Buyukates

Early detection of security bug reports (SBRs) is critical for timely vulnerability mitigation. We present an evaluation of prompt-based engineering and fine-tuning approaches for predicting SBRs using Large Language Models (LLMs). Our…

Cryptography and Security · Computer Science 2026-02-02 Farnaz Soltaniani , Shoaib Razzaq , Mohammad Ghafari

Membership inference attacks (MIA) attempt to verify the membership of a given data sample in the training set for a model. MIA has become relevant in recent years, following the rapid development of large language models (LLM). Many are…

Computation and Language · Computer Science 2025-02-04 Haritz Puerto , Martin Gubri , Sangdoo Yun , Seong Joon Oh

Pre-trained vision-language models are able to interpret visual concepts and language semantics. Prompt learning, a method of constructing prompts for text encoders or image encoders, elicits the potentials of pre-trained models and readily…

Computer Vision and Pattern Recognition · Computer Science 2025-02-21 Zhenhan Huang , Tejaswini Pedapati , Pin-Yu Chen , Jianxi Gao