English
Related papers

Related papers: Quantifying Memorization and Detecting Training Da…

200 papers

Does GPT know you? The answer depends on your level of public recognition; however, if your information was available on a website, the answer could be yes. Most Large Language Models (LLMs) memorize training data to some extent. Thus, even…

Machine Learning · Computer Science 2025-06-19 Henrik Nolte , Michèle Finck , Kristof Meding

We present the first comprehensive study of Memorization in Multilingual Large Language Models (MLLMs), analyzing 95 languages using models across diverse model scales, architectures, and memorization definitions. As MLLMs are increasingly…

Computation and Language · Computer Science 2026-01-08 Xiaoyu Luo , Yiyi Chen , Johannes Bjerva , Qiongxiu Li

In various fields of knowledge creation, including science, new ideas often build on pre-existing information. In this work, we explore this concept within the context of language models. Specifically, we explore the potential of…

Computation and Language · Computer Science 2024-04-04 David Herel , Tomas Mikolov

Recent advances in the development of large language models have resulted in public access to state-of-the-art pre-trained language models (PLMs), including Generative Pre-trained Transformer 3 (GPT-3) and Bidirectional Encoder…

While many have shown how Large Language Models (LLMs) can be applied to a diverse set of tasks, the critical issues of data contamination and memorization are often glossed over. In this work, we address this concern for tabular data.…

Machine Learning · Computer Science 2024-12-05 Sebastian Bordt , Harsha Nori , Vanessa Rodrigues , Besmira Nushi , Rich Caruana

Large language models have been shown to memorize significant portions of their training data, which they can reproduce when appropriately prompted. This work investigates the impact of simple pruning techniques on this behavior. Our…

Machine Learning · Computer Science 2025-02-25 Mansi Gupta , Nikhar Waghela , Sarthak Gupta , Shourya Goel , Sanjif Shanmugavelu

This study investigates the mechanisms and factors influencing memorization in fine-tuned large language models (LLMs), with a focus on the medical domain due to its privacy-sensitive nature. We examine how different aspects of the…

Computation and Language · Computer Science 2025-08-06 Danil Savine

Catastrophic forgetting remains a formidable obstacle to building an omniscient model in large language models (LLMs). Despite the pioneering research on task-level forgetting in LLM fine-tuning, there is scant focus on forgetting during…

Computation and Language · Computer Science 2024-10-23 Chonghua Liao , Ruobing Xie , Xingwu Sun , Haowen Sun , Zhanhui Kang

Large language models (LLMs) are now widely used in various fields, including finance. However, Japanese financial-specific LLMs have not been proposed yet. Hence, this study aims to construct a Japanese financial-specific LLM through…

Computation and Language · Computer Science 2024-04-17 Masanori Hirano , Kentaro Imajo

This work quantifies the risk of training data leakage from LLMs (Large Language Models) using sequence-level probabilities. Computing extraction probabilities for individual sequences provides finer-grained information than has been…

Computation and Language · Computer Science 2025-04-17 Trishita Tiwari , G. Edward Suh

Pretrained Language Models (LMs) have demonstrated ability to perform numerical reasoning by extrapolating from a few examples in few-shot settings. However, the extent to which this extrapolation relies on robust reasoning is unclear. In…

Computation and Language · Computer Science 2023-03-17 Yasaman Razeghi , Robert L. Logan , Matt Gardner , Sameer Singh

Large language models (LLMs) are excellent few-shot learners. They can perform a wide variety of tasks purely based on natural language prompts provided to them. These prompts contain data of a specific downstream task -- often the private…

Machine Learning · Computer Science 2024-11-19 Haonan Duan , Adam Dziedzic , Mohammad Yaghini , Nicolas Papernot , Franziska Boenisch

In this paper, we propose a two-phase training approach where pre-trained large language models are continually pre-trained on parallel data and then supervised fine-tuned with a small amount of high-quality parallel data. To investigate…

Computation and Language · Computer Science 2024-07-04 Minato Kondo , Takehito Utsuro , Masaaki Nagata

As the capabilities of pre-trained large language models (LLMs) continue to advance, the "pre-train and fine-tune" paradigm has become increasingly mainstream, leading to the development of various fine-tuning methods. However, the privacy…

Computation and Language · Computer Science 2025-07-02 Jie Hou , Chuxiong Wu , Lannan Luo , Qiang Zeng

Autoregressive language models (ARMs) have been shown to memorize and occasionally reproduce training data verbatim, raising concerns about privacy and copyright liability. Diffusion language models (DLMs) have recently emerged as a…

Computation and Language · Computer Science 2026-03-04 Xiaoyu Luo , Wenrui Yu , Qiongxiu Li , Johannes Bjerva

Memorization in large language models (LLMs) is a growing concern. LLMs have been shown to easily reproduce parts of their training data, including copyrighted work. This is an important problem to solve, as it may violate existing…

Computation and Language · Computer Science 2024-11-19 Felix B Mueller , Rebekka Görge , Anna K Bernzen , Janna C Pirk , Maximilian Poretschkin

Large Language Models (LLMs) are prevalent in modern applications but often memorize training data, leading to privacy breaches and copyright issues. Existing research has mainly focused on posthoc analyses, such as extracting memorized…

Machine Learning · Computer Science 2025-01-10 Tarun Ram Menta , Susmit Agrawal , Chirag Agarwal

Large language models, trained on massive corpora, are prone to verbatim memorization of training data, creating significant privacy and copyright risks. While previous works have proposed various definitions for memorization, many exhibit…

Computation and Language · Computer Science 2025-11-27 Trung Cuong Dang , David Mohaisen

Recent advances in Large Language Models (LLMs) have exhibited remarkable proficiency across various tasks. Given the potent applications of LLMs in numerous fields, there has been a surge in LLM development. In developing LLMs, a common…

Computation and Language · Computer Science 2024-01-09 Chen-An Li , Hung-Yi Lee

Past work has shown that large language models are susceptible to privacy attacks, where adversaries generate sequences from a trained model and detect which sequences are memorized from the training set. In this work, we show that the…

Cryptography and Security · Computer Science 2022-12-21 Nikhil Kandpal , Eric Wallace , Colin Raffel