English
Related papers

Related papers: Understanding Transformer Memorization Recall Thro…

200 papers

In this study, we propose an axiomatic system to define and quantify the precise memorization and in-context reasoning effects used by the large language model (LLM) for language generation. These effects are formulated as non-linear…

Machine Learning · Computer Science 2024-05-21 Siyu Lou , Yuntian Chen , Xiaodan Liang , Liang Lin , Quanshi Zhang

Language Generation Models produce words based on the previous context. Although existing methods offer input attributions as explanations for a model's prediction, it is still unclear how prior words affect the model's decision throughout…

Computation and Language · Computer Science 2023-05-23 Javier Ferrando , Gerard I. Gállego , Ioannis Tsiamas , Marta R. Costa-jussà

Large Language Models (LLMs) are often evaluated against ideals of perfect Bayesian inference, yet growing evidence suggests that their in-context reasoning exhibits systematic forgetting of past information. Rather than viewing this…

Computation and Language · Computer Science 2026-04-08 Alexandros Christoforos

Large Language Models (LLMs) frequently memorize long sequences verbatim, often with serious legal and privacy implications. Much prior work has studied such verbatim memorization using observational data. To complement such work, we…

Computation and Language · Computer Science 2024-07-26 Jing Huang , Diyi Yang , Christopher Potts

Large language models (LLMs) cannot be trusted for economic forecasts during periods covered by their training data. Counterfactual forecasting ability is non-identified when the model has seen the realized values: any observed output is…

General Finance · Quantitative Finance 2025-12-16 Alejandro Lopez-Lira , Yuehua Tang , Mingyin Zhu

When language models (LMs) are trained to forget (or "unlearn'') a skill, how precisely does their behavior change? We study the behavior of transformer LMs in which tasks have been forgotten via fine-tuning on randomized labels. Such LMs…

Machine Learning · Computer Science 2024-09-05 Eric Zhang , Leshem Chosen , Jacob Andreas

Large Language Models (LLMs) have demonstrated remarkable capabilities across a wide range of tasks, yet they also exhibit memorization of their training data. This phenomenon raises critical questions about model behavior, privacy risks,…

Machine Learning · Computer Science 2025-12-15 Alexander Xiong , Xuandong Zhao , Aneesh Pappu , Dawn Song

Understanding whether and to what extent large language models (LLMs) have memorised training data has important implications for the reliability of their output and the privacy of their training data. In order to cleanly measure and…

Computation and Language · Computer Science 2024-07-30 Till Speicher , Mohammad Aflah Khan , Qinyuan Wu , Vedant Nanda , Soumi Das , Bishwamittra Ghosh , Krishna P. Gummadi , Evimaria Terzi

We are interested in understanding how well Transformer language models (TLMs) can perform reasoning tasks when trained on knowledge encoded in the form of natural language. We investigate their systematic generalization abilities on a…

Machine Learning · Computer Science 2020-10-22 Nicolas Gontier , Koustuv Sinha , Siva Reddy , Christopher Pal

Memorization is a fundamental ability of Transformer-based Large Language Models, achieved through learning. In this paper, we propose a paradigm shift by designing an architecture to memorize text directly, bearing in mind the principle…

Understanding how Transformer-based Language Models (LMs) learn and recall information is a key goal of the deep learning community. Recent interpretability methods project weights and hidden states obtained from the forward pass to the…

Computation and Language · Computer Science 2024-02-21 Shahar Katz , Yonatan Belinkov , Mor Geva , Lior Wolf

Language Models (LMs) are prone to memorizing parts of their data during training and unintentionally emitting them at generation time, raising concerns about privacy leakage and disclosure of intellectual property. While previous research…

Computation and Language · Computer Science 2025-06-12 Stefan Arnold

We investigate how Large Language Models (LLMs) distinguish between memorization and generalization at the neuron level. Through carefully designed tasks, we identify distinct neuron subsets responsible for each behavior. Experiments on…

Computation and Language · Computer Science 2025-07-10 Ko-Wei Huang , Yi-Fu Fu , Ching-Yu Tsai , Yu-Chieh Tu , Tzu-Ling Cheng , Cheng-Yu Lin , Yi-Ting Yang , Heng-Yi Liu , Keng-Te Liao , Da-Cheng Juan , Shou-De Lin

How can pretrained language models (PLMs) learn factual knowledge from the training set? We investigate the two most important mechanisms: reasoning and memorization. Prior work has attempted to quantify the number of facts PLMs learn, but…

Computation and Language · Computer Science 2020-10-13 Nora Kassner , Benno Krojer , Hinrich Schütze

The impressive capabilities of large language models (LLMs) have sparked debate over whether these models genuinely generalize to unseen tasks or predominantly rely on memorizing vast amounts of pretraining data. To explore this issue, we…

Computation and Language · Computer Science 2025-03-04 Xinyi Wang , Antonis Antoniades , Yanai Elazar , Alfonso Amayuelas , Alon Albalak , Kexun Zhang , William Yang Wang

Large Language Models (LLMs) are prevalent in modern applications but often memorize training data, leading to privacy breaches and copyright issues. Existing research has mainly focused on posthoc analyses, such as extracting memorized…

Machine Learning · Computer Science 2025-01-10 Tarun Ram Menta , Susmit Agrawal , Chirag Agarwal

Large Language Models (LLMs) have demonstrated remarkable performance across diverse natural language processing tasks, yet their ability to memorize structured knowledge remains underexplored. In this paper, we investigate the extent to…

Computation and Language · Computer Science 2025-04-02 Marco Bombieri , Paolo Fiorini , Simone Paolo Ponzetto , Marco Rospocher

Large language models (LLMs) are known to memorize and recall English text from their pretraining data. However, the extent to which this ability generalizes to non-English languages or transfers across languages remains unclear. This paper…

Computation and Language · Computer Science 2025-10-08 Alisha Srivastava , Emir Korukluoglu , Minh Nhat Le , Duyen Tran , Chau Minh Pham , Marzena Karpinska , Mohit Iyyer

Large Language Models (LLMs) have the capacity to store and recall facts. Through experimentation with open-source models, we observe that this ability to retrieve facts can be easily manipulated by changing contexts, even without altering…

Computation and Language · Computer Science 2024-12-02 Yibo Jiang , Goutham Rajendran , Pradeep Ravikumar , Bryon Aragam

In-context learning is governed by both temporal and semantic relationships, shaping how Large Language Models (LLMs) retrieve contextual information. Analogous to human episodic memory, where the retrieval of specific events is enabled by…

Computation and Language · Computer Science 2025-10-28 Anooshka Bajaj , Deven Mahesh Mistry , Sahaj Singh Maini , Yash Aggarwal , Zoran Tiganj