English
Related papers

Related papers: Understanding Transformer Memorization Recall Thro…

200 papers

Large Transformer models have achieved impressive performance in many natural language tasks. In particular, Transformer based language models have been shown to have great capabilities in encoding factual knowledge in their vast amount of…

Computation and Language · Computer Science 2020-12-02 Chen Zhu , Ankit Singh Rawat , Manzil Zaheer , Srinadh Bhojanapalli , Daliang Li , Felix Yu , Sanjiv Kumar

The relationship between memorization and generalization in large language models (LLMs) remains an open area of research, with growing evidence that the two are deeply intertwined. In this work, we investigate this relationship by…

Machine Learning · Computer Science 2025-06-19 Joshua Barron , Devin White

While recent research increasingly showcases the remarkable capabilities of Large Language Models (LLMs), it is equally crucial to examine their associated risks. Among these, privacy and security vulnerabilities are particularly…

Computation and Language · Computer Science 2026-01-21 Ali Satvaty , Suzan Verberne , Fatih Turkmen

Transformer-based language models excel at both recall (retrieving memorized facts) and reasoning (performing multi-step inference), but whether these abilities rely on distinct internal mechanisms remains unclear. Distinguishing recall…

Machine Learning · Computer Science 2026-03-16 Harshwardhan Fartale , Ashish Kattamuri , Rahul Raja , Arpita Vats , Ishita Prasad , Akshata Kishore Moharir

Pre-trained language models demonstrate general intelligence and common sense, but long inputs quickly become a bottleneck for memorizing information at inference time. We resurface a simple method, Memorizing Transformers (Wu et al.,…

Machine Learning · Computer Science 2024-06-05 Phoebe Klett , Thomas Ahle

The statistical study of human memory requires large-scale experiments, involving many stimuli conditions and test subjects. While this approach has proven to be quite fruitful for meaningless material such as random lists of words,…

Computation and Language · Computer Science 2024-11-26 Antonios Georgiou , Tankut Can , Mikhail Katkov , Misha Tsodyks

Language models typically need to be trained or finetuned in order to acquire new knowledge, which involves updating their weights. We instead envision language models that can simply read and memorize new data at inference time, thus…

Machine Learning · Computer Science 2022-03-18 Yuhuai Wu , Markus N. Rabe , DeLesley Hutchins , Christian Szegedy

Much of the knowledge encoded in transformer language models (LMs) may be expressed in terms of relations: relations between words and their synonyms, entities and their attributes, etc. We show that, for a subset of relations, this…

Computation and Language · Computer Science 2024-02-19 Evan Hernandez , Arnab Sen Sharma , Tal Haklay , Kevin Meng , Martin Wattenberg , Jacob Andreas , Yonatan Belinkov , David Bau

Large language models (LLMs) have shown impressive capabilities across a wide range of language tasks. However, their reasoning process is primarily guided by statistical patterns in training data, which limits their ability to handle novel…

Artificial Intelligence · Computer Science 2025-08-21 Hong Su

Existing Large Language Models (LLMs) usually remain static after deployment, which might make it hard to inject new knowledge into the model. We aim to build models containing a considerable portion of self-updatable parameters, enabling…

Computation and Language · Computer Science 2024-05-28 Yu Wang , Yifan Gao , Xiusi Chen , Haoming Jiang , Shiyang Li , Jingfeng Yang , Qingyu Yin , Zheng Li , Xian Li , Bing Yin , Jingbo Shang , Julian McAuley

Transformers are neural networks that revolutionized natural language processing and machine learning. They process sequences of inputs, like words, using a mechanism called self-attention, which is trained via masked language modeling…

Disordered Systems and Neural Networks · Physics 2024-04-17 Riccardo Rende , Federica Gerace , Alessandro Laio , Sebastian Goldt

Understanding memorisation in language models has practical and societal implications, e.g., studying models' training dynamics or preventing copyright infringements. Prior work defines memorisation as the causal effect of training with an…

Machine Learning · Computer Science 2024-10-17 Pietro Lesci , Clara Meister , Thomas Hofmann , Andreas Vlachos , Tiago Pimentel

When we read, we make predictions about upcoming words; these predictions influence our reading behavior. The success of large language models (LLMs), which, like humans, make predictions about upcoming words, has motivated their use as…

Computation and Language · Computer Science 2026-05-27 Byung-Doh Oh , Tal Linzen

How do language models (LMs) represent characters' beliefs, especially when those beliefs may differ from reality? This question lies at the heart of understanding the Theory of Mind (ToM) capabilities of LMs. We analyze LMs' ability to…

Computation and Language · Computer Science 2026-02-25 Nikhil Prakash , Natalie Shapira , Arnab Sen Sharma , Christoph Riedl , Yonatan Belinkov , Tamar Rott Shaham , David Bau , Atticus Geiger

Language models (LMs) are trained on collections of documents, written by individual human agents to achieve specific goals in an outside world. During training, LMs have access only to text of these documents, with no direct evidence of…

Computation and Language · Computer Science 2022-12-06 Jacob Andreas

In this paper, we study an under-explored area of language and vocabulary learning: keyword mnemonics, a technique for memorizing vocabulary through memorable associations with a target word via a verbal cue. Typically, creating verbal cues…

Computation and Language · Computer Science 2024-09-24 Jaewook Lee , Hunter McNichols , Andrew Lan

Memory emerges as the core module in the large language model (LLM)-based agents for long-horizon complex tasks (e.g., multi-turn dialogue, game playing, scientific discovery), where memory can enable knowledge accumulation, iterative…

Computation and Language · Computer Science 2026-05-04 Yanchen Wu , Tenghui Lin , Yingli Zhou , Fangyuan Zhang , Qintian Guo , Xun Zhou , Sibo Wang , Xilin Liu , Yuchi Ma , Yixiang Fang

Large Language Models (LLMs) have become increasingly central to recommendation scenarios due to their remarkable natural language understanding and generation capabilities. Although significant research has explored the use of LLMs for…

Information Retrieval · Computer Science 2025-05-16 Dario Di Palma , Felice Antonio Merra , Maurizio Sfilio , Vito Walter Anelli , Fedelucio Narducci , Tommaso Di Noia

Language Models (LMs) have demonstrated impressive capabilities in solving complex reasoning tasks, particularly when prompted to generate intermediate explanations. However, it remains an open question whether these intermediate reasoning…

Computation and Language · Computer Science 2025-02-25 Moritz Miller , Kumar Shridhar

Despite the remarkable capabilities of modern large language models (LLMs), the mechanisms behind their problem-solving abilities remain elusive. In this work, we aim to better understand how the learning dynamics of LLM finetuning shapes…

Machine Learning · Computer Science 2024-11-19 Katie Kang , Amrith Setlur , Dibya Ghosh , Jacob Steinhardt , Claire Tomlin , Sergey Levine , Aviral Kumar