English
Related papers

Related papers: How much do language models memorize?

200 papers

Large language models (LLMs) require immense resources for training and inference. Quantization, a technique that reduces the precision of model parameters, offers a promising solution for improving LLM efficiency and sustainability. While…

Machine Learning · Computer Science 2025-02-18 Jacob Nielsen , Peter Schneider-Kamp , Lukas Galke

In recent years, researchers tend to pre-train ever-larger language models to explore the upper limit of deep models. However, large language model pre-training costs intensive computational resources and most of the models are trained from…

Computation and Language · Computer Science 2021-10-15 Cheng Chen , Yichun Yin , Lifeng Shang , Xin Jiang , Yujia Qin , Fengyu Wang , Zhi Wang , Xiao Chen , Zhiyuan Liu , Qun Liu

This paper studies how the model architecture and data configurations influence the empirical memorization capacity of generative transformers. The models are trained using synthetic text datasets derived from the Systematized Nomenclature…

Computation and Language · Computer Science 2025-06-18 Anton Changalidis , Aki Härmä

When language models (LMs) are trained to forget (or "unlearn'') a skill, how precisely does their behavior change? We study the behavior of transformer LMs in which tasks have been forgotten via fine-tuning on randomized labels. Such LMs…

Machine Learning · Computer Science 2024-09-05 Eric Zhang , Leshem Chosen , Jacob Andreas

Nowadays, pretrained language models (PLMs) have dominated the majority of NLP tasks. While, little research has been conducted on systematically evaluating the language abilities of PLMs. In this paper, we present a large-scale empirical…

Computation and Language · Computer Science 2022-05-04 Junyi Li , Tianyi Tang , Zheng Gong , Lixin Yang , Zhuohao Yu , Zhipeng Chen , Jingyuan Wang , Wayne Xin Zhao , Ji-Rong Wen

While recent research increasingly showcases the remarkable capabilities of Large Language Models (LLMs), it is equally crucial to examine their associated risks. Among these, privacy and security vulnerabilities are particularly…

Computation and Language · Computer Science 2026-01-21 Ali Satvaty , Suzan Verberne , Fatih Turkmen

Memorization is a fundamental ability of Transformer-based Large Language Models, achieved through learning. In this paper, we propose a paradigm shift by designing an architecture to memorize text directly, bearing in mind the principle…

Large Language Models offer impressive language capabilities but suffer from well-known limitations, including hallucinations, biases, privacy concerns, and high computational costs. These issues are largely driven by the combination of…

Computation and Language · Computer Science 2025-09-03 Jaime Collado-Montañez , L. Alfonso Ureña-López , Arturo Montejo-Ráez

Understanding memorisation in language models has practical and societal implications, e.g., studying models' training dynamics or preventing copyright infringements. Prior work defines memorisation as the causal effect of training with an…

Machine Learning · Computer Science 2024-10-17 Pietro Lesci , Clara Meister , Thomas Hofmann , Andreas Vlachos , Tiago Pimentel

In this paper, we explore the capacity of a language model-based method for grammatical error detection in detail. We first show that 5 to 10% of training data are enough for a BERT-based error detection method to achieve performance…

Computation and Language · Computer Science 2021-08-30 Ryo Nagata , Manabu Kimura , Kazuaki Hanawa

Large language models (LLMs) can struggle to memorize factual knowledge in their parameters, often leading to hallucinations and poor performance on knowledge-intensive tasks. In this paper, we formalize fact memorization from an…

Computation and Language · Computer Science 2026-04-10 Jiayuan Ye , Vitaly Feldman , Kunal Talwar

The surprising ability of Large Language Models (LLMs) to perform well on complex reasoning with only few-shot chain-of-thought prompts is believed to emerge only in very large-scale models (100+ billion parameters). We show that such…

Computation and Language · Computer Science 2023-01-31 Yao Fu , Hao Peng , Litu Ou , Ashish Sabharwal , Tushar Khot

The training and inference of large language models (LLMs) are together a costly process that transports knowledge from raw data to meaningful computation. Inspired by the memory hierarchy of the human brain, we reduce this cost by…

Computation and Language · Computer Science 2025-01-29 Hongkang Yang , Zehao Lin , Wenjin Wang , Hao Wu , Zhiyu Li , Bo Tang , Wenqiang Wei , Jinbo Wang , Zeyun Tang , Shichao Song , Chenyang Xi , Yu Yu , Kai Chen , Feiyu Xiong , Linpeng Tang , Weinan E

Large language models (LLMs) are susceptible to memorizing training data, raising concerns about the potential extraction of sensitive information at generation time. Discoverable extraction is the most common method for measuring this…

Memory is one of the most essential cognitive functions serving as a repository of world knowledge and episodes of activities. In recent years, large-scale pre-trained language models have shown remarkable memorizing ability. On the…

Computation and Language · Computer Science 2024-03-14 Boxi Cao , Qiaoyu Tang , Hongyu Lin , Shanshan Jiang , Bin Dong , Xianpei Han , Jiawei Chen , Tianshu Wang , Le Sun

Quantization lowers memory usage, computational requirements, and latency by utilizing fewer bits to represent model weights and activations. In this work, we investigate the generalization properties of quantized neural networks, a…

A better understanding of the emergent computation and problem-solving capabilities of recent large language models is of paramount importance to further improve them and broaden their applicability. This work investigates how a language…

Artificial Intelligence · Computer Science 2024-08-05 Davide Maltoni , Matteo Ferrara

In this paper, we investigate knowledge forgetting in large language models with a focus on its generalisation, ensuring that models forget not only specific training samples but also related implicit knowledge. To this end, we begin by…

Computation and Language · Computer Science 2025-10-10 Huazheng Wang , Yongcheng Jing , Haifeng Sun , Yingjie Wang , Jingyu Wang , Jianxin Liao , Dacheng Tao

Quantifying the impact of individual data samples on machine learning models is an open research problem. This is particularly relevant when complex and high-dimensional relationships have to be learned from a limited sample of the data…

Machine Learning · Computer Science 2023-11-07 Dmitrii Usynin , Moritz Knolle , Georgios Kaissis

A model's capacity to generalize its knowledge to interpret unseen inputs with different characteristics is crucial to build robust and reliable machine learning systems. Language model evaluation tasks lack information metrics about model…

Computation and Language · Computer Science 2024-09-10 Saksham Bassi , Duygu Ataman , Kyunghyun Cho