English
Related papers

Related papers: Measuring Memorization Effect in Word-Level Neural…

200 papers

Recent efforts at explaining the interplay of memorization and generalization in deep overparametrized networks have posited that neural networks $\textit{memorize}$ "hard" examples in the final few layers of the model. Memorization refers…

Machine Learning · Computer Science 2023-07-20 Pratyush Maini , Michael C. Mozer , Hanie Sedghi , Zachary C. Lipton , J. Zico Kolter , Chiyuan Zhang

Concept probing has recently garnered increasing interest as a way to help interpret artificial neural networks, dealing both with their typically large size and their subsymbolic nature, which ultimately renders them unfeasible for direct…

Artificial Intelligence · Computer Science 2025-07-25 Manuel de Sousa Ribeiro , Afonso Leote , João Leite

Probing classifiers have emerged as one of the prominent methodologies for interpreting and analyzing deep neural network models of natural language processing. The basic idea is simple -- a classifier is trained to predict some linguistic…

Computation and Language · Computer Science 2021-09-23 Yonatan Belinkov

Over-parameterized deep neural networks are able to achieve excellent training accuracy while maintaining a small generalization error. It has also been found that they are able to fit arbitrary labels, and this behaviour is referred to as…

Machine Learning · Computer Science 2021-12-17 Futong Liu , Tao Lin , Martin Jaggi

Neural language models learn word representations, or embeddings, that capture rich linguistic and conceptual information. Here we investigate the embeddings learned by neural machine translation models, a recently-developed class of neural…

Computation and Language · Computer Science 2015-04-06 Felix Hill , Kyunghyun Cho , Sebastien Jean , Coline Devin , Yoshua Bengio

Machine learning systems such as large scale recommendation systems or natural language processing systems are usually trained on billions of training points and are associated with hundreds of billions or trillions of parameters. Improving…

Machine Learning · Computer Science 2023-05-26 Michael Kounavis , Ousmane Dia , Ilqar Ramazanli

Memorization in language models is widely studied but remains difficult to isolate and control. Understanding when and what models memorize is essential for explaining their predictions, yet existing approaches are post-hoc: they can detect…

Computation and Language · Computer Science 2026-04-08 Xiangbo Zhang , Ali Emami

Understanding human language has been a sub-challenge on the way of intelligent machines. The study of meaning in natural language processing (NLP) relies on the distributional hypothesis where language elements get meaning from the words…

Computation and Language · Computer Science 2021-10-06 Erhan Sezerer , Selma Tekir

Much of the progress in contemporary NLP has come from learning representations, such as masked language model (MLM) contextual embeddings, that turn challenging problems into simple classification tasks. But how do we quantify and explain…

Computation and Language · Computer Science 2021-09-16 Gregory Yauney , David Mimno

The impressive capabilities of large language models (LLMs) have sparked debate over whether these models genuinely generalize to unseen tasks or predominantly rely on memorizing vast amounts of pretraining data. To explore this issue, we…

Computation and Language · Computer Science 2025-03-04 Xinyi Wang , Antonis Antoniades , Yanai Elazar , Alfonso Amayuelas , Alon Albalak , Kexun Zhang , William Yang Wang

Training data leakage from Large Language Models (LLMs) raises serious concerns related to privacy, security, and copyright compliance. A central challenge in assessing this risk is distinguishing genuine memorization of training data from…

Machine Learning · Computer Science 2026-02-24 Trishita Tiwari , Ari Trachtenberg , G. Edward Suh

Despite the success of language models using neural networks, it remains unclear to what extent neural models have the generalization ability to perform inferences. In this paper, we introduce a method for evaluating whether neural models…

Computation and Language · Computer Science 2020-05-05 Hitomi Yanaka , Koji Mineshima , Daisuke Bekki , Kentaro Inui

To understand how well a large language model captures certain semantic or syntactic features, researchers typically apply probing classifiers. However, the accuracy of these classifiers is critical for the correct interpretation of the…

Computation and Language · Computer Science 2023-12-19 Sergey A. Saltykov

Measuring what linguistic information is encoded in neural models of language has become popular in NLP. Researchers approach this enterprise by training "probes" - supervised models designed to extract linguistic structure from another…

Computation and Language · Computer Science 2020-05-13 Rowan Hall Maudslay , Josef Valvoda , Tiago Pimentel , Adina Williams , Ryan Cotterell

Pretrained language models have achieved a new state of the art on many NLP tasks, but there are still many open questions about how and why they work so well. We investigate the contextualization of words in BERT. We quantify the amount of…

Computation and Language · Computer Science 2020-10-13 Mengjie Zhao , Philipp Dufter , Yadollah Yaghoobzadeh , Hinrich Schütze

In the presence of noisy or incorrect labels, neural networks have the undesirable tendency to memorize information about the noise. Standard regularization techniques such as dropout, weight decay or data augmentation sometimes help, but…

Machine Learning · Computer Science 2020-11-23 Hrayr Harutyunyan , Kyle Reing , Greg Ver Steeg , Aram Galstyan

Large language models have gained significant popularity because of their ability to generate human-like text and potential applications in various fields, such as Software Engineering. Large language models for code are commonly trained on…

Cryptography and Security · Computer Science 2024-01-17 Ali Al-Kaswan , Maliheh Izadi , Arie van Deursen

Understanding memorisation in language models has practical and societal implications, e.g., studying models' training dynamics or preventing copyright infringements. Prior work defines memorisation as the causal effect of training with an…

Machine Learning · Computer Science 2024-10-17 Pietro Lesci , Clara Meister , Thomas Hofmann , Andreas Vlachos , Tiago Pimentel

Prediction in language has traditionally been studied using simple designs in which neural responses to expected and unexpected words are compared in a categorical fashion. However, these designs have been contested as being `prediction…

Neurons and Cognition · Quantitative Biology 2019-09-11 Micha Heilbron , Benedikt Ehinger , Peter Hagoort , Floris P. de Lange

Concerned with privacy threats, memorization in LLMs is often seen as undesirable, specifically for learning. In this paper, we study whether memorization can be avoided when optimally learning a language, and whether the privacy threat…

Machine Learning · Computer Science 2025-07-22 Bishwamittra Ghosh , Soumi Das , Qinyuan Wu , Mohammad Aflah Khan , Krishna P. Gummadi , Evimaria Terzi , Deepak Garg