English
Related papers

Related papers: Memorisation versus Generalisation in Pre-trained …

200 papers

Over-parameterized deep neural networks trained by simple first-order methods are known to be able to fit any labeling of data. Such over-fitting ability hinders generalization when mislabeled training examples are present. On the other…

Machine Learning · Computer Science 2020-10-06 Wei Hu , Zhiyuan Li , Dingli Yu

Memory is one of the most essential cognitive functions serving as a repository of world knowledge and episodes of activities. In recent years, large-scale pre-trained language models have shown remarkable memorizing ability. On the…

Computation and Language · Computer Science 2024-03-14 Boxi Cao , Qiaoyu Tang , Hongyu Lin , Shanshan Jiang , Bin Dong , Xianpei Han , Jiawei Chen , Tianshu Wang , Le Sun

Large language models (LLMs) have shown great capabilities in various tasks but also exhibited memorization of training data, raising tremendous privacy and copyright concerns. While prior works have studied memorization during…

Artificial Intelligence · Computer Science 2024-02-26 Shenglai Zeng , Yaxin Li , Jie Ren , Yiding Liu , Han Xu , Pengfei He , Yue Xing , Shuaiqiang Wang , Jiliang Tang , Dawei Yin

Language models often pre-train on large unsupervised text corpora, then fine-tune on additional task-specific data. However, typical fine-tuning schemes do not prioritize the examples that they tune on. We show that, if you can prioritize…

Computation and Language · Computer Science 2023-05-12 Ian Osband , Seyed Mohammad Asghari , Benjamin Van Roy , Nat McAleese , John Aslanides , Geoffrey Irving

Despite their success in image generation, diffusion models can memorize training data, raising serious privacy and copyright concerns. Although prior work has sought to characterize, detect, and mitigate memorization, the fundamental…

Computer Vision and Pattern Recognition · Computer Science 2025-10-01 Juyeop Kim , Songkuk Kim , Jong-Seok Lee

The notion of neural collapse refers to several emergent phenomena that have been empirically observed across various canonical classification problems. During the terminal phase of training a deep neural network, the feature embedding of…

Machine Learning · Computer Science 2023-04-05 Duc Anh Nguyen , Ron Levie , Julian Lienen , Gitta Kutyniok , Eyke Hüllermeier

We propose a new method for estimating how much a model knows about a datapoint and use it to measure the capacity of modern language models. Prior studies of language model memorization have struggled to disentangle memorization from…

Generalization is a central problem in machine learning, especially when data is limited. Using prior information to enforce constraints is the principled way of encouraging generalization. In this work, we propose to leverage the prior…

Computation and Language · Computer Science 2021-05-12 Yang Li , Ben Athiwaratkun , Cicero Nogueira dos Santos , Bing Xiang

Deep learning with noisy labels is practically challenging, as the capacity of deep models is so high that they can totally memorize these noisy labels sooner or later during training. Nonetheless, recent studies on the memorization effects…

Machine Learning · Computer Science 2018-10-31 Bo Han , Quanming Yao , Xingrui Yu , Gang Niu , Miao Xu , Weihua Hu , Ivor Tsang , Masashi Sugiyama

How do language models learn to make predictions during pre-training? To study this, we extract learning curves from five autoregressive English language model pre-training runs, for 1M unseen tokens in context. We observe that the language…

Computation and Language · Computer Science 2024-08-01 Tyler A. Chang , Zhuowen Tu , Benjamin K. Bergen

Pre-training on large-scale datasets and then fine-tuning on downstream tasks have become a standard practice in deep learning. However, pre-training data often contain label noise that may adversely affect the generalization of the model.…

Machine Learning · Computer Science 2024-03-12 Hao Chen , Jindong Wang , Ankit Shah , Ran Tao , Hongxin Wei , Xing Xie , Masashi Sugiyama , Bhiksha Raj

Named entity recognition (NER) models generally perform poorly when large training datasets are unavailable for low-resource domains. Recently, pre-training a large-scale language model has become a promising direction for coping with the…

Computation and Language · Computer Science 2021-12-02 Zihan Liu , Feijun Jiang , Yuxiang Hu , Chen Shi , Pascale Fung

Deep neural networks (DNNs) fail to learn effectively under label noise and have been shown to memorize random labels which affect their generalization performance. We consider learning in isolation, using one-hot encoded labels as the sole…

Computer Vision and Pattern Recognition · Computer Science 2020-09-18 Fahad Sarfraz , Elahe Arani , Bahram Zonooz

Although pretrained language models (PLMs) can be prompted to perform a wide range of language tasks, it remains an open question how much this ability comes from generalizable linguistic understanding versus surface-level lexical patterns.…

Computation and Language · Computer Science 2023-05-23 Terra Blevins , Hila Gonen , Luke Zettlemoyer

Deep neural networks trained on large supervised datasets have led to impressive results in image classification and other tasks. However, well-annotated datasets can be time-consuming and expensive to collect, lending increased interest to…

Machine Learning · Computer Science 2018-02-27 David Rolnick , Andreas Veit , Serge Belongie , Nir Shavit

Large language models (LLMs) have been proven capable of memorizing their training data, which can be extracted through specifically designed prompts. As the scale of datasets continues to grow, privacy risks arising from memorization have…

Computation and Language · Computer Science 2023-11-07 Zhenhong Zhou , Jiuyang Xiang , Chaomeng Chen , Sen Su

Noise is ubiquitous in data used to train large language models, but it is not well understood whether these models are able to correctly generalize to inputs generated without noise. Here, we study noise-robust learning: are transformers…

Machine Learning · Computer Science 2026-02-10 Evan Peters , Ando Deng , Matheus H. Zambianco , Devin Blankespoor , Achim Kempf

We present a novel approach to leverage large unlabeled datasets by pre-training state-of-the-art deep neural networks on randomly-labeled datasets. Specifically, we train the neural networks to memorize arbitrary labels for all the samples…

Machine Learning · Computer Science 2018-11-06 Vinaychandran Pondenkandath , Michele Alberti , Sammer Puran , Rolf Ingold , Marcus Liwicki

Overparameterized deep networks that generalize well have been key to the dramatic success of deep learning in recent years. The reasons for their remarkable ability to generalize are not well understood yet. When class labels in the…

Machine Learning · Computer Science 2026-02-03 Simran Ketha , Venkatakrishnan Ramaswamy

Data availability and quality are major challenges in natural language processing for low-resourced languages. In particular, there is significantly less data available than for higher-resourced languages. This data is also often of low…

Computation and Language · Computer Science 2023-11-28 Manuel Fokam , Michael Beukman