English
Related papers

Related papers: Data Compressibility Quantifies LLM Memorization

200 papers

Entity matching is the task of linking records from different sources that refer to the same real-world entity. Past work has primarily treated entity linking as a standard supervised learning problem. However, supervised entity matching…

Computation and Language · Computer Science 2024-10-01 Somin Wadhwa , Adit Krishnan , Runhui Wang , Byron C. Wallace , Chris Kong

The inference of Large language models (LLMs) requires immense computation and memory resources. To curtail these costs, quantisation has merged as a promising solution, but existing LLM quantisation mainly focuses on 8-bit. In this work,…

Machine Learning · Computer Science 2024-03-15 Cheng Zhang , Jianyi Cheng , Ilia Shumailov , George A. Constantinides , Yiren Zhao

With the advent of large language models (LLMs), the trend in NLP has been to train LLMs on vast amounts of data to solve diverse language understanding and generation tasks. The list of LLM successes is long and varied. Nevertheless,…

Computation and Language · Computer Science 2023-06-22 Nicholas Asher , Swarnadeep Bhar , Akshay Chaturvedi , Julie Hunter , Soumya Paul

Understanding what kinds of factual knowledge large language models (LLMs) memorize is essential for evaluating their reliability and limitations. Entity-based QA is a common framework for analyzing non-verbatim memorization, but typical…

Computation and Language · Computer Science 2026-04-24 Yuto Nishida , Naoki Shikoda , Yosuke Kishinami , Ryo Fujii , Makoto Morishita , Hidetaka Kamigaito , Taro Watanabe

Objective and scalable measurement of teaching quality is a persistent challenge in education. While Large Language Models (LLMs) offer potential, general-purpose models have struggled to reliably apply complex, authentic classroom…

Computation and Language · Computer Science 2025-11-07 Michael Hardy

Entropy minimization (EM) trains the model to concentrate even more probability mass on its most confident outputs. We show that this simple objective alone, without any labeled data, can substantially improve large language models' (LLMs)…

Machine Learning · Computer Science 2025-05-22 Shivam Agarwal , Zimin Zhang , Lifan Yuan , Jiawei Han , Hao Peng

Large Language Models (LLMs) have emerged as a milestone in artificial intelligence, and their performance can improve as the model size increases. However, this scaling brings great challenges to training and inference efficiency,…

Artificial Intelligence · Computer Science 2024-12-09 Chaojun Xiao , Jie Cai , Weilin Zhao , Guoyang Zeng , Biyuan Lin , Jie Zhou , Zhi Zheng , Xu Han , Zhiyuan Liu , Maosong Sun

The training of large language models (LLMs) is expensive. In this paper, we study data-efficient approaches for pre-training LLMs, i.e., techniques that aim to optimize the Pareto frontier of model quality and training resource/data…

Accurately quantifying uncertainty in large language models (LLMs) is crucial for their reliable deployment, especially in high-stakes applications. Current state-of-the-art methods for measuring semantic uncertainty in LLMs rely on strict…

Machine Learning · Computer Science 2024-10-31 Yashvir S. Grewal , Edwin V. Bonilla , Thang D. Bui

Working memory, or the ability to hold and manipulate information in the mind, is a critical component of human intelligence and executive functioning. It is correlated with performance on various cognitive tasks, including measures of…

Computation and Language · Computer Science 2025-12-01 Karin de Langis , Jong Inn Park , Bin Hu , Khanh Chi Le , Andreas Schramm , Michael C. Mensink , Andrew Elfenbein , Dongyeop Kang

State-of-the-art pre-trained language models have been shown to memorise facts and perform well with limited amounts of training data. To gain a better understanding of how these models learn, we study their generalisation and memorisation…

Computation and Language · Computer Science 2022-03-16 Michael Tänzer , Sebastian Ruder , Marek Rei

Systematic generalization remains challenging for current language models, which are known to be both sensitive to semantically similar permutations of the input and to struggle with known concepts presented in novel contexts. Although…

Computation and Language · Computer Science 2025-05-28 Sondre Wold , Lucas Georges Gabriel Charpentier , Étienne Simon

Deep learning has significantly advanced molecular modeling and design, enabling efficient understanding and discovery of novel molecules. In particular, large language models (LLMs) introduce a fresh research paradigm to tackle scientific…

Machine Learning · Computer Science 2025-01-06 Pengfei Liu , Jun Tao , Zhixiang Ren

Large Language Models (LLMs) achieve strong performance across tasks, but face storage and compute challenges on edge devices. We propose EntroLLM, a compression framework combining mixed quantization and entropy coding to reduce storage…

Machine Learning · Computer Science 2026-05-05 Arnab Sanyal , Gourav Datta , Prithwish Mukherjee , Sandeep P. Chinchali , Michael Orshansky

Continual learning (CL) in large language models (LLMs) is an evolving domain that focuses on developing efficient and sustainable training strategies to adapt models to emerging knowledge and achieve robustness in dynamic environments. Our…

Computation and Language · Computer Science 2025-02-13 Çağatay Yıldız , Nishaanth Kanna Ravichandran , Nitin Sharma , Matthias Bethge , Beyza Ermis

Large Language Models (LLMs) are becoming increasingly popular in pervasive computing due to their versatility and strong performance. However, despite their ubiquitous use, the exact mechanisms underlying their outstanding performance…

Computation and Language · Computer Science 2026-02-02 Alhassan Abdelhalim , Janick Edinger , Sören Laue , Michaela Regneri

In the current landscape of large language models (LLMs), the process of instruction tuning serves as an essential step. Considering the high computing power overhead, data-efficient instruction tuning was proposed to reduce the training…

Computation and Language · Computer Science 2025-01-06 Qi Zhang , Yiming Zhang , Haobo Wang , Junbo Zhao

The capabilities of large language models (LLMs) have expanded beyond natural language processing to scientific prediction tasks, including molecular property prediction. However, their effectiveness in in-context learning remains…

Existing memory systems enable Large Language Models (LLMs) to support long-horizon human-LLM interactions by persisting historical interactions beyond limited context windows. However, while recent approaches have succeeded in constructing…

Computation and Language · Computer Science 2026-04-21 Haidong Xin , Xinze Li , Zhenghao Liu , Yukun Yan , Shuo Wang , Cheng Yang , Yu Gu , Ge Yu , Maosong Sun

Large Language Models (LLMs) represent a promising frontier for recommender systems, yet their development has been impeded by the absence of predictable scaling laws, which are crucial for guiding research and optimizing resource…

Information Retrieval · Computer Science 2026-02-16 Benyu Zhang , Qiang Zhang , Jianpeng Cheng , Hong-You Chen , Qifei Wang , Wei Sun , Shen Li , Jia Li , Jiahao Wu , Xiangjun Fan , Hong Yan