English
Related papers

Related papers: Measuring memorization in language models via prob…

200 papers

There has been extensive research on assessing the value orientation of Large Language Models (LLMs) as it can shape user experiences across demographic groups. However, several challenges remain. First, while the Multiple Choice Question…

Computation and Language · Computer Science 2025-07-21 Siqi Shen , Mehar Singh , Lajanugen Logeswaran , Moontae Lee , Honglak Lee , Rada Mihalcea

This study investigates the efficacy of Large Language Models (LLMs) in causal discovery. Using newly available open-source LLMs, OLMo and BLOOM, which provide access to their pre-training corpora, we investigate how LLMs address causal…

Computation and Language · Computer Science 2025-10-13 Tao Feng , Lizhen Qu , Niket Tandon , Zhuang Li , Xiaoxi Kang , Gholamreza Haffari

As Large Language Models (LLMs) become widely adopted, understanding how they learn from, and memorize, training data becomes crucial. Memorization in LLMs is widely assumed to only occur as a result of sequences being repeated in the…

Computation and Language · Computer Science 2025-05-16 Igor Shilov , Matthieu Meeus , Yves-Alexandre de Montjoye

We introduce iterative retrieval, a novel framework that empowers retrievers to make iterative decisions through policy optimization. Finding an optimal portfolio of retrieved items is a combinatorial optimization problem, generally…

Computation and Language · Computer Science 2024-06-24 Yunmo Chen , Tongfei Chen , Harsh Jhamtani , Patrick Xia , Richard Shin , Jason Eisner , Benjamin Van Durme

Within psychology, neuroscience and artificial intelligence, there has been increasing interest in the proposal that the brain builds probabilistic models of sensory and linguistic input: that is, to infer a probabilistic model from a…

Machine Learning · Computer Science 2017-08-08 Paul M. B. Vitanyi , Nick Chater

Compressing Large Language Models (LLMs) often leads to reduced performance, especially for knowledge-intensive tasks. In this work, we dive into how compression damages LLMs' inherent knowledge and the possible remedies. We start by…

Computation and Language · Computer Science 2024-02-19 Duc N. M Hoang , Minsik Cho , Thomas Merth , Mohammad Rastegari , Zhangyang Wang

While Code Language Models (CLMs) have demonstrated superior performance in software engineering tasks such as code generation and summarization, recent empirical studies reveal a critical privacy vulnerability: these models exhibit…

Software Engineering · Computer Science 2025-09-18 Zhaoyang Chu , Yao Wan , Zhikun Zhang , Di Wang , Zhou Yang , Hongyu Zhang , Pan Zhou , Xuanhua Shi , Hai Jin , David Lo

Protein sequence design, determined by amino acid sequences, are essential to protein engineering problems in drug discovery. Prior approaches have resorted to evolutionary strategies or Monte-Carlo methods for protein design, but often…

As Large Language Models (LLMs) become increasingly widespread, understanding how specific training data shapes their outputs is crucial for transparency, accountability, privacy, and fairness. To explore how LLMs leverage and replicate…

Computation and Language · Computer Science 2025-07-03 Arthur Wuhrmann , Anastasiia Kucherenko , Andrei Kucharavy

Large language models are shown to present privacy risks through memorization of training data, and several recent works have studied such risks for the pre-training phase. Little attention, however, has been given to the fine-tuning phase…

Computation and Language · Computer Science 2022-11-07 Fatemehsadat Mireshghallah , Archit Uniyal , Tianhao Wang , David Evans , Taylor Berg-Kirkpatrick

Large language models (LLMs) have recently demonstrated exceptional code generation capabilities. However, there is a growing debate whether LLMs are mostly doing memorization (i.e., replicating or reusing large parts of their training…

Artificial Intelligence · Computer Science 2025-10-01 Lizhe Zhang , Wentao Chen , Li Zhong , Letian Peng , Zilong Wang , Jingbo Shang

Large language models (LLMs) like ChatGPT and GPT-4 have attracted great attention given their surprising performance on a wide range of NLP tasks. Length controlled generation of LLMs emerges as an important topic, which enables users to…

Computation and Language · Computer Science 2023-10-03 Renlong Jie , Xiaojun Meng , Lifeng Shang , Xin Jiang , Qun Liu

State-of-the-art supervised NLP models achieve high accuracy but are also susceptible to failures on inputs from low-data regimes, such as domains that are not represented in training data. As an approximation to collecting ground-truth…

Computation and Language · Computer Science 2023-06-29 Parikshit Bansal , Amit Sharma

Acquiring factual knowledge with Pretrained Language Models (PLMs) has attracted increasing attention, showing promising performance in many knowledge-intensive tasks. Their good performance has led the community to believe that the models…

Computation and Language · Computer Science 2023-02-14 Zhangdie Yuan , Songbo Hu , Ivan Vulić , Anna Korhonen , Zaiqiao Meng

Large Language Models (LLMs) have shown greatly enhanced performance in recent years, attributed to increased size and extensive training data. This advancement has led to widespread interest and adoption across industries and the public.…

Computation and Language · Computer Science 2024-06-19 Victoria Smith , Ali Shahin Shamsabadi , Carolyn Ashurst , Adrian Weller

As diffusion probabilistic models (DPMs) are being employed as mainstream models for generative artificial intelligence (AI), the study of their memorization of the raw training data has attracted growing attention. Existing works in this…

Cryptography and Security · Computer Science 2024-10-15 Yunhao Chen , Xingjun Ma , Difan Zou , Yu-Gang Jiang

The widespread usage of latent language representations via pre-trained language models (LMs) suggests that they are a promising source of structured knowledge. However, existing methods focus only on a single object per subject-relation…

Computation and Language · Computer Science 2023-07-10 Sneha Singhania , Simon Razniewski , Gerhard Weikum

Interpretable and explainable machine learning has seen a recent surge of interest. We focus on safety as a key motivation behind the surge and make the relationship between interpretability and safety more quantitative. Toward assessing…

Machine Learning · Computer Science 2022-11-04 Dennis Wei , Rahul Nair , Amit Dhurandhar , Kush R. Varshney , Elizabeth M. Daly , Moninder Singh

Large language models (LLMs) have displayed an impressive ability to harness natural language to perform complex tasks. In this work, we explore whether we can leverage this learned ability to find and explain patterns in data.…

Machine Learning · Computer Science 2023-01-30 Chandan Singh , John X. Morris , Jyoti Aneja , Alexander M. Rush , Jianfeng Gao

With an increasing number of parameters and pre-training data, generative large language models (LLMs) have shown remarkable capabilities to solve tasks with minimal or no task-related examples. Notably, LLMs have been successfully employed…

Computation and Language · Computer Science 2023-10-31 Christoph Leiter , Juri Opitz , Daniel Deutsch , Yang Gao , Rotem Dror , Steffen Eger