English
Related papers

Related papers: Predicting memorization within Large Language Mode…

200 papers

Large Language Models are expressive tools that enable complex tasks of text understanding within Computational Social Science. Their versatility, while beneficial, poses a barrier for establishing standardized best practices within the…

Computers and Society · Computer Science 2024-08-05 Anders Giovanni Møller , Luca Maria Aiello

Modern machine learning models are complex and frequently encode surprising amounts of information about individual inputs. In extreme cases, complex models appear to memorize entire input examples, including seemingly irrelevant…

Machine Learning · Computer Science 2021-07-23 Gavin Brown , Mark Bun , Vitaly Feldman , Adam Smith , Kunal Talwar

Fine-tuning large language models (LLMs) is intended to improve their reasoning capabilities, yet we uncover a counterintuitive effect: models often forget how to solve problems they previously answered correctly during training. We term…

Artificial Intelligence · Computer Science 2025-05-27 Yuetai Li , Zhangchen Xu , Fengqing Jiang , Bhaskar Ramasubramanian , Luyao Niu , Bill Yuchen Lin , Xiang Yue , Radha Poovendran

Modern large-scale Pre-trained Language Models (PLMs) have achieved tremendous success on a wide range of downstream tasks. However, most of the LM pre-training objectives only focus on text reconstruction, but have not sought to learn…

Computation and Language · Computer Science 2022-10-28 Liliang Ren , Zixuan Zhang , Han Wang , Clare R. Voss , Chengxiang Zhai , Heng Ji

Large language models (LLMs) are becoming a popular tool as they have significantly advanced in their capability to tackle a wide range of language-based tasks. However, LLMs applications are highly vulnerable to prompt injection attacks,…

Computation and Language · Computer Science 2024-11-11 Md Abdur Rahman , Fan Wu , Alfredo Cuzzocrea , Sheikh Iqbal Ahamed

The growing use of large language models in sensitive domains has exposed a critical weakness: the inability to ensure that private information can be permanently forgotten. Yet these systems still lack reliable mechanisms to guarantee that…

Machine Learning · Computer Science 2025-11-14 James Jin Kang , Dang Bui , Thanh Pham , Huo-Chong Ling

Frontier AI systems are making transformative impacts across society, but such benefits are not without costs: models trained on web-scale datasets containing personal and private data raise profound concerns about data privacy and…

Computer Vision and Pattern Recognition · Computer Science 2024-07-26 Sunny Duan , Mikail Khona , Abhiram Iyer , Rylan Schaeffer , Ila R Fiete

Since individuals may struggle to recall all life details and often confuse events, establishing a system to assist users in recalling forgotten experiences is essential. While numerous studies have proposed memory recall systems, these…

Computation and Language · Computer Science 2026-02-26 Chia Cheng Chang , An-Zi Yen , Hen-Hsen Huang , Hsin-Hsi Chen

Memory is one of the most essential cognitive functions serving as a repository of world knowledge and episodes of activities. In recent years, large-scale pre-trained language models have shown remarkable memorizing ability. On the…

Computation and Language · Computer Science 2024-03-14 Boxi Cao , Qiaoyu Tang , Hongyu Lin , Shanshan Jiang , Bin Dong , Xianpei Han , Jiawei Chen , Tianshu Wang , Le Sun

Large language models (LLMs) cannot be trusted for economic forecasts during periods covered by their training data. Counterfactual forecasting ability is non-identified when the model has seen the realized values: any observed output is…

General Finance · Quantitative Finance 2025-12-16 Alejandro Lopez-Lira , Yuehua Tang , Mingyin Zhu

In recent years, large pre-trained language models (LLMs) have demonstrated the ability to follow instructions and perform novel tasks from a few examples. The possibility to parameterise an LLM through such in-context examples widens their…

Machine Learning · Computer Science 2023-05-10 Imanol Schlag , Sainbayar Sukhbaatar , Asli Celikyilmaz , Wen-tau Yih , Jason Weston , Jürgen Schmidhuber , Xian Li

This paper explores the risk that a large language model (LLM) trained for code generation on data mined from software repositories will generate content that discloses sensitive information included in its training data. We decompose this…

Cryptography and Security · Computer Science 2026-04-16 Rafiqul Rabin , Sean McGregor , Nick Judd

This study investigates the efficacy of Large Language Models (LLMs) in causal discovery. Using newly available open-source LLMs, OLMo and BLOOM, which provide access to their pre-training corpora, we investigate how LLMs address causal…

Computation and Language · Computer Science 2025-10-13 Tao Feng , Lizhen Qu , Niket Tandon , Zhuang Li , Xiaoxi Kang , Gholamreza Haffari

The wide applicability and adaptability of generative large language models (LLMs) has enabled their rapid adoption. While the pre-trained models can perform many tasks, such models are often fine-tuned to improve their performance on…

Computation and Language · Computer Science 2023-06-16 Myles Foley , Ambrish Rawat , Taesung Lee , Yufang Hou , Gabriele Picco , Giulio Zizzo

Machine learning can provide deep insights into data, allowing machines to make high-quality predictions and having been widely used in real-world applications, such as text mining, visual classification, and recommender systems. However,…

Machine Learning · Computer Science 2020-08-11 Meng Wang , Weijie Fu , Xiangnan He , Shijie Hao , Xindong Wu

The parameter counts of the most widely used large language models (LLMs) are often withheld by their developers, leaving model size -- a primary reference point for interpreting capabilities and costs -- largely undisclosed. We propose a…

Machine Learning · Computer Science 2026-05-29 Ivica Nikolic

The relationship between memorization and generalization in large language models (LLMs) remains an open area of research, with growing evidence that the two are deeply intertwined. In this work, we investigate this relationship by…

Machine Learning · Computer Science 2025-06-19 Joshua Barron , Devin White

Many efforts have been made to facilitate natural language processing tasks with pre-trained language models (LMs), and brought significant improvements to various applications. To fully leverage the nearly unlimited corpora and capture…

Computation and Language · Computer Science 2018-09-11 Liyuan Liu , Xiang Ren , Jingbo Shang , Jian Peng , Jiawei Han

Large Language Models (LLMs) have attracted extensive attention due to their remarkable performance across various tasks. However, the substantial computational and memory requirements of LLM inference pose challenges for deployment in…

The lack of transparency about code datasets used to train large language models (LLMs) makes it difficult to detect, evaluate, and mitigate data leakage. We present a perturbation-based method to quantify memorization advantage in code…