English
Related papers

Related papers: Hey, That's My Data! Token-Only Dataset Inference …

200 papers

Large crowdsourced datasets are widely used for training and evaluating neural models on natural language inference (NLI). Despite these efforts, neural models have a hard time capturing logical inferences, including those licensed by…

Computation and Language · Computer Science 2019-04-30 Hitomi Yanaka , Koji Mineshima , Daisuke Bekki , Kentaro Inui , Satoshi Sekine , Lasha Abzianidze , Johan Bos

Instruction Tuning (IT), the process of training large language models (LLMs) using instruction-response pairs, has emerged as the predominant method for transforming base pre-trained LLMs into open-domain conversational agents. While IT…

Computation and Language · Computer Science 2024-07-16 Sreyan Ghosh , Chandra Kiran Reddy Evuru , Sonal Kumar , Ramaneswaran S , Deepali Aneja , Zeyu Jin , Ramani Duraiswami , Dinesh Manocha

Pretrained knowledge memorized in LLMs raises critical concerns over safety and privacy, which has motivated LLM Unlearning as a technique for selectively removing the influences of undesirable knowledge. Existing approaches, rooted in…

Computation and Language · Computer Science 2026-02-04 Zhengbang Yang , Yisheng Zhong , Junyuan Hong , Zhuangdi Zhu

The growing use of large language models in sensitive domains has exposed a critical weakness: the inability to ensure that private information can be permanently forgotten. Yet these systems still lack reliable mechanisms to guarantee that…

Machine Learning · Computer Science 2025-11-14 James Jin Kang , Dang Bui , Thanh Pham , Huo-Chong Ling

This paper presents a comprehensive study on the tokenization techniques employed by state-of-the-art large language models (LLMs) and their implications on the cost and availability of services across different languages, especially low…

Computation and Language · Computer Science 2024-10-07 Abrar Rahman , Garry Bowlin , Binit Mohanty , Sean McGunigal

Large language models (LLMs) suffer from catastrophic forgetting during continual learning. Conventional rehearsal-based methods rely on previous training data to retain the model's ability, which may not be feasible in real-world…

Computation and Language · Computer Science 2024-05-28 Jianheng Huang , Leyang Cui , Ante Wang , Chengyi Yang , Xinting Liao , Linfeng Song , Junfeng Yao , Jinsong Su

Fine-tuning has been proven to be a simple and effective technique to transfer the learned knowledge of Pre-trained Language Models (PLMs) to downstream tasks. However, vanilla fine-tuning easily overfits the target data and degrades the…

Computation and Language · Computer Science 2023-06-21 Junhao Zheng , Qianli Ma , Shengjie Qiu , Yue Wu , Peitian Ma , Junlong Liu , Huawen Feng , Xichen Shang , Haibin Chen

Large Language Models (LLMs) are often evaluated against ideals of perfect Bayesian inference, yet growing evidence suggests that their in-context reasoning exhibits systematic forgetting of past information. Rather than viewing this…

Computation and Language · Computer Science 2026-04-08 Alexandros Christoforos

The remarkable language ability of Large Language Models (LLMs) stems from extensive training on vast datasets, often including copyrighted material, which raises serious concerns about unauthorized use. While Membership Inference Attacks…

Artificial Intelligence · Computer Science 2025-11-21 Haodong Li , Jingqi Zhang , Xiao Cheng , Peihua Mai , Haoyu Wang , Yan Pang

Recent large language models (LLM) exhibit sub-optimal performance on low-resource languages, as the training data of these models is usually dominated by English and other high-resource languages. Furthermore, it is challenging to train…

Computation and Language · Computer Science 2023-12-18 Zoltan Csaki , Pian Pawakapan , Urmish Thakker , Qiantong Xu

Large language models (LLMs) have achieved impressive results in natural language processing but are prone to memorizing portions of their training data, which can compromise evaluation metrics, raise privacy concerns, and limit…

Machine Learning · Computer Science 2024-12-03 Eduardo Slonski

Large Language Models (LLMs) demand significant computational resources, making it essential to enhance their capabilities without retraining from scratch. A key challenge in this domain is \textit{catastrophic forgetting} (CF), which…

Machine Learning · Computer Science 2025-01-31 Haichao Wei , Yunxiang Ren , Zhoutong Fu , Aman Lunia , Yi-Lin Chen , Alice Leung , Ya Xu

The Large Language Model (LLM) watermark is a newly emerging technique that shows promise in addressing concerns surrounding LLM copyright, monitoring AI-generated text, and preventing its misuse. The LLM watermark scheme commonly includes…

Cryptography and Security · Computer Science 2024-05-31 Zhaoxi Zhang , Xiaomei Zhang , Yanjun Zhang , Leo Yu Zhang , Chao Chen , Shengshan Hu , Asif Gill , Shirui Pan

The pre-training of large language models (LLMs) relies on massive text datasets sourced from diverse and difficult-to-curate origins. Although membership inference attacks and hidden canaries have been explored to trace data usage, such…

Cryptography and Security · Computer Science 2025-06-19 Wassim Bouaziz , Mathurin Videau , Nicolas Usunier , El-Mahdi El-Mhamdi

Large language models (LLMs) have become essential tools for digital task assistance. Their training relies heavily on the collection of vast amounts of data, which may include copyright-protected or sensitive information. Recent studies on…

Cryptography and Security · Computer Science 2025-09-22 Sagiv Antebi , Edan Habler , Asaf Shabtai , Yuval Elovici

Fine-tuning large language models (LLMs) can cause them to lose their general capabilities. However, the intrinsic mechanisms behind such forgetting remain unexplored. In this paper, we begin by examining this phenomenon by focusing on…

Artificial Intelligence · Computer Science 2024-12-02 Gangwei Jiang , Zhaoyi Li , Defu Lian , Ying Wei

Large language models (LLMs) have achieved significant progress from pre-training on and memorizing a wide range of textual data, however, this process might suffer from privacy issues and violations of data protection regulations. As a…

Computation and Language · Computer Science 2023-11-01 Jiaao Chen , Diyi Yang

Although Large Language Models (LLMs) have demonstrated impressive capabilities across a wide range of tasks, growing concerns have emerged over the misuse of sensitive, copyrighted, or harmful data during training. To address these…

Cryptography and Security · Computer Science 2025-06-03 Jie Ren , Zhenwei Dai , Xianfeng Tang , Yue Xing , Shenglai Zeng , Hui Liu , Jingying Zeng , Qiankun Peng , Samarth Varshney , Suhang Wang , Qi He , Charu C. Aggarwal , Hui Liu

Large-scale pre-trained language models (LLMs) have demonstrated exceptional performance in various natural language processing (NLP) tasks. However, the massive size of these models poses huge challenges for their deployment in real-world…

Computation and Language · Computer Science 2023-10-25 Jiduan Liu , Jiahao Liu , Qifan Wang , Jingang Wang , Xunliang Cai , Dongyan Zhao , Ran Lucien Wang , Rui Yan

Large Language Models (LLMs) can memorize and reveal personal information, raising concerns regarding compliance with the EU's GDPR, particularly the Right to Be Forgotten (RTBF). Existing machine unlearning methods assume the data to…

Computation and Language · Computer Science 2025-07-16 Dimitri Staufer