English
Related papers

Related papers: When Tables Leak: Attacking String Memorization in…

200 papers

Machine learning models are known to leak sensitive information, as they inevitably memorize (parts of) their training data. More alarmingly, large language models (LLMs) are now trained on nearly all available data, which amplifies the…

Machine Learning · Computer Science 2025-10-10 Jiashu Tao , Reza Shokri

The memorization of training data in large language models (LLMs) poses significant privacy and copyright concerns. Existing data extraction methods, particularly heuristic-based divergence attacks, often exhibit limited success and offer…

Computation and Language · Computer Science 2025-11-11 Myeongseob Ko , Nikhil Reddy Billa , Adam Nguyen , Charles Fleming , Ming Jin , Ruoxi Jia

Tabular data synthesis using diffusion models has gained significant attention for its potential to balance data utility and privacy. However, existing privacy evaluations often rely on heuristic metrics or weak membership inference attacks…

Machine Learning · Computer Science 2025-03-18 Xiaoyu Wu , Yifei Pang , Terrance Liu , Steven Wu

Diffusion Language Models (DLMs) represent a promising alternative to autoregressive language models, using bidirectional masked token prediction. Yet their susceptibility to privacy leakage via Membership Inference Attacks (MIA) remains…

Machine Learning · Computer Science 2026-02-10 Yuetian Chen , Kaiyuan Zhang , Yuntao Du , Edoardo Stoppa , Charles Fleming , Ashish Kundu , Bruno Ribeiro , Ninghui Li

The rapid advancement of Large Language Models (LLMs) has been driven by extensive datasets that may contain sensitive information, raising serious privacy concerns. One notable threat is the Membership Inference Attack (MIA), where…

Cryptography and Security · Computer Science 2025-12-17 Yihan Liao , Jacky Keung , Xiaoxue Ma , Jingyu Zhang , Yicheng Sun

Membership Inference Attack (MIA) aims to determine whether a specific data sample was included in the training dataset of a target model. Traditional MIA approaches rely on shadow models to mimic target model behavior, but their…

Information Retrieval · Computer Science 2026-03-20 Li Cuihong , Huang Xiaowen , Yin Chuanhuan , Sang Jitao

Large Language Models (LLMs) are increasingly deployed to enable or improve a multitude of real-world applications. Given the large size of their training data sets, their tendency to memorize training data raises serious privacy and…

Machine Learning · Computer Science 2026-01-27 Pedram Zaree , Md Abdullah Al Mamun , Yue Dong , Ihsen Alouani , Nael Abu-Ghazaleh

Language Models (LMs) typically adhere to a "pre-training and fine-tuning" paradigm, where a universal pre-trained model can be fine-tuned to cater to various specialized domains. Low-Rank Adaptation (LoRA) has gained the most widespread…

Cryptography and Security · Computer Science 2025-07-25 Delong Ran , Xinlei He , Tianshuo Cong , Anyu Wang , Qi Li , Xiaoyun Wang

The rise of Large Language Models (LLMs) has triggered legal and ethical concerns, especially regarding the unauthorized use of copyrighted materials in their training datasets. This has led to lawsuits against tech companies accused of…

Cryptography and Security · Computer Science 2025-01-17 Cédric Eichler , Nathan Champeil , Nicolas Anciaux , Alexandra Bensamoun , Heber Hwang Arcolezi , José Maria De Fuentes

Large language models (LLMs) are trained on massive corpora that may contain sensitive information, creating privacy risks under membership inference attacks (MIAs). Knowledge distillation is widely used to compress LLMs into smaller…

Machine Learning · Computer Science 2026-01-13 Ziyao Cui , Minxing Zhang , Jian Pei

Synthetic tabular data is essential for machine learning workflows, especially for expanding small or imbalanced datasets and enabling privacy-preserving data sharing. However, state-of-the-art generative models (GANs, VAEs, diffusion…

Machine Learning · Computer Science 2025-07-24 Jessup Byun , Xiaofeng Lin , Joshua Ward , Guang Cheng

Large Language Models (LLMs) have shown greatly enhanced performance in recent years, attributed to increased size and extensive training data. This advancement has led to widespread interest and adoption across industries and the public.…

Computation and Language · Computer Science 2024-06-19 Victoria Smith , Ali Shahin Shamsabadi , Carolyn Ashurst , Adrian Weller

Large Language Models (LLMs) memorize, and thus, among huge amounts of uncontrolled data, may memorize Personally Identifiable Information (PII), which should not be stored and, consequently, not leaked. In this paper, we introduce Private…

Cryptography and Security · Computer Science 2025-08-22 Elena Sofia Ruzzetti , Giancarlo A. Xompero , Davide Venditti , Fabio Massimo Zanzotto

Tabular data sharing under privacy constraints is increasingly important for research and collaboration. Synthetic data generators (SDGs) are a promising solution, but synthetic data remains vulnerable to attacks, such as membership…

Machine Learning · Computer Science 2026-05-15 Davide Scassola , Andrea Coser , Sebastiano Saccani

Synthetic data generation plays an important role in enabling data sharing, particularly in sensitive domains like healthcare and finance. Recent advances in diffusion models have made it possible to generate realistic, high-quality tabular…

Cryptography and Security · Computer Science 2025-10-07 Eyal German , Daniel Samira , Yuval Elovici , Asaf Shabtai

Membership inference attacks (MIAs) reveal whether specific data was used to train machine learning models, serving as important tools for privacy auditing and compliance assessment. Recent studies have reported that MIAs perform only…

Machine Learning · Computer Science 2025-09-09 Disha Makhija , Manoj Ghuhan Arivazhagan , Vinayshekhar Bannihatti Kumar , Rashmi Gangadharaiah

The lack of data transparency in Large Language Models (LLMs) has highlighted the importance of Membership Inference Attack (MIA), which differentiates trained (member) and untrained (non-member) data. Though it shows success in previous…

Computation and Language · Computer Science 2024-12-19 Bowen Chen , Namgi Han , Yusuke Miyao

Large language models (LLMs) have demonstrated significant success in various domain-specific tasks, with their performance often improving substantially after fine-tuning. However, fine-tuning with real-world data introduces privacy risks.…

Cryptography and Security · Computer Science 2025-01-30 Atilla Akkus , Masoud Poorghaffar Aghdam , Mingjie Li , Junjie Chu , Michael Backes , Yang Zhang , Sinem Sav

Machine learning poses severe privacy concerns as it has been shown that the learned models can reveal sensitive information about their training data. Many works have investigated the effect of widely adopted data augmentation and…

Machine Learning · Computer Science 2024-03-26 Xiao Li , Qiongxiu Li , Zhanhao Hu , Xiaolin Hu

Retrieval-Augmented Generation (RAG) and Supervised Finetuning (SFT) have become the predominant paradigms for equipping Large Language Models (LLMs) with external knowledge for diverse, knowledge-intensive tasks. However, while such…

Cryptography and Security · Computer Science 2025-12-04 Haowei Fu , Bo Ni , Han Xu , Kunpeng Liu , Dan Lin , Tyler Derr