English
Related papers

Related papers: Pandora's White-Box: Precise Training Data Detecti…

200 papers

Large Language Models (LLMs) have achieved significantly advanced capabilities in understanding and generating human language text, which have gained increasing popularity over recent years. Apart from their state-of-the-art natural…

Cryptography and Security · Computer Science 2025-02-11 Yihe Zhou , Tao Ni , Wei-Bin Lee , Qingchuan Zhao

Large Language Models (LLMs) have shown their impressive capabilities, while also raising concerns about the data contamination problems due to privacy issues and leakage of benchmark datasets in the pre-training phase. Therefore, it is…

Computation and Language · Computer Science 2024-06-04 Zhenhua Liu , Tong Zhu , Chuanyuan Tan , Haonan Lu , Bing Liu , Wenliang Chen

The wide adoption and application of Masked language models~(MLMs) on sensitive data (from legal to medical) necessitates a thorough quantitative investigation into their privacy vulnerabilities -- to what extent do MLMs leak information…

Machine Learning · Computer Science 2022-11-07 Fatemehsadat Mireshghallah , Kartik Goyal , Archit Uniyal , Taylor Berg-Kirkpatrick , Reza Shokri

Federated Learning (FL) is an emerging solution to the data scarcity problem for training deep learning models in hardware assurance. While FL is designed to enhance privacy by not sharing raw data, it remains vulnerable to Membership…

Cryptography and Security · Computer Science 2026-04-23 Gijung Lee , Wavid Bowman , Olivia P. Dizon-Paradis , Reiner N. Dizon-Paradis , Ronald Wilson , Damon L. Woodard , Domenic Forte

Large language models (LLMs) can leak sensitive training data through memorization and membership inference attacks. Prior work has primarily focused on strong adversarial assumptions, including attacker access to entire samples or long,…

Machine Learning · Computer Science 2025-05-21 Lucas Rosenblatt , Bin Han , Robert Wolfe , Bill Howe

The proliferation of large language models (LLMs) has intensified concerns over model theft and license violations, necessitating robust and stealthy ownership verification. Existing fingerprinting methods either require impractical…

Cryptography and Security · Computer Science 2025-09-04 Zhenhua Xu , Meng Han , Wenpeng Xing

Large language models (LLMs) are becoming a popular tool as they have significantly advanced in their capability to tackle a wide range of language-based tasks. However, LLMs applications are highly vulnerable to prompt injection attacks,…

Computation and Language · Computer Science 2024-11-11 Md Abdur Rahman , Fan Wu , Alfredo Cuzzocrea , Sheikh Iqbal Ahamed

Large Multimodal Language Models (MLLMs) are emerging as one of the foundational tools in an expanding range of applications. Consequently, understanding training-data leakage in these systems is increasingly critical. Log-probability-based…

Cryptography and Security · Computer Science 2026-05-22 Ziyi Tong , Feifei Sun , Le Minh Nguyen

Diffusion models have achieved remarkable progress in image generation, but their increasing deployment raises serious concerns about privacy. In particular, fine-tuned models are highly vulnerable, as they are often fine-tuned on small and…

Cryptography and Security · Computer Science 2026-01-30 Puwei Lian , Yujun Cai , Songze Li , Bingkun Bao

Membership inference attacks (MIAs) on code completion models offer an effective way to assess privacy risks by inferring whether a given code snippet was part of the training data. Existing black- and gray-box MIAs rely on expensive…

Software Engineering · Computer Science 2025-11-20 Yuan Jiang , Zehao Li , Shan Huang , Christoph Treude , Xiaohong Su , Tiantian Wang

Large Reasoning Models (LRMs) have rapidly gained prominence for their strong performance in solving complex tasks. Many modern black-box LRMs expose the intermediate reasoning traces through APIs to improve transparency (e.g., Gemini-2.5…

Cryptography and Security · Computer Science 2026-01-21 Ruihan Hu , Yu-Ming Shang , Wei Luo , Ye Tao , Xi Zhang

Large Language Models (LLMs) represent a significant advancement in artificial intelligence, finding applications across various domains. However, their reliance on massive internet-sourced datasets for training brings notable privacy…

Cryptography and Security · Computer Science 2025-02-11 Michele Miranda , Elena Sofia Ruzzetti , Andrea Santilli , Fabio Massimo Zanzotto , Sébastien Bratières , Emanuele Rodolà

With the rapid adoption of Federated Learning (FL) as the training and tuning protocol for applications utilizing Large Language Models (LLMs), recent research highlights the need for significant modifications to FL to accommodate the…

Cryptography and Security · Computer Science 2024-03-11 Minh N. Vu , Truc Nguyen , Tre' R. Jeter , My T. Thai

The success of deep neural networks has driven numerous research studies and applications from Euclidean to non-Euclidean data. However, there are increasing concerns about privacy leakage, as these networks rely on processing private data.…

Machine Learning · Computer Science 2025-11-03 Zhanke Zhou , Jianing Zhu , Fengfei Yu , Xuan Li , Xiong Peng , Tongliang Liu , Bo Han

Adapting Large Language Models (LLMs) to specific tasks introduces concerns about computational efficiency, prompting an exploration of efficient methods such as In-Context Learning (ICL). However, the vulnerability of ICL to privacy…

Cryptography and Security · Computer Science 2024-09-04 Rui Wen , Zheng Li , Michael Backes , Yang Zhang

Large language models(LLMs) are currently at the forefront of the machine learning field, which show a broad application prospect but at the same time expose some risks of privacy leakage. We combined Fully Homomorphic Encryption(FHE) and…

Cryptography and Security · Computer Science 2025-01-08 Zhang Ruoyan , Zheng Zhongxiang , Bao Wankang

Decentralized training has become a resource-efficient framework to democratize the training of large language models (LLMs). However, the privacy risks associated with this framework, particularly due to the potential inclusion of…

Cryptography and Security · Computer Science 2025-02-25 Chenxi Dai , Lin Lu , Pan Zhou

In a membership inference attack (MIA), an attacker exploits the overconfidence exhibited by typical machine learning models to determine whether a specific data point was used to train a target model. In this paper, we analyze the…

Information Theory · Computer Science 2025-06-10 Meiyi Zhu , Caili Guo , Chunyan Feng , Osvaldo Simeone

Transfer learning, successful in knowledge translation across related tasks, faces a substantial privacy threat from membership inference attacks (MIAs). These attacks, despite posing significant risk to ML model's training data, remain…

Cryptography and Security · Computer Science 2025-01-22 Cong Wu , Jing Chen , Qianru Fang , Kun He , Ziming Zhao , Hao Ren , Guowen Xu , Yang Liu , Yang Xiang

Federated Learning (FL) enables collaborative model training while keeping training data localized, allowing us to preserve privacy in various domains including remote sensing. However, recent studies show that FL models may still leak…

Cryptography and Security · Computer Science 2026-01-13 Anh-Kiet Duong , Petra Gomez-Krämer , Hoàng-Ân Lê , Minh-Tan Pham