English
Related papers

Related papers: Stealing Training Data from Large Language Models …

200 papers

In this paper we develop state-of-the-art privacy attacks against Large Language Models (LLMs), where an adversary with some access to the model tries to learn something about the underlying training data. Our headline results are new…

Cryptography and Security · Computer Science 2024-07-16 Jeffrey G. Wang , Jason Wang , Marvin Li , Seth Neel

Adversarial training was introduced as a way to improve the robustness of deep learning models to adversarial attacks. This training method improves robustness against adversarial attacks, but increases the models vulnerability to privacy…

Motivated by the advancing computational capacity of distributed end-user equipments (UEs), as well as the increasing concerns about sharing private data, there has been considerable recent interest in machine learning (ML) and artificial…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-08-11 Chuan Ma , Jun Li , Kang Wei , Bo Liu , Ming Ding , Long Yuan , Zhu Han , H. Vincent Poor

Large Language Models (LLMs) have achieved remarkable progress in natural language understanding, reasoning, and autonomous decision-making. However, these advancements have also come with significant privacy concerns. While significant…

Cryptography and Security · Computer Science 2026-01-27 Yuntao Du , Zitao Li , Ninghui Li , Bolin Ding

Deep learning techniques based on neural networks have shown significant success in a wide range of AI tasks. Large-scale training datasets are one of the critical factors for their success. However, when the training datasets are…

Cryptography and Security · Computer Science 2019-12-23 Lei Yu , Ling Liu , Calton Pu , Mehmet Emre Gursoy , Stacey Truex

Large Language Models (LLMs) have demonstrated advanced capabilities in both text generation and comprehension, and their application to data archives might facilitate the privatization of sensitive information about the data subjects. In…

Cryptography and Security · Computer Science 2025-04-08 Stefano Cirillo , Domenico Desiato , Giuseppe Polese , Monica Maria Lucia Sebillo , Giandomenico Solimando

Large Language Models (LLMs) trained on massive data capture rich information embedded in the training data. However, this also introduces the risk of privacy leakage, particularly involving personally identifiable information (PII).…

Computation and Language · Computer Science 2025-06-10 Wenshuo Dong , Qingsong Yang , Shu Yang , Lijie Hu , Meng Ding , Wanyu Lin , Tianhang Zheng , Di Wang

Federated learning (FL) has emerged as a promising privacy-aware paradigm that allows multiple clients to jointly train a model without sharing their private data. Recently, many studies have shown that FL is vulnerable to membership…

Cryptography and Security · Computer Science 2021-09-14 Hongsheng Hu , Zoran Salcic , Lichao Sun , Gillian Dobbie , Xuyun Zhang

Federated Learning (FL) has emerged as a leading paradigm for decentralized, privacy preserving machine learning training. However, recent research on gradient inversion attacks (GIAs) have shown that gradient updates in FL can leak…

Cryptography and Security · Computer Science 2024-05-20 Yichuan Shi , Olivera Kotevska , Viktor Reshniak , Abhishek Singh , Ramesh Raskar

This paper presents how to leak private information from a wireless signal classifier by launching an over-the-air membership inference attack (MIA). As machine learning (ML) algorithms are used to process wireless signals to make decisions…

Signal Processing · Electrical Eng. & Systems 2020-06-26 Yi Shi , Kemal Davaslioglu , Yalin E. Sagduyu

Deep neural networks are susceptible to various inference attacks as they remember information about their training data. We design white-box inference attacks to perform a comprehensive privacy analysis of deep learning models. We measure…

Machine Learning · Statistics 2020-06-09 Milad Nasr , Reza Shokri , Amir Houmansadr

Deep Learning (DL) techniques allow ones to train models from a dataset to solve tasks. DL has attracted much interest given its fancy performance and potential market value, while security issues are amongst the most colossal concerns.…

Cryptography and Security · Computer Science 2020-05-19 Hongwei Huang , Weiqi Luo , Guoqiang Zeng , Jian Weng , Yue Zhang , Anjia Yang

Machine learning models often pose a threat to the privacy of individuals whose data is part of the training set. Several recent attacks have been able to infer sensitive information from trained models, including model inversion or…

Machine Learning · Computer Science 2020-06-30 Abigail Goldsteen , Gilad Ezov , Ariel Farkash

When large language models are trained on private data, it can be a significant privacy risk for them to memorize and regurgitate sensitive information. In this work, we propose a new practical data extraction attack that we call "neural…

Cryptography and Security · Computer Science 2024-03-05 Ashwinee Panda , Christopher A. Choquette-Choo , Zhengming Zhang , Yaoqing Yang , Prateek Mittal

We introduce Advertisement Embedding Attacks (AEA), a new class of LLM security threats that stealthily inject promotional or malicious content into model outputs and AI agents. AEA operate through two low-cost vectors: (1) hijacking…

Cryptography and Security · Computer Science 2025-09-10 Qiming Guo , Jinwen Tang , Xingran Huang

With the rapid progress of large language models (LLMs), many downstream NLP tasks can be well solved given appropriate prompts. Though model developers and researchers work hard on dialog safety to avoid generating harmful content from…

Computation and Language · Computer Science 2023-11-02 Haoran Li , Dadi Guo , Wei Fan , Mingshi Xu , Jie Huang , Fanpu Meng , Yangqiu Song

The wide adoption and application of Masked language models~(MLMs) on sensitive data (from legal to medical) necessitates a thorough quantitative investigation into their privacy vulnerabilities -- to what extent do MLMs leak information…

Machine Learning · Computer Science 2022-11-07 Fatemehsadat Mireshghallah , Kartik Goyal , Archit Uniyal , Taylor Berg-Kirkpatrick , Reza Shokri

Model Inversion (MI) attacks aim to reconstruct private training data by abusing access to machine learning models. Contemporary MI attacks have achieved impressive attack performance, posing serious threats to privacy. Meanwhile, all…

Machine Learning · Computer Science 2024-05-10 Sy-Tuyen Ho , Koh Jun Hao , Keshigeyan Chandrasegaran , Ngoc-Bao Nguyen , Ngai-Man Cheung

Large language models (LLMs) have demonstrated exceptional capabilities in text understanding and generation, and they are increasingly being utilized across various domains to enhance productivity. However, due to the high costs of…

Cryptography and Security · Computer Science 2024-11-05 Yu Mao , Xueping Liao , Wei Liu , Anjia Yang

Neural network-based image classifiers are powerful tools for computer vision tasks, but they inadvertently reveal sensitive attribute information about their classes, raising concerns about their privacy. To investigate this privacy…

Machine Learning · Computer Science 2023-06-14 Lukas Struppek , Dominik Hintersdorf , Felix Friedrich , Manuel Brack , Patrick Schramowski , Kristian Kersting