English
Related papers

Related papers: Model Inversion Attacks on Llama 3: Extracting PII…

200 papers

While open Large Language Models (LLMs) have made significant progress, they still fall short of matching the performance of their closed, proprietary counterparts, making the latter attractive even for the use on highly private data.…

Machine Learning · Computer Science 2024-11-18 Vincent Hanke , Tom Blanchard , Franziska Boenisch , Iyiola Emmanuel Olatunji , Michael Backes , Adam Dziedzic

Large language models (LLMs) require a significant redesign in solutions to preserve privacy in data-intensive applications due to their text-generation capabilities. Indeed, LLMs tend to memorize and emit private information when…

Large Language Models (LLMs) generate responses based on user prompts. Often, these prompts may contain highly sensitive information, including personally identifiable information (PII), which could be exposed to third parties hosting these…

Cryptography and Security · Computer Science 2026-03-30 Shashie Dilhara Batan Arachchige , Hassan Jameel Asghar , Benjamin Zi Hao Zhao , Dinusha Vatsalan , Dali Kaafar

Model extraction attacks pose significant security threats to deployed language models, potentially compromising intellectual property and user privacy. This survey provides a comprehensive taxonomy of LLM-specific extraction attacks and…

Cryptography and Security · Computer Science 2025-07-09 Kaixiang Zhao , Lincan Li , Kaize Ding , Neil Zhenqiang Gong , Yue Zhao , Yushun Dong

Large language models (LLMs) and LLM-based agents have been widely deployed in a wide range of applications in the real world, including healthcare diagnostics, financial analysis, customer support, robotics, and autonomous driving,…

Cryptography and Security · Computer Science 2025-05-20 Wenrui Xu , Keshab K. Parhi

Large Language Models (LLMs) are increasingly integrated into daily routines, yet they raise significant privacy and safety concerns. Recent research proposes collaborative inference, which outsources the early-layer inference to ensure…

Cryptography and Security · Computer Science 2025-07-23 Tian Dong , Yan Meng , Shaofeng Li , Guoxing Chen , Zhen Liu , Haojin Zhu

Redacting Personally Identifiable Information (PII) from unstructured text is critical for ensuring data privacy in regulated domains. While earlier approaches have relied on rule-based systems and domain-specific Named Entity Recognition…

Cryptography and Security · Computer Science 2025-08-08 Leon Garza , Anantaa Kotal , Aritran Piplai , Lavanya Elluri , Prajit Das , Aman Chadha

Large language models (LLMs) have significantly transformed the landscape of Natural Language Processing (NLP). Their impact extends across a diverse spectrum of tasks, revolutionizing how we approach language understanding and generations.…

Cryptography and Security · Computer Science 2025-06-13 Sara Abdali , Richard Anarfi , CJ Barberan , Jia He , Erfan Shayegani

Large Language Models (LLMs) are prone to memorizing training data, which poses serious privacy risks. Two of the most prominent concerns are training data extraction and Membership Inference Attacks (MIAs). Prior research has shown that…

Machine Learning · Computer Science 2026-03-02 Ali Al Sahili , Ali Chehab , Razane Tajeddine

Are Large Pre-Trained Language Models Leaking Your Personal Information? In this paper, we analyze whether Pre-Trained Language Models (PLMs) are prone to leaking personal information. Specifically, we query PLMs for email addresses with…

Computation and Language · Computer Science 2022-10-21 Jie Huang , Hanyin Shao , Kevin Chen-Chuan Chang

Large Language Models (LLMs) have been reported to "leak" Personally Identifiable Information (PII), with successful PII reconstruction often interpreted as evidence of memorization. We propose a principled revision of memorization…

Computation and Language · Computer Science 2026-01-08 Xiaoyu Luo , Yiyi Chen , Qiongxiu Li , Johannes Bjerva

Large Language Models (LLMs) have seen widespread adoption due to their remarkable natural language capabilities. However, when deploying them in real-world settings, it is important to align LLMs to generate texts according to acceptable…

Artificial Intelligence · Computer Science 2025-04-29 Qizhang Feng , Siva Rajesh Kasa , Santhosh Kumar Kasa , Hyokun Yun , Choon Hui Teo , Sravan Babu Bodapati

The large language model (LLM) powered recommendation paradigm has been proposed to address the limitations of traditional recommender systems, which often struggle to handle cold start users or items with new IDs. Despite its…

Information Retrieval · Computer Science 2025-09-15 Yubo Wang , Min Tang , Nuo Shen , Shujie Cui , Weiqing Wang

Ensuring the security of large language models (LLMs) is an ongoing challenge despite their widespread popularity. Developers work to enhance LLMs security, but vulnerabilities persist, even in advanced versions like GPT-4. Attackers…

Cryptography and Security · Computer Science 2023-12-19 Aysan Esmradi , Daniel Wankit Yip , Chun Fai Chan

Large multimodal language models have proven transformative in numerous applications. However, these models have been shown to memorize and leak pre-training data, raising serious user privacy and information security concerns. While data…

Computation and Language · Computer Science 2023-10-04 Yang Chen , Ethan Mendes , Sauvik Das , Wei Xu , Alan Ritter

The discourse on privacy risks in Large Language Models (LLMs) has disproportionately focused on verbatim memorization of training data, while a constellation of more immediate and scalable privacy threats remain underexplored. This…

Cryptography and Security · Computer Science 2025-10-03 Niloofar Mireshghallah , Tianshi Li

The inference process of modern large language models (LLMs) demands prohibitive computational resources, rendering them infeasible for deployment on consumer-grade devices. To address this limitation, recent studies propose distributed LLM…

Cryptography and Security · Computer Science 2025-05-26 Xinjian Luo , Ting Yu , Xiaokui Xiao

Large language models (LLMs) have achieved remarkable success and are widely adopted for diverse applications. However, fine-tuning these models often involves private or sensitive information, raising critical privacy concerns. In this…

Cryptography and Security · Computer Science 2025-06-13 Kaiyuan Zhang , Siyuan Cheng , Hanxi Guo , Yuetian Chen , Zian Su , Shengwei An , Yuntao Du , Charles Fleming , Ashish Kundu , Xiangyu Zhang , Ninghui Li

Current privacy research on large language models (LLMs) primarily focuses on the issue of extracting memorized training data. At the same time, models' inference capabilities have increased drastically. This raises the key question of…

Artificial Intelligence · Computer Science 2024-05-07 Robin Staab , Mark Vero , Mislav Balunović , Martin Vechev

Users interacting with large language models (LLMs) under their real identifiers often unknowingly risk disclosing private information. Automatically notifying users whether their queries leak privacy and which phrases leak what private…

Computation and Language · Computer Science 2025-08-11 Hang Zeng , Xiangyu Liu , Yong Hu , Chaoyue Niu , Fan Wu , Shaojie Tang , Guihai Chen