English
Related papers

Related papers: SRPG: Semantically Reconstructed Privacy Guard for…

200 papers

With the rise of large language models (LLMs), increasing research has recognized their risk of leaking personally identifiable information (PII) under malicious attacks. Although efforts have been made to protect PII in LLMs, existing…

Computation and Language · Computer Science 2025-03-12 Martin Kuo , Jingyang Zhang , Jianyi Zhang , Minxue Tang , Louis DiValentin , Aolin Ding , Jingwei Sun , William Chen , Amin Hass , Tianlong Chen , Yiran Chen , Hai Li

Retrieval-Augmented Generation (RAG) enhances large language models (LLMs) by grounding them in external knowledge. However, its application in sensitive domains is limited by privacy risks. Existing private RAG methods typically rely on…

Cryptography and Security · Computer Science 2026-05-13 Junki Mori , Kazuya Kakizaki , Taiki Miyagawa , Jun Sakuma

The rapid advancement of large language models (LLMs) has revolutionized natural language processing, enabling applications in diverse domains such as healthcare, finance and education. However, the growing reliance on extensive data for…

Cryptography and Security · Computer Science 2024-12-10 Guoshenghui Zhao , Eric Song

While the flexible capabilities of large language models (LLMs) allow them to answer a range of queries based on existing learned knowledge, information retrieval to augment generation is an important tool to allow LLMs to answer questions…

Information Retrieval · Computer Science 2023-11-23 Guy Zyskind , Tobin South , Alex Pentland

Large Language Models (LLMs) memorize, and thus, among huge amounts of uncontrolled data, may memorize Personally Identifiable Information (PII), which should not be stored and, consequently, not leaked. In this paper, we introduce Private…

Cryptography and Security · Computer Science 2025-08-22 Elena Sofia Ruzzetti , Giancarlo A. Xompero , Davide Venditti , Fabio Massimo Zanzotto

The tension between data privacy and model utility has become the defining bottleneck for the practical deployment of large language models (LLMs) trained on sensitive corpora including healthcare. Differentially private stochastic gradient…

Machine Learning · Computer Science 2025-07-31 Afshin Khadangi , Amir Sartipi , Igor Tchappi , Ramin Bahmani , Gilbert Fridgen

Large Language Models (LLMs) are widely used in sensitive domains, including healthcare, finance, and legal services, raising concerns about potential private information leaks during inference. Privacy extraction attacks, such as…

Cryptography and Security · Computer Science 2025-06-25 Jinwen He , Yiyang Lu , Zijin Lin , Kai Chen , Yue Zhao

The proliferation of retrieval-augmented generation (RAG) has established vector databases as critical infrastructure, yet they introduce severe privacy risks via embedding inversion attacks. Existing paradigms face a fundamental trade-off:…

Computation and Language · Computer Science 2026-02-04 Doohyun Kim , Donghwa Kang , Kyungjae Lee , Hyeongboo Baek , Brent Byunghoon Kang

Retrieval-Augmented Generation (RAG) systems enhance response credibility and traceability by displaying reference contexts, but this transparency simultaneously introduces a novel black-box attack vector. Existing document poisoning…

Computation and Language · Computer Science 2026-01-27 Runqi Sui

The security of LLM-based multi-agent systems (MAS) is critically threatened by propagation vulnerability, where malicious agents can distort collective decision-making through inter-agent message interactions. While existing supervised…

Artificial Intelligence · Computer Science 2026-04-28 Rui Miao , Yixin Liu , Yili Wang , Xu Shen , Yue Tan , Yiwei Dai , Shirui Pan , Xin Wang

The widespread adoption of large language models (LLMs) has raised concerns regarding data privacy. This study aims to investigate the potential for privacy invasion through input reconstruction attacks, in which a malicious model provider…

Machine Learning · Computer Science 2024-05-24 Zhipeng Wan , Anda Cheng , Yinggui Wang , Lei Wang

The task of text privatization using Differential Privacy has recently taken the form of $\textit{text rewriting}$, in which an input text is obfuscated via the use of generative (large) language models. While these methods have shown…

Computation and Language · Computer Science 2024-07-02 Stephen Meisenbacher , Maulik Chevli , Juraj Vladika , Florian Matthes

Large language models (LLMs) have demonstrated exceptional capabilities in text understanding and generation, and they are increasingly being utilized across various domains to enhance productivity. However, due to the high costs of…

Cryptography and Security · Computer Science 2024-11-05 Yu Mao , Xueping Liao , Wei Liu , Anjia Yang

In recent years, machine learning - particularly deep learning - has significantly impacted the field of information management. While several strategies have been proposed to restrict models from learning and memorizing sensitive…

Computation and Language · Computer Science 2024-07-10 Jiajia Li , Lu Yang , Letian Peng , Shitou Zhang , Ping Wang , Zuchao Li , Hai Zhao

The reliance of mobile GUI agents on Multimodal Large Language Models (MLLMs) introduces a severe privacy vulnerability: screenshots containing Personally Identifiable Information (PII) are often sent to untrusted, third-party routers.…

Cryptography and Security · Computer Science 2025-11-18 Fuyao Zhang , Jiaming Zhang , Che Wang , Xiongtao Sun , Yurong Hao , Guowei Guan , Wenjie Li , Longtao Huang , Wei Yang Bryan Lim

Retrieval-based language models (LMs) have demonstrated improved interpretability, factuality, and adaptability compared to their parametric counterparts, by incorporating retrieved text from external datastores. While it is well known that…

Computation and Language · Computer Science 2023-05-25 Yangsibo Huang , Samyak Gupta , Zexuan Zhong , Kai Li , Danqi Chen

Federated learning frameworks have been regarded as a promising approach to break the dilemma between demands on privacy and the promise of learning from large collections of distributed data. Many such frameworks only ask collaborators to…

Machine Learning · Computer Science 2021-03-17 Junyi Zhu , Matthew Blaschko

The widespread use of cloud-based Large Language Models (LLMs) has heightened concerns over user privacy, as sensitive information may be inadvertently exposed during interactions with these services. To protect privacy before sending…

Computation and Language · Computer Science 2025-05-28 Shuo Huang , William MacLean , Xiaoxi Kang , Qiongkai Xu , Zhuang Li , Xingliang Yuan , Gholamreza Haffari , Lizhen Qu

Large Language Models (LLMs) are transforming enterprise workflows but introduce security and ethics challenges when employees inadvertently share confidential data or generate policy-violating content. This paper proposes SafeGPT, a…

Cryptography and Security · Computer Science 2026-05-26 Pratyush Desai , Luoxi Tang , Yuqiao Meng , Zhaohan Xi

Retrieval-Augmented Generation (RAG) is a powerful technique for enhancing Large Language Models (LLMs) with external, up-to-date knowledge. Graph RAG has emerged as an advanced paradigm that leverages graph-based knowledge structures to…

Cryptography and Security · Computer Science 2025-08-26 Jiale Liu , Jiahao Zhang , Suhang Wang