English
Related papers

Related papers: PII-Bench: Evaluating Query-Aware Privacy Protecti…

200 papers

The advancement of large language models (LLMs) brings notable improvements across various applications, while simultaneously raising concerns about potential private data exposure. One notable capability of LLMs is their ability to form…

Computation and Language · Computer Science 2024-02-12 Hanyin Shao , Jie Huang , Shen Zheng , Kevin Chen-Chuan Chang

The deployment of Large Language Models in agentic, multi-turn conversational settings has introduced a class of privacy vulnerabilities that existing protection mechanisms are not designed to address. Current approaches to Personally…

Cryptography and Security · Computer Science 2026-04-21 Aman Panjwani

Large language models (LLMs) have transformed natural language processing, but their ability to memorize training data poses significant privacy risks. This paper investigates model inversion attacks on the Llama 3.2 model, a multilingual…

Machine Learning · Computer Science 2025-07-08 Sathesh P. Sivashanmugam

Large Language Models (LLMs) excel in various domains but pose inherent privacy risks. Existing methods to evaluate privacy leakage in LLMs often use memorized prefixes or simple instructions to extract data, both of which well-alignment…

Cryptography and Security · Computer Science 2025-05-19 Yidan Wang , Yanan Cao , Yubing Ren , Fang Fang , Zheng Lin , Binxing Fang

AI chatbots have quietly become the world's most popular therapists, coaches, and confidants. Users of cloud-based LLM services are increasingly shifting from simple queries like idea generation and poem writing, to deeply personal…

Human-Computer Interaction · Computer Science 2026-04-08 Max Holschneider , Saetbyeol LeeYouk

Large Language Models (LLMs) hold promise for advancing legal practice by automating complex tasks and improving access to justice. However, their adoption is limited by concerns over client confidentiality, especially when lawyers include…

Computation and Language · Computer Science 2025-01-22 M. Mikail Demir , Hakan T. Otal , M. Abdullah Canbaz

With the rise of large language models (LLMs), increasing research has recognized their risk of leaking personally identifiable information (PII) under malicious attacks. Although efforts have been made to protect PII in LLMs, existing…

Computation and Language · Computer Science 2025-03-12 Martin Kuo , Jingyang Zhang , Jianyi Zhang , Minxue Tang , Louis DiValentin , Aolin Ding , Jingwei Sun , William Chen , Amin Hass , Tianlong Chen , Yiran Chen , Hai Li

The recent advances in large language models (LLMs) have significantly expanded their applications across various fields such as language generation, summarization, and complex question answering. However, their application to privacy…

Computation and Language · Computer Science 2025-02-17 Yang Liu , Xichou Zhu , Zhou Shen , Yi Liu , Min Li , Yujun Chen , Benzi John , Zhenzhen Ma , Tao Hu , Zhi Li , Bolong Yang , Manman Wang , Zongxing Xie , Peng Liu , Dan Cai , Junhui Wang

Although Large Language Models (LLMs) have become increasingly integral to diverse applications, their capabilities raise significant privacy concerns. This survey offers a comprehensive overview of privacy risks associated with LLMs and…

Cryptography and Security · Computer Science 2025-05-06 Kang Chen , Xiuze Zhou , Yuanguo Lin , Shibo Feng , Li Shen , Pengcheng Wu

Large language models (LLMs) are increasingly applied to cybersecurity question answering (QA) for critical tasks such as incident response and vulnerability analysis. However, real-world operational contexts, including system logs and…

Cryptography and Security · Computer Science 2026-05-26 Matilda Gaddi , Jin Noh , Onat Gungor , Tajana Rosing

The rapid development of large language models (LLMs) is redefining the landscape of human-computer interaction, and their integration into various user-service applications is becoming increasingly prevalent. However, transmitting user…

Computation and Language · Computer Science 2025-02-20 Guangwei Li , Yuansen Zhang , Yinggui Wang , Shoumeng Yan , Lei Wang , Tao Wei

When users submit queries to Large Language Models (LLMs), their prompts can often contain sensitive data, forcing a difficult choice: Send the query to a powerful proprietary LLM providers to achieving state-of-the-art performance and risk…

Cryptography and Security · Computer Science 2026-04-21 Zheng Hui , Yijiang River Dong , Sanhanat Sivapiromrat , Ehsan Shareghi , Nigel Collier

Large Language Models (LLMs) represent a significant advancement in artificial intelligence, finding applications across various domains. However, their reliance on massive internet-sourced datasets for training brings notable privacy…

Cryptography and Security · Computer Science 2025-02-11 Michele Miranda , Elena Sofia Ruzzetti , Andrea Santilli , Fabio Massimo Zanzotto , Sébastien Bratières , Emanuele Rodolà

Pre-trained language models (PLMs) have demonstrated significant proficiency in solving a wide range of general natural language processing (NLP) tasks. Researchers have observed a direct correlation between the performance of these models…

Computation and Language · Computer Science 2024-04-12 Kennedy Edemacu , Xintao Wu

The widespread availability of large-scale code datasets has fueled the rapid development of large language models (LLMs) for code-related tasks. These datasets may include sensitive personally identifiable information (PII), which can lead…

Software Engineering · Computer Science 2026-05-18 Yifei Ge , Zhenpeng Chen , Weisong Sun , Yuchen Chen , Chunrong Fang , Juan Zhai , Xiaofang Zhang , Xia Feng , Yang Liu , Zhenyu Chen

Large language models (LLMs) are rapidly being adopted for tasks like drafting emails, summarizing meetings, and answering health questions. In these settings, users may need to share private information (e.g., contact details, health…

Computation and Language · Computer Science 2026-01-16 Xiaoyuan Wu , Roshni Kaushik , Wenkai Li , Lujo Bauer , Koichi Onoue

Recent advances in Retrieval-Augmented Generation (RAG) have enabled large language models (LLMs) to ground outputs in clinical evidence. However, connecting LLMs with external databases introduces the risk of contextual leakage: a subtle…

Computation and Language · Computer Science 2026-03-17 Shaowei Guan , Yu Zhai , Hin Chi Kwok , Jiawei Du , Xinyu Feng , Jing Li , Harry Qin , Vivian Hui

The emergence of large language models (LLMs), and their increased use in user-facing systems, has led to substantial privacy concerns. To date, research on these privacy concerns has been model-centered: exploring how LLMs lead to privacy…

Human-Computer Interaction · Computer Science 2024-02-06 Tianshi Li , Sauvik Das , Hao-Ping Lee , Dakuo Wang , Bingsheng Yao , Zhiping Zhang

The number and dynamic nature of web and mobile applications presents significant challenges for assessing their compliance with data protection laws. In this context, symbolic and statistical Natural Language Processing (NLP) techniques…

Computation and Language · Computer Science 2025-12-22 David Rodriguez , Ian Yang , Jose M. Del Alamo , Norman Sadeh

Large Language Models (LLMs) have revolutionized how information are collected, aggregated, and reasoned. However, this enables a novel and accessible vector of privacy intrusion: the automated and in-depth personal profiling; this…

Cryptography and Security · Computer Science 2026-05-08 Jiahao Chen , Qi Zhang , Ruixiao Lin , Chunyi Zhou , Tianyu Du , Qingming Li , Tong Zhang , Junhao Li , Yuwen Pu , Shouling Ji