English
Related papers

Related papers: Got a Secret? LLM Agents Can't Keep It: Evaluating…

200 papers

LLM agents increasingly draft messages on behalf of users, yet users routinely overshare sensitive information and disagree on what counts as private. Existing systems support only suppression (omitting sensitive information) and…

Cryptography and Security · Computer Science 2026-04-09 Yunze Xiao , Wenkai Li , Xiaoyuan Wu , Ningshan Ma , Yueqi Song , Weihao Xuan

Large language models (LLMs) and AI agents are increasingly integrated into enterprise systems to access internal databases and generate context-aware responses. While such integration improves productivity and decision support, the model…

Cryptography and Security · Computer Science 2026-03-19 Ya-Ting Yang , Quanyan Zhu

LLM agents require personal information for personalization in order to effectively act on users' behalf, but this raises privacy concerns that can discourage data sharing, limiting both the autonomy levels at which agents can operate and…

Human-Computer Interaction · Computer Science 2026-04-07 Zhiping Zhang , Yi Evie Zhang , Freda Shi , Tianshi Li

The increasing autonomy of LLM agents in handling sensitive communications, accelerated by Model Context Protocol (MCP) and Agent-to-Agent (A2A) frameworks, creates urgent privacy challenges. While recent work reveals significant gaps…

Cryptography and Security · Computer Science 2025-09-23 Shouju Wang , Fenglin Yu , Xirui Liu , Xiaoting Qin , Jue Zhang , Qingwei Lin , Dongmei Zhang , Saravan Rajmohan

Autonomous AI agents that can follow instructions and perform complex multi-step tasks have tremendous potential to boost human productivity. However, to perform many of these tasks, the agents need access to personal information from their…

Artificial Intelligence · Computer Science 2025-10-03 Arman Zharmagambetov , Chuan Guo , Ivan Evtimov , Maya Pavlova , Ruslan Salakhutdinov , Kamalika Chaudhuri

Although Large Language Models (LLMs) have become increasingly integral to diverse applications, their capabilities raise significant privacy concerns. This survey offers a comprehensive overview of privacy risks associated with LLMs and…

Cryptography and Security · Computer Science 2025-05-06 Kang Chen , Xiuze Zhou , Yuanguo Lin , Shibo Feng , Li Shen , Pengcheng Wu

An increasing number of LLM-based applications are being developed to facilitate romantic relationships with AI partners, yet the safety and privacy risks in these partnerships remain largely underexplored. In this work, we investigate…

Human-Computer Interaction · Computer Science 2026-02-16 Rongjun Ma , Shijing He , Jose Luis Martin-Navarro , Xiao Zhan , Jose Such

Large language models (LLMs) are rapidly being adopted for tasks like drafting emails, summarizing meetings, and answering health questions. In these settings, users may need to share private information (e.g., contact details, health…

Computation and Language · Computer Science 2026-01-16 Xiaoyuan Wu , Roshni Kaushik , Wenkai Li , Lujo Bauer , Koichi Onoue

Users interacting with large language models (LLMs) under their real identifiers often unknowingly risk disclosing private information. Automatically notifying users whether their queries leak privacy and which phrases leak what private…

Computation and Language · Computer Science 2025-08-11 Hang Zeng , Xiangyu Liu , Yong Hu , Chaoyue Niu , Fan Wu , Shaojie Tang , Guihai Chen

As Large Language Model (LLM) agents become more capable, their coordinated use in the form of multi-agent systems is anticipated to emerge as a practical paradigm. Prior work has examined the safety and misuse risks associated with agents.…

Artificial Intelligence · Computer Science 2026-02-26 Akshat Naik , Jay Culligan , Yarin Gal , Philip Torr , Rahaf Aljundi , Alasdair Paren , Adel Bibi

Conversational agents are increasingly woven into individuals' personal lives, yet users often underestimate the privacy risks associated with them. The moment users share information with these agents-such as large language models…

Cryptography and Security · Computer Science 2025-07-29 Ivoline Ngong , Swanand Kadhe , Hao Wang , Keerthiram Murugesan , Justin D. Weisz , Amit Dhurandhar , Karthikeyan Natesan Ramamurthy

Personal AI agents like OpenClaw run with elevated privileges on users' local machines, where a single successful prompt injection can leak credentials, redirect financial transactions, or destroy files. This threat goes well beyond…

Artificial Intelligence · Computer Science 2026-04-07 Bowen Wei , Yunbei Zhang , Jinhao Pan , Kai Mei , Xiao Wang , Jihun Hamm , Ziwei Zhu , Yingqiang Ge

The widespread use of Large Language Model (LLM)-based conversational agents (CAs), especially in high-stakes domains, raises many privacy concerns. Building ethical LLM-based CAs that respect user privacy requires an in-depth understanding…

Human-Computer Interaction · Computer Science 2024-04-03 Zhiping Zhang , Michelle Jia , Hao-Ping Lee , Bingsheng Yao , Sauvik Das , Ada Lerner , Dakuo Wang , Tianshi Li

Large Language Model (LLM) agents have become increasingly prevalent across various real-world applications. They enhance decision-making by storing private user-agent interactions in the memory module for demonstrations, introducing new…

Cryptography and Security · Computer Science 2025-06-04 Bo Wang , Weiyi He , Shenglai Zeng , Zhen Xiang , Yue Xing , Jiliang Tang , Pengfei He

Individuals are increasingly relying on large language model (LLM)-enabled conversational agents for emotional support. While prior research has examined privacy and security issues in chatbots specifically designed for mental health…

Computers and Society · Computer Science 2025-07-16 Jabari Kwesi , Jiaxun Cao , Riya Manchanda , Pardis Emami-Naeini

The rapid advancement of conversational agents, particularly chatbots powered by Large Language Models (LLMs), poses a significant risk of social engineering (SE) attacks on social media platforms. SE detection in multi-turn, chat-based…

Large language model (LLM) agents are increasingly deployed in personalized tasks involving sensitive, context-dependent information, where privacy violations may arise in agents' action due to the implicitness of contextual privacy.…

Computation and Language · Computer Science 2026-02-17 Yuhan Cheng , Hancheng Ye , Hai Helen Li , Jingwei Sun , Yiran Chen

As AI agents increasingly operate in complex environments, ensuring reliable, context-aware privacy is critical for regulatory compliance. Traditional access controls are insufficient because privacy risks often arise after access is…

When users submit queries to Large Language Models (LLMs), their prompts can often contain sensitive data, forcing a difficult choice: Send the query to a powerful proprietary LLM providers to achieving state-of-the-art performance and risk…

Cryptography and Security · Computer Science 2026-04-21 Zheng Hui , Yijiang River Dong , Sanhanat Sivapiromrat , Ehsan Shareghi , Nigel Collier

The growing use of Machine Learning and Artificial Intelligence (AI), particularly Large Language Models (LLMs) like OpenAI's GPT series, leads to disruptive changes across organizations. At the same time, there is a growing concern about…