English
Related papers

Related papers: Got a Secret? LLM Agents Can't Keep It: Evaluating…

200 papers

Language model (LM) agents that act on users' behalf for personal tasks (e.g., replying emails) can boost productivity, but are also susceptible to unintended privacy leakage risks. We present the first study on people's capacity to oversee…

Human-Computer Interaction · Computer Science 2025-10-07 Zhiping Zhang , Bingcan Guo , Tianshi Li

LLM agents have begun to appear as personal assistants, customer service bots, and clinical aides. While these applications deliver substantial operational benefits, they also require continuous access to sensitive data, which increases the…

Cryptography and Security · Computer Science 2025-09-30 Saswat Das , Jameson Sandler , Ferdinando Fioretto

The widespread deployment of LLM-based agents is likely to introduce a critical privacy threat: malicious agents that proactively engage others in multi-turn interactions to extract sensitive information. However, the evolving nature of…

Cryptography and Security · Computer Science 2026-05-11 Yanzhe Zhang , Diyi Yang

Multi-agent Large Language Model (LLM) systems create privacy risks that current benchmarks cannot measure. When agents coordinate on tasks, sensitive data passes through inter-agent messages, shared memory, and tool arguments, all pathways…

Artificial Intelligence · Computer Science 2026-03-31 Faouzi El Yagoubi , Godwin Badu-Marfo , Ranwa Al Mallah

The proliferation of LLM-based agents has led to increasing deployment of inter-agent collaboration for tasks like scheduling, negotiation, resource allocation etc. In such systems, privacy is critical, as agents often access proprietary…

Artificial Intelligence · Computer Science 2025-06-27 Gurusha Juneja , Alon Albalak , Wenyue Hua , William Yang Wang

With the rise of personalized, persistent LLM agent frameworks such as OpenClaw, human-centered agentic social networks in which teams of collaborative AI agents serve individual users in a social network across multiple domains are…

Artificial Intelligence · Computer Science 2026-04-07 Prince Zizhuang Wang , Shuli Jiang

Large language model (LLM)-based agents combine LLMs with external tools to automate tasks such as scheduling meetings, managing documents, or booking travel. While these integrations unlock powerful capabilities, they also create new and…

Cryptography and Security · Computer Science 2026-04-22 Jonathan Evertz , Merlin Chlosta , Lea Schönherr , Thorsten Eisenhofer

The interactive nature of Large Language Models (LLMs), which closely track user data and context, has prompted users to share personal and private information in unprecedented ways. Even when users opt out of allowing their data to be used…

Cryptography and Security · Computer Science 2025-08-26 GodsGift Uzor , Hasan Al-Qudah , Ynes Ineza , Abdul Serwadda

The interactive use of large language models (LLMs) in AI assistants (at work, home, etc.) introduces a new set of inference-time privacy risks: LLMs are fed different types of information from multiple sources in their inputs and are…

Artificial Intelligence · Computer Science 2024-07-02 Niloofar Mireshghallah , Hyunwoo Kim , Xuhui Zhou , Yulia Tsvetkov , Maarten Sap , Reza Shokri , Yejin Choi

Personalized AI agents rely on access to a user's digital footprint, which often includes sensitive data from private emails, chats and purchase histories. Yet this access creates a fundamental societal and privacy risk: systems lacking…

Computation and Language · Computer Science 2026-01-01 Srija Mukhopadhyay , Sathwik Reddy , Shruthi Muthukumar , Jisun An , Ponnurangam Kumaraguru

The discourse on privacy risks in Large Language Models (LLMs) has disproportionately focused on verbatim memorization of training data, while a constellation of more immediate and scalable privacy threats remain underexplored. This…

Cryptography and Security · Computer Science 2025-10-03 Niloofar Mireshghallah , Tianshi Li

With the rapid progress of large language models (LLMs), many downstream NLP tasks can be well solved given appropriate prompts. Though model developers and researchers work hard on dialog safety to avoid generating harmful content from…

Computation and Language · Computer Science 2023-11-02 Haoran Li , Dadi Guo , Wei Fan , Mingshi Xu , Jie Huang , Fanpu Meng , Yangqiu Song

Addressing contextual privacy concerns remains challenging in interactive settings where large language models (LLMs) process information from multiple sources (e.g., summarizing meetings with private and public information). We introduce a…

Artificial Intelligence · Computer Science 2026-02-26 Wenkai Li , Liwen Sun , Zhenxiang Guan , Xuhui Zhou , Maarten Sap

Recent improvement gains in large language models (LLMs) have lead to everyday usage of AI-based Conversational Agents (CAs). At the same time, LLMs are vulnerable to an array of threats, including jailbreaks and, for example, causing…

Cryptography and Security · Computer Science 2025-11-03 Kathrin Grosse , Nico Ebert

Sequential multi-agent large language model (LLM) systems are increasingly deployed in sensitive domains such as healthcare, finance, and enterprise decision-making, where multiple specialized agents collaboratively process a single user…

Multiagent Systems · Computer Science 2026-03-09 Sadia Asif , Mohammad Mohammadi Amiri

A core challenge for autonomous LLM agents in collaborative settings is balancing robust privacy understanding and preservation alongside task efficacy. Existing privacy benchmarks only focus on simplistic, single-turn interactions where…

Cryptography and Security · Computer Science 2025-10-20 Gurusha Juneja , Jayanth Naga Sai Pasupulati , Alon Albalak , Wenyue Hua , William Yang Wang

As language models (LMs) are widely utilized in personalized communication scenarios (e.g., sending emails, writing social media posts) and endowed with a certain level of agency, ensuring they act in accordance with the contextual privacy…

Computation and Language · Computer Science 2025-03-17 Yijia Shao , Tianshi Li , Weiyan Shi , Yanchen Liu , Diyi Yang

Large Language Models (LLMs) are increasingly deployed in mental health contexts, from structured therapeutic support tools to informal chat-based well-being assistants. While these systems increase accessibility, scalability, and…

Human-Computer Interaction · Computer Science 2025-10-14 Soraya S. Anvari , Rina R. Wehbe

Agentic AI systems -- Large Language Models (LLMs) augmented with planning, tool use, memory, and long-horizon interactions -- can execute complex tasks autonomously, but their multi-step trajectories introduce new failure modes that…

Artificial Intelligence · Computer Science 2026-05-26 Jinhu Qi , Muzhi Li , Jiahong Liu , Yuqin Shu , Dianzhi Yu , Shicheng Ma , Wenqian Cui , Yiyang Zhao , Yiyi Chen , Ruoxi Jiang , Irwin King , Zenglin Xu

Large Language Models (LLMs) are increasingly deployed as agents that orchestrate tasks and integrate external tools to execute complex workflows. We demonstrate that these interactive behaviors leave distinctive fingerprints in encrypted…

Cryptography and Security · Computer Science 2025-10-09 Yixiang Zhang , Xinhao Deng , Zhongyi Gu , Yihao Chen , Ke Xu , Qi Li , Jianping Wu
‹ Prev 1 2 3 10 Next ›