English
Related papers

Related papers: MAGPIE: A benchmark for Multi-AGent contextual PrI…

200 papers

Multi-agent systems achieve state-of-the-art outcomes through peer collaboration. However, when an agent in the pipeline silently drops a constraint, the system's final output may look correct even though the reasoning chain was quietly…

Recent advancements in generative large language models (LLMs) have enabled wider applicability, accessibility, and flexibility. However, their reliability and trustworthiness are still in doubt, especially for concerns regarding…

Computation and Language · Computer Science 2025-05-26 Haoran Li , Wenbin Hu , Huihao Jing , Yulin Chen , Qi Hu , Sirui Han , Tianshu Chu , Peizhao Hu , Yangqiu Song

Multi-agent collaboration systems (MACS), powered by large language models (LLMs), solve complex problems efficiently by leveraging each agent's specialization and communication between agents. However, the inherent exchange of information…

Cryptography and Security · Computer Science 2026-03-04 Jian Cui , Zichuan Li , Luyi Xing , Xiaojing Liao

Personalized AI agents rely on access to a user's digital footprint, which often includes sensitive data from private emails, chats and purchase histories. Yet this access creates a fundamental societal and privacy risk: systems lacking…

Computation and Language · Computer Science 2026-01-01 Srija Mukhopadhyay , Sathwik Reddy , Shruthi Muthukumar , Jisun An , Ponnurangam Kumaraguru

As language models (LMs) are widely utilized in personalized communication scenarios (e.g., sending emails, writing social media posts) and endowed with a certain level of agency, ensuring they act in accordance with the contextual privacy…

Computation and Language · Computer Science 2025-03-17 Yijia Shao , Tianshi Li , Weiyan Shi , Yanchen Liu , Diyi Yang

LLM agents have begun to appear as personal assistants, customer service bots, and clinical aides. While these applications deliver substantial operational benefits, they also require continuous access to sensitive data, which increases the…

Cryptography and Security · Computer Science 2025-09-30 Saswat Das , Jameson Sandler , Ferdinando Fioretto

As Large Language Models (LLMs) become increasingly autonomous and integrated into critical societal functions, the focus of AI safety must evolve from mitigating harmful content to evaluating underlying behavioral alignment. Current safety…

Artificial Intelligence · Computer Science 2025-08-14 Manuel Herrador

Large language models (LLMs) are rapidly being adopted for tasks like drafting emails, summarizing meetings, and answering health questions. In these settings, users may need to share private information (e.g., contact details, health…

Computation and Language · Computer Science 2026-01-16 Xiaoyuan Wu , Roshni Kaushik , Wenkai Li , Lujo Bauer , Koichi Onoue

While AI agents hold transformative potential in business, effective performance benchmarking is hindered by the scarcity of public, realistic business data on widely used platforms. Existing benchmarks often lack fidelity in their…

LLM agents increasingly have access to private user data and act on the user's behalf when interacting with third-party systems. The user defines what may and must not be shared, and the agent must robustly follow that intent even when…

Artificial Intelligence · Computer Science 2026-05-20 Qiaoyuan Zheng , Yiqu Yang , Qi Gao , Imanol Schlag

As Vision-Language Models (VLMs) are increasingly deployed as autonomous cognitive cores for embodied assistants, evaluating their privacy awareness in physical environments becomes critical. Unlike digital chatbots, these agents operate in…

Cryptography and Security · Computer Science 2026-05-11 Junran Wang , Xinjie Shen , Zehao Jin , Pan Li

As AI agents increasingly operate in complex environments, ensuring reliable, context-aware privacy is critical for regulatory compliance. Traditional access controls are insufficient because privacy risks often arise after access is…

Users interacting with large language models (LLMs) under their real identifiers often unknowingly risk disclosing private information. Automatically notifying users whether their queries leak privacy and which phrases leak what private…

Computation and Language · Computer Science 2025-08-11 Hang Zeng , Xiangyu Liu , Yong Hu , Chaoyue Niu , Fan Wu , Shaojie Tang , Guihai Chen

Large language model (LLM) agents are increasingly deployed in personalized tasks involving sensitive, context-dependent information, where privacy violations may arise in agents' action due to the implicitness of contextual privacy.…

Computation and Language · Computer Science 2026-02-17 Yuhan Cheng , Hancheng Ye , Hai Helen Li , Jingwei Sun , Yiran Chen

As language-model agents evolve from passive chatbots into proactive assistants that handle personal data, evaluating their adherence to social norms becomes increasingly critical, often through the lens of Contextual Integrity (CI).…

Artificial Intelligence · Computer Science 2026-01-27 Shouju Wang , Haopeng Zhang

The interactive use of large language models (LLMs) in AI assistants (at work, home, etc.) introduces a new set of inference-time privacy risks: LLMs are fed different types of information from multiple sources in their inputs and are…

Artificial Intelligence · Computer Science 2024-07-02 Niloofar Mireshghallah , Hyunwoo Kim , Xuhui Zhou , Yulia Tsvetkov , Maarten Sap , Reza Shokri , Yejin Choi

Sequential multi-agent large language model (LLM) systems are increasingly deployed in sensitive domains such as healthcare, finance, and enterprise decision-making, where multiple specialized agents collaboratively process a single user…

Multiagent Systems · Computer Science 2026-03-09 Sadia Asif , Mohammad Mohammadi Amiri

LLM agents increasingly draft messages on behalf of users, yet users routinely overshare sensitive information and disagree on what counts as private. Existing systems support only suppression (omitting sensitive information) and…

Cryptography and Security · Computer Science 2026-04-09 Yunze Xiao , Wenkai Li , Xiaoyuan Wu , Ningshan Ma , Yueqi Song , Weihao Xuan

Agentic AI systems -- Large Language Models (LLMs) augmented with planning, tool use, memory, and long-horizon interactions -- can execute complex tasks autonomously, but their multi-step trajectories introduce new failure modes that…

Artificial Intelligence · Computer Science 2026-05-26 Jinhu Qi , Muzhi Li , Jiahong Liu , Yuqin Shu , Dianzhi Yu , Shicheng Ma , Wenqian Cui , Yiyang Zhao , Yiyi Chen , Ruoxi Jiang , Irwin King , Zenglin Xu

The rapid integration of AI-powered coding assistants into developer workflows has raised significant privacy and trust concerns. As developers entrust proprietary code to services like OpenAI's GPT, Google's Gemini, and GitHub Copilot, the…

Cryptography and Security · Computer Science 2025-09-26 Amir AL-Maamari