English
Related papers

Related papers: Protecting Users From Themselves: Safeguarding Con…

200 papers

Sensitive information, such as knowledge about an individual's personality, can be can be misused to influence behavior (e.g., via personalized messaging). To assess to what extent an individual's personality can be inferred from user…

Computation and Language · Computer Science 2026-05-05 Derya Cögendez , Verena Zimmermann , Noé Zufferey

Individuals' concerns about data privacy and AI safety are highly contextualized and extend beyond sensitive patterns. Addressing these issues requires reasoning about the context to identify and mitigate potential risks. Though researchers…

Computation and Language · Computer Science 2026-04-15 Haoran Li , Yulin Chen , Huihao Jing , Wenbin Hu , Tsz Ho Li , Chanhou Lou , Hong Ting Tsang , Sirui Han , Yangqiu Song

Large language models (LLMs) have demonstrated exceptional capabilities in text understanding and generation, and they are increasingly being utilized across various domains to enhance productivity. However, due to the high costs of…

Cryptography and Security · Computer Science 2024-11-05 Yu Mao , Xueping Liao , Wei Liu , Anjia Yang

Large language models (LLMs) are increasingly deployed in high-stakes settings, yet they frequently violate contextual privacy by disclosing private information in situations where humans would exercise discretion. This raises a fundamental…

Computation and Language · Computer Science 2026-04-02 Haoran Wang , Li Xiong , Kai Shu

Language model (LM) agents that act on users' behalf for personal tasks (e.g., replying emails) can boost productivity, but are also susceptible to unintended privacy leakage risks. We present the first study on people's capacity to oversee…

Human-Computer Interaction · Computer Science 2025-10-07 Zhiping Zhang , Bingcan Guo , Tianshi Li

An increasing number of companies have begun providing services that leverage cloud-based large language models (LLMs), such as ChatGPT. However, this development raises substantial privacy concerns, as users' prompts are transmitted to and…

Cryptography and Security · Computer Science 2025-02-24 Shilong Hou , Ruilin Shang , Zi Long , Xianghua Fu , Yin Chen

As large language models (LLMs) are integrated into sociotechnical systems, it is crucial to examine the privacy biases they exhibit. We define privacy bias as the appropriateness value of information flows in responses from LLMs. A…

Machine Learning · Computer Science 2025-12-22 Yan Shvartzshnaider , Vasisht Duddu

Conversational agents (CAs) (e.g., chatbots) are increasingly used in settings where users disclose sensitive information, raising significant privacy concerns. Because privacy judgments are highly contextual, supporting users to engage in…

Human-Computer Interaction · Computer Science 2026-01-27 Mohammad Hadi Nezhad , Francisco Enrique Vicente Castro , Ivon Arroyo

Recent advancements in generative large language models (LLMs) have enabled wider applicability, accessibility, and flexibility. However, their reliability and trustworthiness are still in doubt, especially for concerns regarding…

Computation and Language · Computer Science 2025-05-26 Haoran Li , Wenbin Hu , Huihao Jing , Yulin Chen , Qi Hu , Sirui Han , Tianshu Chu , Peizhao Hu , Yangqiu Song

As Large Language Models (LLMs) are increasingly deployed in sensitive domains such as enterprise and government, ensuring that they adhere to user-defined security policies within context is critical-especially with respect to information…

Computation and Language · Computer Science 2025-09-17 Hwan Chang , Yumin Kim , Yonghyun Jun , Hwanhee Lee

Individuals are increasingly relying on large language model (LLM)-enabled conversational agents for emotional support. While prior research has examined privacy and security issues in chatbots specifically designed for mental health…

Computers and Society · Computer Science 2025-07-16 Jabari Kwesi , Jiaxun Cao , Riya Manchanda , Pardis Emami-Naeini

Conversational AI interfaces powered by large language models (LLMs) are increasingly used as coding assistants. However, questions remain about how programmers interact with LLM-based conversational agents, the challenges they encounter,…

Human-Computer Interaction · Computer Science 2025-03-24 Mehmet Akhoroz , Caglar Yildirim

Advanced AI assistants combine frontier LLMs and tool access to autonomously perform complex tasks on behalf of users. While the helpfulness of such assistants can increase dramatically with access to user information including emails and…

Large Language Models (LLMs) are increasingly vulnerable to sophisticated multi-turn manipulation attacks, where adversaries strategically build context through seemingly benign conversational turns to circumvent safety measures and elicit…

Cryptography and Security · Computer Science 2025-03-21 Prashant Kulkarni , Assaf Namer

Numerous companies have started offering services based on large language models (LLM), such as ChatGPT, which inevitably raises privacy concerns as users' prompts are exposed to the model provider. Previous research on secure reasoning…

Cryptography and Security · Computer Science 2023-09-07 Yu Chen , Tingxin Li , Huiming Liu , Yang Yu

State-of-the-art large language models (LLMs) are typically deployed as online services, requiring users to transmit detailed prompts to cloud servers. This raises significant privacy concerns. In response, we introduce ConfusionPrompt, a…

Cryptography and Security · Computer Science 2026-04-09 Peihua Mai , Youjia Yang , Ran Yan , Rui Ye , Yan Pang

With the rise of personalized, persistent LLM agent frameworks such as OpenClaw, human-centered agentic social networks in which teams of collaborative AI agents serve individual users in a social network across multiple domains are…

Artificial Intelligence · Computer Science 2026-04-07 Prince Zizhuang Wang , Shuli Jiang

LLM agents increasingly act on users' personal information, yet existing privacy defenses remain limited in both design and adaptability. Most prior approaches rely on static or passive defenses, such as prompting and guarding. These…

Cryptography and Security · Computer Science 2026-03-04 Yule Wen , Yanzhe Zhang , Jianxun Lian , Xiaoyuan Yi , Xing Xie , Diyi Yang

When users submit queries to Large Language Models (LLMs), their prompts can often contain sensitive data, forcing a difficult choice: Send the query to a powerful proprietary LLM providers to achieving state-of-the-art performance and risk…

Cryptography and Security · Computer Science 2026-04-21 Zheng Hui , Yijiang River Dong , Sanhanat Sivapiromrat , Ehsan Shareghi , Nigel Collier

Large Language Models (LLMs) have achieved remarkable progress in natural language understanding, reasoning, and autonomous decision-making. However, these advancements have also come with significant privacy concerns. While significant…

Cryptography and Security · Computer Science 2026-01-27 Yuntao Du , Zitao Li , Ninghui Li , Bolin Ding