English
Related papers

Related papers: Contextual Integrity in LLMs via Reasoning and Rei…

200 papers

While Large Language Models (LLMs) exhibit remarkable capabilities, they also introduce significant safety and privacy risks. Current mitigation strategies often fail to preserve contextual reasoning capabilities in risky scenarios.…

Computation and Language · Computer Science 2025-09-05 Wenbin Hu , Haoran Li , Huihao Jing , Qi Hu , Ziqian Zeng , Sirui Han , Heli Xu , Tianshu Chu , Peizhao Hu , Yangqiu Song

Advanced AI assistants combine frontier LLMs and tool access to autonomously perform complex tasks on behalf of users. While the helpfulness of such assistants can increase dramatically with access to user information including emails and…

Machine learning community is discovering Contextual Integrity (CI) as a useful framework to assess the privacy implications of large language models (LLMs). This is an encouraging development. The CI theory emphasizes sharing information…

Computers and Society · Computer Science 2025-05-16 Yan Shvartzshnaider , Vasisht Duddu

Individuals' concerns about data privacy and AI safety are highly contextualized and extend beyond sensitive patterns. Addressing these issues requires reasoning about the context to identify and mitigate potential risks. Though researchers…

Computation and Language · Computer Science 2026-04-15 Haoran Li , Yulin Chen , Huihao Jing , Wenbin Hu , Tsz Ho Li , Chanhou Lou , Hong Ting Tsang , Sirui Han , Yangqiu Song

Contextual Integrity (CI) defines privacy not merely as keeping information hidden, but as governing information flows according to the norms of a given context. As large language models are increasingly deployed as personal agents handling…

Machine Learning · Computer Science 2026-05-21 Sangwoo Park , Woongyeong Yeo , Seanie Lee , Yumin Choi , Hyomin Lee , Kangsan Kim , Jinheon Baek , Seong Joon Oh , Sung Ju Hwang

Information handling practices of LLM agents are broadly misaligned with the contextual privacy expectations of their users. Contextual Integrity (CI) provides a principled framework, defining privacy as the appropriate flow of information…

Machine Learning · Computer Science 2026-04-24 Matt Franchi , Madiha Zahrah Choksi , Harold Triedman , Helen Nissenbaum

Reinforcement learning (RL) has produced spectacular results in games, robotics, and continuous control. Yet, despite these successes, learned policies often fail to generalize beyond their training distribution, limiting real-world impact.…

Machine Learning · Computer Science 2026-04-06 André Biedenkapp

Enterprise LLM agents can dramatically improve workplace productivity, but their core capability, retrieving and using internal context to act on a user's behalf, also creates new risks for sensitive information leakage. We introduce…

Cryptography and Security · Computer Science 2026-04-24 Wenjie Fu , Xiaoting Qin , Jue Zhang , Qingwei Lin , Lukas Wutschitz , Robert Sim , Saravan Rajmohan , Dongmei Zhang

Recent advancements in generative large language models (LLMs) have enabled wider applicability, accessibility, and flexibility. However, their reliability and trustworthiness are still in doubt, especially for concerns regarding…

Computation and Language · Computer Science 2025-05-26 Haoran Li , Wenbin Hu , Huihao Jing , Yulin Chen , Qi Hu , Sirui Han , Tianshu Chu , Peizhao Hu , Yangqiu Song

When users submit queries to Large Language Models (LLMs), their prompts can often contain sensitive data, forcing a difficult choice: Send the query to a powerful proprietary LLM providers to achieving state-of-the-art performance and risk…

Cryptography and Security · Computer Science 2026-04-21 Zheng Hui , Yijiang River Dong , Sanhanat Sivapiromrat , Ehsan Shareghi , Nigel Collier

Addressing contextual privacy concerns remains challenging in interactive settings where large language models (LLMs) process information from multiple sources (e.g., summarizing meetings with private and public information). We introduce a…

Artificial Intelligence · Computer Science 2026-02-26 Wenkai Li , Liwen Sun , Zhenxiang Guan , Xuhui Zhou , Maarten Sap

Large language models (LLMs) are increasingly deployed in high-stakes settings, yet they frequently violate contextual privacy by disclosing private information in situations where humans would exercise discretion. This raises a fundamental…

Computation and Language · Computer Science 2026-04-02 Haoran Wang , Li Xiong , Kai Shu

While Reinforcement Learning ( RL) has made great strides towards solving increasingly complicated problems, many algorithms are still brittle to even slight environmental changes. Contextual Reinforcement Learning (cRL) provides a…

The rise of reinforcement learning (RL) in critical real-world applications demands a fundamental rethinking of privacy in AI systems. Traditional privacy frameworks, designed to protect isolated data points, fall short for sequential…

Machine Learning · Computer Science 2025-06-19 Flint Xiaofeng Fan , Cheston Tan , Roger Wattenhofer , Yew-Soon Ong

The interactive use of large language models (LLMs) in AI assistants (at work, home, etc.) introduces a new set of inference-time privacy risks: LLMs are fed different types of information from multiple sources in their inputs and are…

Artificial Intelligence · Computer Science 2024-07-02 Niloofar Mireshghallah , Hyunwoo Kim , Xuhui Zhou , Yulia Tsvetkov , Maarten Sap , Reza Shokri , Yejin Choi

Continuous Integration (CI) significantly reduces integration problems, speeds up development time, and shortens release time. However, it also introduces new challenges for quality assurance activities, including regression testing, which…

Software Engineering · Computer Science 2021-03-29 Mojtaba Bagherzadeh , Nafiseh Kahani , Lionel Briand

Reinforcement Learning (RL) is a learning paradigm in which the agent learns from its environment through trial and error. Deep reinforcement learning (DRL) algorithms represent the agent's policies using neural networks, making their…

Artificial Intelligence · Computer Science 2024-09-10 Jasmina Gajcin , Jovan Jeromela , Ivana Dusparic

The multicontextual nature of immersive VR makes it difficult to ensure contextual integrity of VR-generated information flows using existing privacy design and policy mechanisms. In this position paper, we call on the HCI community to do…

Computers and Society · Computer Science 2023-03-27 Karoline Brehm , Yan Shvartzshnaider , David Goedicke

Prompt injection is the most critical vulnerability in deployed AI agents. Despite recent progress, we show that the prevailing defense paradigm (data-instruction separation) both fails to detect attacks that operate through contextual…

Cryptography and Security · Computer Science 2026-05-19 Sahar Abdelnabi , Eugene Bagdasarian

In-context learning (ICL) of large language models (LLMs) has attracted increasing attention in the community where LLMs make predictions only based on instructions augmented with a few examples. Existing example selection methods for ICL…

Computation and Language · Computer Science 2024-08-26 Haowei Du , Dongyan Zhao
‹ Prev 1 2 3 10 Next ›