English
Related papers

Related papers: Agentic Privacy-Preserving Machine Learning

200 papers

The widespread adoption of Artificial Intelligence (AI) has been driven by significant advances in intelligent system research. However, this progress has raised concerns about data privacy, leading to a growing awareness of the need for…

Machine Learning · Computer Science 2025-05-06 Md. Tanzib Hosain , Asif Zaman , Md. Shahriar Sajid , Shadman Sakeeb Khan , Shanjida Akter

Privacy policies are often obfuscated by their complexity, which impedes transparency and informed consent. Conventional machine learning approaches for automatically analyzing these policies demand significant resources and substantial…

Computation and Language · Computer Science 2024-09-24 Arda Goknil , Femke B. Gelderblom , Simeon Tverdal , Shukun Tokas , Hui Song

Large language model (LLM) agents are increasingly deployed in personalized tasks involving sensitive, context-dependent information, where privacy violations may arise in agents' action due to the implicitness of contextual privacy.…

Computation and Language · Computer Science 2026-02-17 Yuhan Cheng , Hancheng Ye , Hai Helen Li , Jingwei Sun , Yiran Chen

State-of-the-art large language models (LLMs) are typically deployed as online services, requiring users to transmit detailed prompts to cloud servers. This raises significant privacy concerns. In response, we introduce ConfusionPrompt, a…

Cryptography and Security · Computer Science 2026-04-09 Peihua Mai , Youjia Yang , Ran Yan , Rui Ye , Yan Pang

Agentic AI systems -- Large Language Models (LLMs) augmented with planning, tool use, memory, and long-horizon interactions -- can execute complex tasks autonomously, but their multi-step trajectories introduce new failure modes that…

Artificial Intelligence · Computer Science 2026-05-26 Jinhu Qi , Muzhi Li , Jiahong Liu , Yuqin Shu , Dianzhi Yu , Shicheng Ma , Wenqian Cui , Yiyang Zhao , Yiyi Chen , Ruoxi Jiang , Irwin King , Zenglin Xu

The interactive use of large language models (LLMs) in AI assistants (at work, home, etc.) introduces a new set of inference-time privacy risks: LLMs are fed different types of information from multiple sources in their inputs and are…

Artificial Intelligence · Computer Science 2024-07-02 Niloofar Mireshghallah , Hyunwoo Kim , Xuhui Zhou , Yulia Tsvetkov , Maarten Sap , Reza Shokri , Yejin Choi

Privacy-preserving machine learning (PPML) aims at enabling machine learning (ML) algorithms to be used on sensitive data. We contribute to this line of research by proposing a framework that allows efficient and secure evaluation of…

Cryptography and Security · Computer Science 2021-06-07 Nuttapong Attrapadung , Koki Hamada , Dai Ikarashi , Ryo Kikuchi , Takahiro Matsuda , Ibuki Mishina , Hiraku Morita , Jacob C. N. Schuldt

The widespread usage of online Large Language Models (LLMs) inference services has raised significant privacy concerns about the potential exposure of private information in user inputs to malicious eavesdroppers. Existing privacy…

Cryptography and Security · Computer Science 2025-05-29 Ziqian Zeng , Jianwei Wang , Junyao Yang , Zhengdong Lu , Haoran Li , Huiping Zhuang , Cen Chen

Large language models (LLMs) have shown promising potential for next Point-of-Interest (POI) recommendation. However, existing methods only perform direct zero-shot prompting, leading to ineffective extraction of user preferences,…

Information Retrieval · Computer Science 2024-12-12 Ziqing Wu , Zhu Sun , Dongxia Wang , Lu Zhang , Jie Zhang , Yew Soon Ong

Large language models (LLMs) are excellent few-shot learners. They can perform a wide variety of tasks purely based on natural language prompts provided to them. These prompts contain data of a specific downstream task -- often the private…

Machine Learning · Computer Science 2024-11-19 Haonan Duan , Adam Dziedzic , Mohammad Yaghini , Nicolas Papernot , Franziska Boenisch

With the increasing adoption of data-hungry machine learning algorithms, personal data privacy has emerged as one of the key concerns that could hinder the success of digital transformation. As such, Privacy-Preserving Machine Learning…

Cryptography and Security · Computer Science 2022-04-22 Ziyao Liu , Jiale Guo , Kwok-Yan Lam , Jun Zhao

When users submit queries to Large Language Models (LLMs), their prompts can often contain sensitive data, forcing a difficult choice: Send the query to a powerful proprietary LLM providers to achieving state-of-the-art performance and risk…

Cryptography and Security · Computer Science 2026-04-21 Zheng Hui , Yijiang River Dong , Sanhanat Sivapiromrat , Ehsan Shareghi , Nigel Collier

The rapid development of language models (LMs) brings unprecedented accessibility and usage for both models and users. On the one hand, powerful LMs achieve state-of-the-art performance over numerous downstream NLP tasks. On the other hand,…

Computation and Language · Computer Science 2024-06-04 Haoran Li , Dadi Guo , Donghao Li , Wei Fan , Qi Hu , Xin Liu , Chunkit Chan , Duanyi Yao , Yuan Yao , Yangqiu Song

With the recent emergence of revolutionary autonomous agentic systems, research community is witnessing a significant shift from traditional static, passive, and domain-specific AI agents toward more dynamic, proactive, and generalizable…

Computer Vision and Pattern Recognition · Computer Science 2025-10-14 Huanjin Yao , Ruifei Zhang , Jiaxing Huang , Jingyi Zhang , Yibo Wang , Bo Fang , Ruolin Zhu , Yongcheng Jing , Shunyu Liu , Guanbin Li , Dacheng Tao

Users interacting with large language models (LLMs) under their real identifiers often unknowingly risk disclosing private information. Automatically notifying users whether their queries leak privacy and which phrases leak what private…

Computation and Language · Computer Science 2025-08-11 Hang Zeng , Xiangyu Liu , Yong Hu , Chaoyue Niu , Fan Wu , Shaojie Tang , Guihai Chen

As Large Language Models (LLMs) proliferate, developing privacy safeguards for these models is crucial. One popular safeguard involves training LLMs in a differentially private manner. However, such solutions are shown to be computationally…

Machine Learning · Computer Science 2024-10-04 James Flemings , Meisam Razaviyayn , Murali Annavaram

Machine learning models should not reveal particular information that is not otherwise accessible. Differential privacy provides a formal framework to mitigate privacy risks by ensuring that the inclusion or exclusion of any single data…

Cryptography and Security · Computer Science 2026-03-12 Francisco Aguilera-Martínez , Fernando Berzal

Recent privacy research on large language models (LLMs) has shown that they achieve near-human-level performance at inferring personal data from online texts. With ever-increasing model capabilities, existing text anonymization methods are…

Artificial Intelligence · Computer Science 2025-02-04 Robin Staab , Mark Vero , Mislav Balunović , Martin Vechev

Pre-trained Large Language Models (LLMs) are an integral part of modern AI that have led to breakthrough performances in complex AI tasks. Major AI companies with expensive infrastructures are able to develop and train these large models…

Cryptography and Security · Computer Science 2023-05-02 Rouzbeh Behnia , Mohamamdreza Ebrahimi , Jason Pacheco , Balaji Padmanabhan

The emergence of ChatGPT marks the arrival of the large language model (LLM) era. While LLMs demonstrate their power in a variety of fields, they also raise serious privacy concerns as the users' queries are sent to the model provider. On…

Cryptography and Security · Computer Science 2024-05-30 Fei Zheng , Chaochao Chen , Zhongxuan Han , Xiaolin Zheng