English
Related papers

Related papers: From Weak Cues to Real Identities: Evaluating Infe…

200 papers

Autonomous AI agents that can follow instructions and perform complex multi-step tasks have tremendous potential to boost human productivity. However, to perform many of these tasks, the agents need access to personal information from their…

Artificial Intelligence · Computer Science 2025-10-03 Arman Zharmagambetov , Chuan Guo , Ivan Evtimov , Maya Pavlova , Ruslan Salakhutdinov , Kamalika Chaudhuri

The increasing autonomy of LLM agents in handling sensitive communications, accelerated by Model Context Protocol (MCP) and Agent-to-Agent (A2A) frameworks, creates urgent privacy challenges. While recent work reveals significant gaps…

Cryptography and Security · Computer Science 2025-09-23 Shouju Wang , Fenglin Yu , Xirui Liu , Xiaoting Qin , Jue Zhang , Qingwei Lin , Dongmei Zhang , Saravan Rajmohan

As LLMs rapidly advance and enter real-world use, their privacy implications are increasingly important. We study an authorship de-anonymization threat: using LLMs to link anonymous documents to their authors, potentially compromising…

Cryptography and Security · Computer Science 2026-04-17 Lirui Zhang , Huishuai Zhang

The wide adoption and application of Masked language models~(MLMs) on sensitive data (from legal to medical) necessitates a thorough quantitative investigation into their privacy vulnerabilities -- to what extent do MLMs leak information…

Machine Learning · Computer Science 2022-11-07 Fatemehsadat Mireshghallah , Kartik Goyal , Archit Uniyal , Taylor Berg-Kirkpatrick , Reza Shokri

When users submit queries to Large Language Models (LLMs), their prompts can often contain sensitive data, forcing a difficult choice: Send the query to a powerful proprietary LLM providers to achieving state-of-the-art performance and risk…

Cryptography and Security · Computer Science 2026-04-21 Zheng Hui , Yijiang River Dong , Sanhanat Sivapiromrat , Ehsan Shareghi , Nigel Collier

The rapid advancement of large language models (LLMs) has enabled powerful authorship inference capabilities, raising growing concerns about unintended deanonymization risks in textual data such as news articles. In this work, we introduce…

Computation and Language · Computer Science 2026-02-27 Boyang Zhang , Yang Zhang

An increasing number of companies have begun providing services that leverage cloud-based large language models (LLMs), such as ChatGPT. However, this development raises substantial privacy concerns, as users' prompts are transmitted to and…

Cryptography and Security · Computer Science 2025-02-24 Shilong Hou , Ruilin Shang , Zi Long , Xianghua Fu , Yin Chen

Face anonymization aims to conceal identity information while preserving non-identity attributes. Mainstream diffusion models rely on inference-time interventions such as negative guidance or energy-based optimization, which are applied…

Computer Vision and Pattern Recognition · Computer Science 2025-10-29 Haoxin Yang , Yihong Lin , Jingdan Kang , Xuemiao Xu , Yue Li , Cheng Xu , Shengfeng He

Large language models (LLMs) are increasingly being used in privacy pipelines to detect and remedy sensitive data leakage. These solutions often rely on the premise that LLMs can reliably recognize human names, one of the most important…

Cryptography and Security · Computer Science 2026-04-28 Dzung Pham , Peter Kairouz , Niloofar Mireshghallah , Eugene Bagdasarian , Chau Minh Pham , Amir Houmansadr

Fine-tuning is a common and effective method for tailoring large language models (LLMs) to specialized tasks and applications. In this paper, we study the privacy implications of fine-tuning LLMs on user data. To this end, we consider a…

Cryptography and Security · Computer Science 2024-02-27 Nikhil Kandpal , Krishna Pillutla , Alina Oprea , Peter Kairouz , Christopher A. Choquette-Choo , Zheng Xu

Large Language Models (LLMs) are increasingly deployed as agents that orchestrate tasks and integrate external tools to execute complex workflows. We demonstrate that these interactive behaviors leave distinctive fingerprints in encrypted…

Cryptography and Security · Computer Science 2025-10-09 Yixiang Zhang , Xinhao Deng , Zhongyi Gu , Yihao Chen , Ke Xu , Qi Li , Jianping Wu

As LLM-based agents increasingly browse the web on users' behalf, a natural question arises: can websites passively identify which underlying model powers an agent? Doing so would represent a significant security risk, enabling targeted…

Cryptography and Security · Computer Science 2026-05-15 William Lugoloobi , Samuelle Marro , Jabez Magomere , Joss Wright , Chris Russell

The rapid deployment of large language models (LLMs) in consumer applications has led to frequent exchanges of personal information. To obtain useful responses, users often share more than necessary, increasing privacy risks via…

Machine Learning · Computer Science 2025-10-07 Jijie Zhou , Niloofar Mireshghallah , Tianshi Li

The proliferation of textual data containing sensitive personal information across various domains requires robust anonymization techniques to protect privacy and comply with regulations, while preserving data usability for diverse and…

Computation and Language · Computer Science 2025-12-17 Tobias Deußer , Lorenz Sparrenberg , Armin Berger , Max Hahnbück , Christian Bauckhage , Rafet Sifa

The use of Natural Language Processing (NLP) in highstakes AI-based applications has increased significantly in recent years, especially since the emergence of Large Language Models (LLMs). However, despite their strong performance, LLMs…

Current LLM-based frameworks for text anonymization usually rely on remote API services from powerful LLMs, which creates an inherent privacy paradox: users must disclose the raw data to untrusted third parties for guaranteed privacy…

Cryptography and Security · Computer Science 2026-04-14 Donghang Duan , Xu Zheng , Yuefeng He , Chong Mu , Leyi Cai , Lizong Zhang

As large language models (LLMs) rapidly advance and integrate into daily life, the privacy risks they pose are attracting increasing attention. We focus on a specific privacy risk where LLMs may help identify the authorship of anonymous…

Computation and Language · Computer Science 2024-11-21 Zichen Wen , Dadi Guo , Huishuai Zhang

Responsible use of AI demands that we protect sensitive information without undermining the usefulness of data, an imperative that has become acute in the age of large language models. We address this challenge with an on-premise,…

Computation and Language · Computer Science 2026-03-19 Federico Albanese , Pablo Ronco , Nicolás D'Ippolito

The unprecedented capture and application of face images raise increasing concerns on anonymization to fight against privacy disclosure. Most existing methods may suffer from the problem of excessive change of the identity-independent…

Computer Vision and Pattern Recognition · Computer Science 2024-07-09 Zhenzhong Kuang , Xiaochen Yang , Yingjie Shen , Chao Hu , Jun Yu

While many online services provide privacy policies for end users to read and understand what personal data are being collected, these documents are often lengthy and complicated. As a result, the vast majority of users do not read them at…

Artificial Intelligence · Computer Science 2024-09-26 Bhanuka Silva , Dishanika Denipitiyage , Suranga Seneviratne , Anirban Mahanti , Aruna Seneviratne