English
Related papers

Related papers: CAPID: Context-Aware PII Detection for Question-An…

200 papers

Protecting sensitive information is crucial in today's world of Large Language Models (LLMs) and data-driven services. One common method used to preserve privacy is by using data perturbation techniques to reduce overreaching utility of…

Computation and Language · Computer Science 2023-07-19 Ajinkya Deshmukh , Saumya Banthia , Anantha Sharma

In-context learning (ICL) enables Large Language Models (LLMs) to adapt to new tasks with only a small set of examples at inference time, thereby avoiding task-specific fine-tuning. However, in-context examples may contain privacy-sensitive…

Machine Learning · Computer Science 2026-02-06 Rob Romijnders , Mohammad Mahdi Derakhshani , Jonathan Petit , Max Welling , Christos Louizos , Yuki M. Asano

The interactive use of large language models (LLMs) in AI assistants (at work, home, etc.) introduces a new set of inference-time privacy risks: LLMs are fed different types of information from multiple sources in their inputs and are…

Artificial Intelligence · Computer Science 2024-07-02 Niloofar Mireshghallah , Hyunwoo Kim , Xuhui Zhou , Yulia Tsvetkov , Maarten Sap , Reza Shokri , Yejin Choi

Recent advancements in generative large language models (LLMs) have enabled wider applicability, accessibility, and flexibility. However, their reliability and trustworthiness are still in doubt, especially for concerns regarding…

Computation and Language · Computer Science 2025-05-26 Haoran Li , Wenbin Hu , Huihao Jing , Yulin Chen , Qi Hu , Sirui Han , Tianshu Chu , Peizhao Hu , Yangqiu Song

Large Language Models (LLMs) excel in various domains but pose inherent privacy risks. Existing methods to evaluate privacy leakage in LLMs often use memorized prefixes or simple instructions to extract data, both of which well-alignment…

Cryptography and Security · Computer Science 2025-05-19 Yidan Wang , Yanan Cao , Yubing Ren , Fang Fang , Zheng Lin , Binxing Fang

In-context learning (ICL) is an important capability of Large Language Models (LLMs), enabling these models to dynamically adapt based on specific, in-context exemplars, thereby improving accuracy and relevance. However, LLM's responses may…

Machine Learning · Computer Science 2023-10-03 Tong Wu , Ashwinee Panda , Jiachen T. Wang , Prateek Mittal

Crash narratives in crash reports provide crucial contextual information for traffic safety analysis. Yet, their broader use is hindered by the presence of personally identifiable information (PII), including names, home addresses, and…

Cryptography and Security · Computer Science 2026-04-20 Junyi Ma , Pei Li , Rui Gan , Kai Cheng , Steven T. Parker , Bin Ran

Large language models (LLMs) are increasingly applied to cybersecurity question answering (QA) for critical tasks such as incident response and vulnerability analysis. However, real-world operational contexts, including system logs and…

Cryptography and Security · Computer Science 2026-05-26 Matilda Gaddi , Jin Noh , Onat Gungor , Tajana Rosing

Large Language Models (LLMs) have been reported to "leak" Personally Identifiable Information (PII), with successful PII reconstruction often interpreted as evidence of memorization. We propose a principled revision of memorization…

Computation and Language · Computer Science 2026-01-08 Xiaoyu Luo , Yiyi Chen , Qiongxiu Li , Johannes Bjerva

Multimodal large language models (MLLMs) have demonstrated remarkable capabilities in processing and reasoning over diverse modalities, but their advanced abilities also raise significant privacy concerns, particularly regarding Personally…

Cryptography and Security · Computer Science 2025-10-01 Boyang Zhang , Istemi Ekin Akkus , Ruichuan Chen , Alice Dethise , Klaus Satzke , Ivica Rimac , Yang Zhang

Despite advances in the use of large language models (LLMs) in downstream tasks, their ability to memorize information has raised privacy concerns. Therefore, protecting personally identifiable information (PII) during LLM training remains…

Machine Learning · Computer Science 2025-12-02 Stella Etuk , Ashraf Matrawy

As Large Language Models (LLMs) gain wider adoption, ensuring their reliable handling of Personally Identifiable Information (PII) across diverse regulatory contexts has become essential. This work introduces a scalable multilingual data…

Computation and Language · Computer Science 2025-10-13 Bharti Meena , Joanna Skubisz , Harshit Rajgarhia , Nand Dave , Kiran Ganesh , Shivali Dalmia , Abhishek Mukherji , Vasudevan Sundarababu

Language Models (LMs) have been shown to leak information about training data through sentence-level membership inference and reconstruction attacks. Understanding the risk of LMs leaking Personally Identifiable Information (PII) has…

Machine Learning · Computer Science 2023-04-25 Nils Lukas , Ahmed Salem , Robert Sim , Shruti Tople , Lukas Wutschitz , Santiago Zanella-Béguelin

Large Language Models (LLMs) have demonstrated remarkable capabilities in natural language processing but also pose significant privacy risks by memorizing and leaking Personally Identifiable Information (PII). Existing mitigation…

Machine Learning · Computer Science 2025-03-17 Ahmed Frikha , Muhammad Reza Ar Razi , Krishna Kanth Nakka , Ricardo Mendes , Xue Jiang , Xuebing Zhou

Language models (LMs) may memorize personally identifiable information (PII) from training data, enabling adversaries to extract it during inference. Existing defense mechanisms such as differential privacy (DP) reduce this leakage, but…

Cryptography and Security · Computer Science 2026-02-27 Anthony Hughes , Vasisht Duddu , N. Asokan , Nikolaos Aletras , Ning Ma

Deep learning-based language models have achieved state-of-the-art results in a number of applications including sentiment analysis, topic labelling, intent classification and others. Obtaining text representations or embeddings using these…

Computation and Language · Computer Science 2021-08-30 Richard Plant , Dimitra Gkatzia , Valerio Giuffrida

Privacy Masking is a critical concept under data privacy involving anonymization and de-anonymization of personally identifiable information (PII). Privacy masking techniques rely on Named Entity Recognition (NER) approaches under NLP…

Computation and Language · Computer Science 2025-04-18 Devansh Singh , Sundaraparipurnan Narayanan

Qualitative research often contains personal, contextual, and organizational details that pose privacy risks if not handled appropriately. Manual anonymization is time-consuming, inconsistent, and frequently omits critical identifiers.…

Artificial Intelligence · Computer Science 2026-01-22 Aisvarya Adeseye , Jouni Isoaho , Seppo Virtanen , Mohammad Tahir

Prompt serves as a crucial link in interacting with large language models (LLMs), widely impacting the accuracy and interpretability of model outputs. However, acquiring accurate and high-quality responses necessitates precise prompts,…

Cryptography and Security · Computer Science 2024-08-20 Xiongtao Sun , Gan Liu , Zhipeng He , Hui Li , Xiaoguang Li

Large language models (LLMs) require a significant redesign in solutions to preserve privacy in data-intensive applications due to their text-generation capabilities. Indeed, LLMs tend to memorize and emit private information when…