English
Related papers

Related papers: Controlling What You Share: Assessing Language Mod…

200 papers

To protect the privacy of individuals whose data is being shared, it is of high importance to develop methods allowing researchers and companies to release textual data while providing formal privacy guarantees to its originators. In the…

Machine Learning · Computer Science 2022-10-27 Justus Mattern , Zhijing Jin , Benjamin Weggenmann , Bernhard Schoelkopf , Mrinmaya Sachan

Accurate privacy evaluation of textual data remains a critical challenge in privacy-preserving natural language processing. Recent work has shown that large language models (LLMs) can serve as reliable privacy evaluators, achieving strong…

Computation and Language · Computer Science 2026-04-01 Gabriel Loiseau , Damien Sileo , Damien Riquet , Maxime Meyer , Marc Tommasi

The use of Natural Language Processing (NLP) in highstakes AI-based applications has increased significantly in recent years, especially since the emergence of Large Language Models (LLMs). However, despite their strong performance, LLMs…

The de-identification of private information in medical data is a crucial process to mitigate the risk of confidentiality breaches, particularly when patient personal details are not adequately removed before the release of medical records.…

Cryptography and Security · Computer Science 2025-04-29 Guanchen Wu , Linzhi Zheng , Han Xie , Zhen Xiang , Jiaying Lu , Darren Liu , Delgersuren Bold , Bo Li , Xiao Hu , Carl Yang

SpeechLLMs are increasingly deployed in professional settings where domain customisation is standard practice: users supply context in prompts with sensitive information, fine-tune on proprietary recordings, or both. We identify and…

Computation and Language · Computer Science 2026-05-28 Maike Züfle , Jan Niehues

The deployment of Large Language Models (LLMs) in embodied agents creates an urgent need to measure their privacy awareness in the physical world. Existing evaluation methods, however, are confined to natural language based scenarios. To…

Cryptography and Security · Computer Science 2026-02-17 Xinjie Shen , Mufei Li , Pan Li

Fine-tuning Large Language Models (LLMs) on sensitive datasets carries a substantial risk of unintended memorization and leakage of Personally Identifiable Information (PII), which can violate privacy regulations and compromise individual…

The increasing use of synthetic data generated by Large Language Models (LLMs) presents both opportunities and challenges in data-driven applications. While synthetic data provides a cost-effective, scalable alternative to real-world data…

Computation and Language · Computer Science 2025-07-25 Tevin Atwal , Chan Nam Tieu , Yefeng Yuan , Zhan Shi , Yuhong Liu , Liang Cheng

Recent advances in neural network based language models lead to successful deployments of such models, improving user experience in various applications. It has been demonstrated that strong performance of language models comes along with…

Cryptography and Security · Computer Science 2021-02-24 Huseyin A. Inan , Osman Ramadan , Lukas Wutschitz , Daniel Jones , Victor Rühle , James Withers , Robert Sim

Personalization in large language models (LLMs) is increasingly important, aiming to align the LLMs' interactions, content, and recommendations with individual user preferences. Recent advances have highlighted effective prompt design by…

Computation and Language · Computer Science 2025-02-11 Zhaoxuan Tan , Qingkai Zeng , Yijun Tian , Zheyuan Liu , Bing Yin , Meng Jiang

Utilizing user profiles to personalize Large Language Models (LLMs) has been shown to enhance the performance on a wide range of tasks. However, the precise role of user profiles and their effect mechanism on LLMs remains unclear. This…

Computation and Language · Computer Science 2024-06-27 Bin Wu , Zhengyan Shi , Hossein A. Rahmani , Varsha Ramineni , Emine Yilmaz

Impressive progress has been made in automated problem-solving by the collaboration of large language model (LLM) based agents. However, these automated capabilities also open avenues for malicious applications. In this paper, we study a…

Cryptography and Security · Computer Science 2026-04-16 Yuntao Du , Zitao Li , Bolin Ding , Yaliang Li , Hanshen Xiao , Jingren Zhou , Ninghui Li

The rapid advancement and widespread use of large language models (LLMs) have raised significant concerns regarding the potential leakage of personally identifiable information (PII). These models are often trained on vast quantities of…

Cryptography and Security · Computer Science 2023-07-06 Siwon Kim , Sangdoo Yun , Hwaran Lee , Martin Gubri , Sungroh Yoon , Seong Joon Oh

This is the first survey of the active area of AI research that focuses on privacy issues in Large Language Models (LLMs). Specifically, we focus on work that red-teams models to highlight privacy risks, attempts to build privacy into the…

Artificial Intelligence · Computer Science 2024-06-03 Seth Neel , Peter Chang

Large language models (LLMs) are excellent in-context learners. However, the sensitivity of data contained in prompts raises privacy concerns. Our work first shows that these concerns are valid: we instantiate a simple but highly effective…

Machine Learning · Computer Science 2023-05-26 Haonan Duan , Adam Dziedzic , Nicolas Papernot , Franziska Boenisch

As large language models (LLMs) become increasingly integrated into daily applications, it is essential to ensure they operate fairly across diverse user demographics. In this work, we show that LLMs suffer from personalization bias, where…

Computation and Language · Computer Science 2025-02-12 Anvesh Rao Vijjini , Somnath Basu Roy Chowdhury , Snigdha Chaturvedi

Facial recognition technologies are implemented in many areas, including but not limited to, citizen surveillance, crime control, activity monitoring, and facial expression evaluation. However, processing biometric information is a…

Cryptography and Security · Computer Science 2020-07-07 M. A. P. Chamikara , P. Bertok , I. Khalil , D. Liu , S. Camtepe

Social chatbots, also known as chit-chat chatbots, evolve rapidly with large pretrained language models. Despite the huge progress, privacy concerns have arisen recently: training data of large language models can be extracted via model…

Computation and Language · Computer Science 2022-05-23 Haoran Li , Yangqiu Song , Lixin Fan

Children are increasingly using technologies powered by Artificial Intelligence (AI). However, there are growing concerns about privacy risks, particularly for children. Although existing privacy regulations require companies and…

Artificial Intelligence · Computer Science 2026-02-20 Diana Addae , Diana Rogachova , Nafiseh Kahani , Masoud Barati , Michael Christensen , Chen Zhou

In sensitive domains such as medical and legal, protecting sensitive information is critical, with protective laws strictly prohibiting the disclosure of personal data. This poses challenges for sharing valuable data such as medical reports…

Computation and Language · Computer Science 2025-05-28 Anthony Hughes , Ning Ma , Nikolaos Aletras