English
Related papers

Related papers: Privacy Preserving Large Language Models: ChatGPT …

200 papers

We demonstrate that it is possible to train large recurrent language models with user-level differential privacy guarantees with only a negligible cost in predictive accuracy. Our work builds on recent advances in the training of deep…

Machine Learning · Computer Science 2018-02-27 H. Brendan McMahan , Daniel Ramage , Kunal Talwar , Li Zhang

Large Language Models (LLMs) are emerging as powerful enablers for autonomous reasoning and natural-language coordination in unmanned aerial vehicle (UAV) swarms operating within Internet of Things (IoT) environments. However, existing…

Cryptography and Security · Computer Science 2025-12-09 Jifar Wakuma Ayana , Huang Qiming

An increasing number of companies have begun providing services that leverage cloud-based large language models (LLMs), such as ChatGPT. However, this development raises substantial privacy concerns, as users' prompts are transmitted to and…

Cryptography and Security · Computer Science 2025-02-24 Shilong Hou , Ruilin Shang , Zi Long , Xianghua Fu , Yin Chen

Synthetic tabular data generation with differential privacy is a crucial problem to enable data sharing with formal privacy. Despite a rich history of methodological research and development, developing differentially private tabular data…

Machine Learning · Computer Science 2024-06-05 Toan V. Tran , Li Xiong

With the recent remarkable advancement of large language models (LLMs), there has been a growing interest in utilizing them in the domains with highly sensitive data that lies outside their training data. For this purpose,…

Cryptography and Security · Computer Science 2025-11-13 Tatsuki Koga , Ruihan Wu , Zhiyuan Zhang , Kamalika Chaudhuri

The emergence of large language models (LLMs), and their increased use in user-facing systems, has led to substantial privacy concerns. To date, research on these privacy concerns has been model-centered: exploring how LLMs lead to privacy…

Human-Computer Interaction · Computer Science 2024-02-06 Tianshi Li , Sauvik Das , Hao-Ping Lee , Dakuo Wang , Bingsheng Yao , Zhiping Zhang

Fine-tuning has emerged as a critical process in leveraging Large Language Models (LLMs) for specific downstream tasks, enabling these models to achieve state-of-the-art performance across various domains. However, the fine-tuning process…

Artificial Intelligence · Computer Science 2025-04-08 Hao Du , Shang Liu , Lele Zheng , Yang Cao , Atsuyoshi Nakamura , Lei Chen

The interactive use of large language models (LLMs) in AI assistants (at work, home, etc.) introduces a new set of inference-time privacy risks: LLMs are fed different types of information from multiple sources in their inputs and are…

Artificial Intelligence · Computer Science 2024-07-02 Niloofar Mireshghallah , Hyunwoo Kim , Xuhui Zhou , Yulia Tsvetkov , Maarten Sap , Reza Shokri , Yejin Choi

We study the problem of in-context learning (ICL) with large language models (LLMs) on private datasets. This scenario poses privacy risks, as LLMs may leak or regurgitate the private examples demonstrated in the prompt. We propose a novel…

Large language models (LLMs), like ChatGPT, have greatly simplified text generation tasks. However, they have also raised concerns about privacy risks such as data leakage and unauthorized data collection. Existing solutions for…

Cryptography and Security · Computer Science 2026-03-19 Meng Tong , Kejiang Chen , Jie Zhang , Yuang Qi , Weiming Zhang , Nenghai Yu , Tianwei Zhang , Zhikun Zhang

Fine-tuning Large Language Models (LLMs) on sensitive datasets carries a substantial risk of unintended memorization and leakage of Personally Identifiable Information (PII), which can violate privacy regulations and compromise individual…

The emergence of ChatGPT marks the arrival of the large language model (LLM) era. While LLMs demonstrate their power in a variety of fields, they also raise serious privacy concerns as the users' queries are sent to the model provider. On…

Cryptography and Security · Computer Science 2024-05-30 Fei Zheng , Chaochao Chen , Zhongxuan Han , Xiaolin Zheng

Large Language Model (LLM)-based recommendation systems leverage powerful language models to generate personalized suggestions by processing user interactions and preferences. Unlike traditional recommendation systems that rely on…

Information Retrieval · Computer Science 2025-05-05 Tina Khezresmaeilzadeh , Jiang Zhang , Dimitrios Andreadis , Konstantinos Psounis

The remarkable ability of language models (LMs) has also brought challenges at the interface of AI and security. A critical challenge pertains to how much information these models retain and leak about the training data. This is…

Machine Learning · Computer Science 2023-01-31 My H. Dinh , Ferdinando Fioretto

Large Language Models (LLMs) have demonstrated extraordinary capabilities and contributed to multiple fields, such as generating and summarizing text, language translation, and question-answering. Nowadays, LLM is becoming a very popular…

Computation and Language · Computer Science 2024-11-18 Badhan Chandra Das , M. Hadi Amini , Yanzhao Wu

This research addresses privacy protection in Natural Language Processing (NLP) by introducing a novel algorithm based on differential privacy, aimed at safeguarding user data in common applications such as chatbots, sentiment analysis, and…

Cryptography and Security · Computer Science 2024-10-14 Shaobo Liu , Guiran Liu , Binrong Zhu , Yuanshuai Luo , Linxiao Wu , Rui Wang

With the increasing applications of language models, it has become crucial to protect these models from leaking private information. Previous work has attempted to tackle this challenge by training RNN-based language models with…

Computation and Language · Computer Science 2022-07-19 Weiyan Shi , Aiqi Cui , Evan Li , Ruoxi Jia , Zhou Yu

Users interacting with large language models (LLMs) under their real identifiers often unknowingly risk disclosing private information. Automatically notifying users whether their queries leak privacy and which phrases leak what private…

Computation and Language · Computer Science 2025-08-11 Hang Zeng , Xiangyu Liu , Yong Hu , Chaoyue Niu , Fan Wu , Shaojie Tang , Guihai Chen

The rapid development of large language models (LLMs) is redefining the landscape of human-computer interaction, and their integration into various user-service applications is becoming increasingly prevalent. However, transmitting user…

Computation and Language · Computer Science 2025-02-20 Guangwei Li , Yuansen Zhang , Yinggui Wang , Shoumeng Yan , Lei Wang , Tao Wei

Hundreds of millions of people now regularly interact with large language models via chatbots. Model developers are eager to acquire new sources of high-quality training data as they race to improve model capabilities and win market share.…

Computers and Society · Computer Science 2025-09-09 Jennifer King , Kevin Klyman , Emily Capstick , Tiffany Saade , Victoria Hsieh