English
Related papers

Related papers: Large Language Model Empowered Privacy-Protected F…

200 papers

Healthcare systems continuously generate vast amounts of electronic health records (EHRs), commonly stored in the Fast Healthcare Interoperability Resources (FHIR) standard. Despite the wealth of information in these records, their…

Computation and Language · Computer Science 2025-01-24 Sara Kothari , Ayush Gupta

In the field of machine learning, domain-specific annotated data is an invaluable resource for training effective models. However, in the medical domain, this data often includes Personal Health Information (PHI), raising significant…

Computation and Language · Computer Science 2024-09-13 Tal Baumel , Andre Manoel , Daniel Jones , Shize Su , Huseyin Inan , Aaron , Bornstein , Robert Sim

Artificial Intelligence (AI) faces growing challenges from evolving data protection laws and enforcement practices worldwide. Regulations like GDPR and CCPA impose strict compliance requirements on Machine Learning (ML) models, especially…

Machine Learning · Computer Science 2025-01-23 Shubhi Asthana , Ruchi Mahindru , Bing Zhang , Jorge Sanz

Large language models (LLMs) are commonly adapted to downstream tasks through fine-tuning, but fine-tuning data often contains sensitive information that may be leaked by the resulting model. Differential privacy (DP) offers formal…

Machine Learning · Computer Science 2026-05-19 Haichao Sha , Zihao Wang , Yuncheng Wu , Hong Chen , Wei Dong

Large Vision-Language Models (LVLMs) exhibit impressive potential across various tasks but also face significant privacy risks, limiting their practical applications. Current researches on privacy assessment for LVLMs is limited in scope,…

Cryptography and Security · Computer Science 2026-03-03 Jie Zhang , Xiangkui Cao , Zhouyu Han , Shiguang Shan , Xilin Chen

With the increasing prevalence of mental health conditions worldwide, AI-powered chatbots and conversational agents have emerged as accessible tools to support mental health. However, deploying Large Language Models (LLMs) in mental…

Computation and Language · Computer Science 2026-01-27 Nobin Sarwar

Differential privacy (DP) is the de facto privacy standard against privacy leakage attacks, including many recently discovered ones against large language models (LLMs). However, we discovered that LLMs could reconstruct the altered/removed…

Cryptography and Security · Computer Science 2025-09-19 Shuchao Pang , Zhigang Lu , Haichen Wang , Peng Fu , Yongbin Zhou , Minhui Xue

Large multimodal language models have proven transformative in numerous applications. However, these models have been shown to memorize and leak pre-training data, raising serious user privacy and information security concerns. While data…

Computation and Language · Computer Science 2023-10-04 Yang Chen , Ethan Mendes , Sauvik Das , Wei Xu , Alan Ritter

Large language models (LLMs) have been widely applied for their remarkable capability of content generation. However, the practical use of open-source LLMs is hindered by high resource requirements, making deployment expensive and limiting…

Cryptography and Security · Computer Science 2025-05-05 Wenjie Qu , Yuguang Zhou , Yongji Wu , Tingsong Xiao , Binhang Yuan , Yiming Li , Jiaheng Zhang

Rapid advances in Natural Language Processing (NLP) have revolutionized many fields, including healthcare. However, these advances raise significant privacy concerns, especially when pre-trained models fine-tuned and specialized on…

Computation and Language · Computer Science 2026-05-21 Antoine Boutet , Lucas Magnana , Juliette Sénéchal

We investigate practical and scalable algorithms for training large language models (LLMs) with user-level differential privacy (DP) in order to provably safeguard all the examples contributed by each user. We study two variants of DP-SGD…

Machine Learning · Computer Science 2024-07-11 Zachary Charles , Arun Ganesh , Ryan McKenna , H. Brendan McMahan , Nicole Mitchell , Krishna Pillutla , Keith Rush

Large Language Models (LLMs) excel in various domains but pose inherent privacy risks. Existing methods to evaluate privacy leakage in LLMs often use memorized prefixes or simple instructions to extract data, both of which well-alignment…

Cryptography and Security · Computer Science 2025-05-19 Yidan Wang , Yanan Cao , Yubing Ren , Fang Fang , Zheng Lin , Binxing Fang

Large Language Models (LLMs) have a privacy concern because they memorize training data (including personally identifiable information (PII) like emails and phone numbers) and leak it during inference. A company can train an LLM on its…

Cryptography and Security · Computer Science 2023-07-21 Jaydeep Borkar

While many online services provide privacy policies for end users to read and understand what personal data are being collected, these documents are often lengthy and complicated. As a result, the vast majority of users do not read them at…

Artificial Intelligence · Computer Science 2024-09-26 Bhanuka Silva , Dishanika Denipitiyage , Suranga Seneviratne , Anirban Mahanti , Aruna Seneviratne

The emergence of large language models (LLMs), and their increased use in user-facing systems, has led to substantial privacy concerns. To date, research on these privacy concerns has been model-centered: exploring how LLMs lead to privacy…

Human-Computer Interaction · Computer Science 2024-02-06 Tianshi Li , Sauvik Das , Hao-Ping Lee , Dakuo Wang , Bingsheng Yao , Zhiping Zhang

Large Language Models (LLMs) have achieved remarkable performance and received significant research interest. The enormous computational demands, however, hinder the local deployment on devices with limited resources. The current prevalent…

Cryptography and Security · Computer Science 2026-02-13 Yujie Gu , Richeng Jin , Xiaoyu Ji , Yier Jin , Wenyuan Xu

Prevalent supervised learning methods in natural language processing (NLP) are notoriously data-hungry, which demand large amounts of high-quality annotated data. In practice, acquiring such data is a costly endeavor. Recently, the superior…

Computation and Language · Computer Science 2023-11-01 Ruoyu Zhang , Yanzeng Li , Yongliang Ma , Ming Zhou , Lei Zou

Large language models (LLMs) show early signs of artificial general intelligence but struggle with hallucinations. One promising solution to mitigate these hallucinations is to store external knowledge as embeddings, aiding LLMs in…

Computation and Language · Computer Science 2024-04-26 Zhihao Zhu , Ninglu Shao , Defu Lian , Chenwang Wu , Zheng Liu , Yi Yang , Enhong Chen

Model adaptation is crucial to handle the discrepancy between proxy training data and actual users data received. To effectively perform adaptation, textual data of users is typically stored on servers or their local devices, where…

Computation and Language · Computer Science 2023-12-15 Arpita Vats , Zhe Liu , Peng Su , Debjyoti Paul , Yingyi Ma , Yutong Pang , Zeeshan Ahmed , Ozlem Kalinli

Parameter-Efficient Fine-Tuning (PEFT) provides a practical way for users to customize Large Language Models (LLMs) with their private data in LLM service scenarios. However, the inherently sensitive nature of private data demands robust…

Computation and Language · Computer Science 2025-10-13 Yansong Li , Zhixing Tan , Paula Branco , Yang Liu