English
Related papers

Related papers: PSY: Posterior Sampling Based Privacy Enhancer in …

200 papers

We develop a privatised stochastic variational inference method for Latent Dirichlet Allocation (LDA). The iterative nature of stochastic variational inference presents challenges: multiple iterations are required to obtain accurate…

Machine Learning · Statistics 2018-12-05 Mijung Park , James Foulds , Kamalika Chaudhuri , Max Welling

Recent advancements in pre-trained large language models (LLMs) have significantly influenced various domains. Adapting these models for specific tasks often involves fine-tuning (FT) with private, domain-specific data. However, privacy…

Cryptography and Security · Computer Science 2024-12-11 Guanzhong Chen , Zhenghan Qin , Mingxin Yang , Yajie Zhou , Tao Fan , Tianyu Du , Zenglin Xu

How much information about training samples can be leaked through synthetic data generated by Large Language Models (LLMs)? Overlooking the subtleties of information flow in synthetic data generation pipelines can lead to a false sense of…

Computation and Language · Computer Science 2026-02-13 Matthieu Meeus , Lukas Wutschitz , Santiago Zanella-Béguelin , Shruti Tople , Reza Shokri

Differential privacy formalises privacy-preserving mechanisms that provide access to a database. We pose the question of whether Bayesian inference itself can be used directly to provide private access to data, with no modification. The…

Multimodal Large Language Models (LLMs) are pivotal in revolutionizing customer support and operations by integrating multiple modalities such as text, images, and audio. Federated Prompt Learning (FPL) is a recently proposed approach that…

Machine Learning · Computer Science 2025-02-14 Linh Tran , Wei Sun , Stacy Patterson , Ana Milanova

Large Reasoning Models (LRMs) improve performance, reliability, and interpretability by generating explicit chain-of-thought (CoT) reasoning, but this transparency introduces a serious privacy risk: intermediate reasoning often leaks…

Artificial Intelligence · Computer Science 2026-01-09 Arghyadeep Das , Sai Sreenivas Chintha , Rishiraj Girmal , Kinjal Pandey , Sharvi Endait

Large language models (LLMs) have revolutionized natural language processing with their ability to generate coherent and contextually relevant text. However, their deployment raises significant concerns about the potential for generating…

Computation and Language · Computer Science 2025-10-03 Hoang Phan , Victor Li , Qi Lei

Large Language Models (LLMs) are increasingly integrated into daily routines, yet they raise significant privacy and safety concerns. Recent research proposes collaborative inference, which outsources the early-layer inference to ensure…

Cryptography and Security · Computer Science 2025-07-23 Tian Dong , Yan Meng , Shaofeng Li , Guoxing Chen , Zhen Liu , Haojin Zhu

Lately, differential privacy (DP) has been introduced in cooperative multiagent reinforcement learning (CMARL) to safeguard the agents' privacy against adversarial inference during knowledge sharing. Nevertheless, we argue that the noise…

Machine Learning · Computer Science 2023-07-14 Md Tamjid Hossain , Hung La

Machine learning poses severe privacy concerns as it has been shown that the learned models can reveal sensitive information about their training data. Many works have investigated the effect of widely adopted data augmentation and…

Machine Learning · Computer Science 2024-03-26 Xiao Li , Qiongxiu Li , Zhanhao Hu , Xiaolin Hu

The rapid advancement and widespread use of large language models (LLMs) have raised significant concerns regarding the potential leakage of personally identifiable information (PII). These models are often trained on vast quantities of…

Cryptography and Security · Computer Science 2023-07-06 Siwon Kim , Sangdoo Yun , Hwaran Lee , Martin Gubri , Sungroh Yoon , Seong Joon Oh

Pre-trained language models (PLMs) have demonstrated significant proficiency in solving a wide range of general natural language processing (NLP) tasks. Researchers have observed a direct correlation between the performance of these models…

Computation and Language · Computer Science 2024-04-12 Kennedy Edemacu , Xintao Wu

As Large Language Models (LLMs) evolve into personal assistants with access to sensitive user data, they face a critical privacy challenge: while prior work has addressed output-level privacy, recent findings reveal that LLMs often leak…

Cryptography and Security · Computer Science 2025-11-24 Shourya Batra , Pierce Tillman , Samarth Gaggar , Shashank Kesineni , Kevin Zhu , Sunishchal Dev , Ashwinee Panda , Vasu Sharma , Maheep Chaudhary

Differential privacy is a leading protection setting, focused by design on individual privacy. Many applications, in medical / pharmaceutical domains or social networks, rather posit privacy at a group level, a setting we call integral…

Machine Learning · Statistics 2019-07-04 Hisham Husain , Zac Cranko , Richard Nock

Recent research in differential privacy demonstrated that (sub)sampling can amplify the level of protection. For example, for $\epsilon$-differential privacy and simple random sampling with sampling rate $r$, the actual privacy guarantee is…

Applications · Statistics 2022-02-22 Jingchen Hu , Joerg Drechsler , Hang J. Kim

While diffusion models have recently demonstrated remarkable progress in generating realistic images, privacy risks also arise: published models or APIs could generate training images and thus leak privacy-sensitive training information. In…

Machine Learning · Computer Science 2024-04-23 Zhangheng Li , Junyuan Hong , Bo Li , Zhangyang Wang

Diffusion Language Models (DLMs) represent a promising alternative to autoregressive language models, using bidirectional masked token prediction. Yet their susceptibility to privacy leakage via Membership Inference Attacks (MIA) remains…

Machine Learning · Computer Science 2026-02-10 Yuetian Chen , Kaiyuan Zhang , Yuntao Du , Edoardo Stoppa , Charles Fleming , Ashish Kundu , Bruno Ribeiro , Ninghui Li

Local differential privacy (LDP) has become a central topic in data privacy research, offering strong privacy guarantees by perturbing user data at the source and removing the need for a trusted curator. However, the noise introduced by LDP…

Machine Learning · Computer Science 2026-03-04 Caihong Qin , Yang Bai

With the increasing use of conversational AI systems, there is growing concern over privacy leaks, especially when users share sensitive personal data in interactions with Large Language Models (LLMs). Conversations shared with these models…

Computation and Language · Computer Science 2025-11-03 Jayden Serenari , Stephen Lee

The tension between data privacy and model utility has become the defining bottleneck for the practical deployment of large language models (LLMs) trained on sensitive corpora including healthcare. Differentially private stochastic gradient…

Machine Learning · Computer Science 2025-07-31 Afshin Khadangi , Amir Sartipi , Igor Tchappi , Ramin Bahmani , Gilbert Fridgen