English
Related papers

Related papers: Harnessing large-language models to generate priva…

200 papers

Machine Learning (ML) has achieved enormous success in solving a variety of problems in computer vision, speech recognition, object detection, to name a few. The principal reason for this success is the availability of huge datasets for…

Cryptography and Security · Computer Science 2023-02-14 Efstathia Soufleri , Gobinda Saha , Kaushik Roy

A common and effective means for improving language model capabilities involves finetuning a ``student'' language model's parameters on generations from a more proficient ``teacher'' model. Termed ``synthetic data'', these generations are…

As the use of large embedding models in recommendation systems and language applications increases, concerns over user data privacy have also risen. DP-SGD, a training algorithm that combines differential privacy with stochastic gradient…

Machine Learning · Computer Science 2023-11-15 Badih Ghazi , Yangsibo Huang , Pritish Kamath , Ravi Kumar , Pasin Manurangsi , Amer Sinha , Chiyuan Zhang

Large Language models (LLMs) are achieving state-of-the-art performance in many different downstream tasks. However, the increasing urgency of data privacy puts pressure on practitioners to train LLMs with Differential Privacy (DP) on…

Machine Learning · Computer Science 2025-12-17 James Flemings , Murali Annavaram

In this paper, we propose three methods for generating synthetic samples to train and evaluate multimodal large language models capable of processing both text and speech inputs. Addressing the scarcity of samples containing both…

Audio and Speech Processing · Electrical Eng. & Systems 2024-06-21 Vahid Noroozi , Zhehuai Chen , Somshubra Majumdar , Steve Huang , Jagadeesh Balam , Boris Ginsburg

Tabular generative adversarial networks (TGAN) have recently emerged to cater to the need of synthesizing tabular data -- the most widely used data format. While synthetic tabular data offers the advantage of complying with privacy…

Machine Learning · Computer Science 2021-08-03 Aditya Kunar , Robert Birke , Zilong Zhao , Lydia Chen

While location trajectories offer valuable insights, they also reveal sensitive personal information. Differential Privacy (DP) offers formal protection, but achieving a favourable utility-privacy trade-off remains challenging. Recent works…

Cryptography and Security · Computer Science 2025-06-12 Erik Buchholz , Natasha Fernandes , David D. Nguyen , Alsharif Abuadbba , Surya Nepal , Salil S. Kanhere

Although machine learning models trained on massive data have led to break-throughs in several areas, their deployment in privacy-sensitive domains remains limited due to restricted access to data. Generative models trained with privacy…

Machine Learning · Computer Science 2022-06-22 Tianshi Cao , Alex Bie , Arash Vahdat , Sanja Fidler , Karsten Kreis

Large language models (LLMs) have emerged as a powerful tool for synthetic data generation. A particularly important use case is producing synthetic replicas of private text, which requires carefully balancing privacy and utility. We…

Cryptography and Security · Computer Science 2026-04-14 Qian Ma , Sarah Rajtmajer

Retrieval-Augmented Generation (RAG) enhances large language models (LLMs) by grounding them in external knowledge. However, its application in sensitive domains is limited by privacy risks. Existing private RAG methods typically rely on…

Cryptography and Security · Computer Science 2026-05-13 Junki Mori , Kazuya Kakizaki , Taiki Miyagawa , Jun Sakuma

Ensuring user privacy by synthesizing data from large language models (LLMs) tuned under differential privacy (DP) has become popular recently. However, the impact of DP fine-tuned LLMs on the quality of the language and the utility of the…

Computation and Language · Computer Science 2025-09-16 Erion Çano , Ivan Habernal

In the arena of privacy-preserving machine learning, differentially private stochastic gradient descent (DP-SGD) has outstripped the objective perturbation mechanism in popularity and interest. Though unrivaled in versatility, DP-SGD…

Machine Learning · Computer Science 2024-01-02 Rachel Redberg , Antti Koskela , Yu-Xiang Wang

We study private prediction where differential privacy is achieved by adding noise to the outputs of a non-private model. Existing methods rely on noise proportional to the global sensitivity of the model, often resulting in sub-optimal…

Generative models trained with Differential Privacy (DP) can produce synthetic data while reducing privacy risks. However, navigating their privacy-utility tradeoffs makes finding the best models for specific settings/tasks challenging.…

Machine Learning · Computer Science 2024-08-30 Georgi Ganev , Kai Xu , Emiliano De Cristofaro

Privacy-preserving releasing of complex data (e.g., image, text, audio) represents a long-standing challenge for the data mining research community. Due to rich semantics of the data and lack of a priori knowledge about the analysis task,…

Cryptography and Security · Computer Science 2018-03-28 Xinyang Zhang , Shouling Ji , Ting Wang

Generating synthetic data through generative models is gaining interest in the ML community and beyond, promising a future where datasets can be tailored to individual needs. Unfortunately, synthetic data is usually not perfect, resulting…

Machine Learning · Computer Science 2023-07-11 Boris van Breugel , Zhaozhi Qian , Mihaela van der Schaar

Pre-training on public data is an effective method to improve the performance for federated learning (FL) with differential privacy (DP). This paper investigates how large language models (LLMs) trained on public data can improve the…

Machine Learning · Computer Science 2024-08-08 Shanshan Wu , Zheng Xu , Yanxiang Zhang , Yuanbo Zhang , Daniel Ramage

A major challenge in applying differential privacy to training deep neural network models is scalability.The widely-used training algorithm, differentially private stochastic gradient descent (DP-SGD), struggles with training…

Machine Learning · Computer Science 2023-03-09 Kamil Adamczewski , Mijung Park

We study the problem of efficiently generating differentially private synthetic data that approximate the statistical properties of an underlying sensitive dataset. In recent years, there has been a growing line of work that approaches this…

Neural and Evolutionary Computing · Computer Science 2023-06-07 Terrance Liu , Jingwu Tang , Giuseppe Vietri , Zhiwei Steven Wu

Protecting large language models from privacy leakage is becoming increasingly crucial with their wide adoption in real-world products. Yet applying differential privacy (DP), a canonical notion with provable privacy guarantees for machine…

Computation and Language · Computer Science 2022-10-28 Weiyan Shi , Ryan Shea , Si Chen , Chiyuan Zhang , Ruoxi Jia , Zhou Yu