English
Related papers

Related papers: Can Differentially Private Fine-tuning LLMs Protec…

200 papers

Differential Privacy (DP) was originally developed to protect privacy. However, it has recently been utilized to secure machine learning (ML) models from poisoning attacks, with DP-SGD receiving substantial attention. Nevertheless, a…

Cryptography and Security · Computer Science 2023-11-13 Fereshteh Razmi , Jian Lou , Li Xiong

In recent years, local differential privacy (LDP) has emerged as a technique of choice for privacy-preserving data collection in several scenarios when the aggregator is not trustworthy. LDP provides client-side privacy by adding noise at…

Machine Learning · Statistics 2021-10-28 Tejas Kulkarni , Joonas Jälkö , Samuel Kaski , Antti Honkela

Neural language models are known to have a high capacity for memorization of training samples. This may have serious privacy implications when training models on user content such as email correspondence. Differential privacy (DP), a…

The surge in interest and application of large language models (LLMs) has sparked a drive to fine-tune these models to suit specific applications, such as finance and medical science. However, concerns regarding data privacy have emerged,…

Machine Learning · Computer Science 2024-06-04 Xiao-Yang Liu , Rongyi Zhu , Daochen Zha , Jiechao Gao , Shan Zhong , Matt White , Meikang Qiu

Differential Privacy (DP) is the de facto standard for reasoning about the privacy guarantees of a training algorithm. Despite the empirical observation that DP reduces the vulnerability of models to existing membership inference (MI)…

Machine Learning · Computer Science 2022-12-20 Anvith Thudi , Ilia Shumailov , Franziska Boenisch , Nicolas Papernot

Collecting and analyzing massive data generated from smart devices have become increasingly pervasive in crowdsensing, which are the building blocks for data-driven decision-making. However, extensive statistics and analysis of such data…

Cryptography and Security · Computer Science 2021-01-29 Teng Wang , Xuefeng Zhang , Jingyu Feng , Xinyu Yang

Differential Privacy (DP) has emerged as a pivotal approach for safeguarding individual privacy in data analysis, yet its practical adoption is often hindered by challenges in the implementation and communication of DP. This paper presents…

Human-Computer Interaction · Computer Science 2025-07-03 Onyinye Dibia , Prianka Bhattacharjee , Brad Stenger , Steven Baldasty , Mako Bates , Ivoline C. Ngong , Yuanyuan Feng , Joseph P. Near

Differential Privacy (DP) is a family of definitions that bound the worst-case privacy leakage of a mechanism. One important feature of the worst-case DP guarantee is it naturally implies protections against adversaries with less prior…

Cryptography and Security · Computer Science 2025-07-14 Marika Swanberg , Meenatchi Sundaram Muthu Selva Annamalai , Jamie Hayes , Borja Balle , Adam Smith

Split learning (SL) aims to protect user data privacy by distributing deep models between client-server and keeping private data locally. Only processed or `smashed' data can be transmitted from the clients to the server during the SL…

Cryptography and Security · Computer Science 2024-10-17 Ngoc Duy Pham , Khoa Tran Phan , Naveen Chilamkurti

Differentially private (DP) synthetic data generation plays a pivotal role in developing large language models (LLMs) on private data, where data owners cannot provide eyes-on access to individual examples. Generating DP synthetic data…

The generative Artificial Intelligence (AI) tools based on Large Language Models (LLMs) use billions of parameters to extensively analyse large datasets and extract critical private information such as, context, specific details,…

Cryptography and Security · Computer Science 2023-10-20 Imdad Ullah , Najm Hassan , Sukhpal Singh Gill , Basem Suleiman , Tariq Ahamed Ahanger , Zawar Shah , Junaid Qadir , Salil S. Kanhere

Machine Learning (ML) is crucial in many sectors, including computer vision. However, ML models trained on sensitive data face security challenges, as they can be attacked and leak information. Privacy-Preserving Machine Learning (PPML)…

Machine Learning · Computer Science 2026-02-03 Lucas Lange , Maurice-Maximilian Heykeroth , Erhard Rahm

While location trajectories offer valuable insights, they also reveal sensitive personal information. Differential Privacy (DP) offers formal protection, but achieving a favourable utility-privacy trade-off remains challenging. Recent works…

Cryptography and Security · Computer Science 2025-06-12 Erik Buchholz , Natasha Fernandes , David D. Nguyen , Alsharif Abuadbba , Surya Nepal , Salil S. Kanhere

Local differential privacy (LDP) has become a central topic in data privacy research, offering strong privacy guarantees by perturbing user data at the source and removing the need for a trusted curator. However, the noise introduced by LDP…

Machine Learning · Computer Science 2026-03-04 Caihong Qin , Yang Bai

There has been an explosion of research on differential privacy (DP) and its various applications in recent years, ranging from novel variants and accounting techniques in differential privacy to the thriving field of differentially private…

Cryptography and Security · Computer Science 2024-04-09 Saswat Das , Subhankar Mishra

Diferentially private (DP) synthetic datasets are a powerful approach for training machine learning models while respecting the privacy of individual data providers. The effect of DP on the fairness of the resulting trained models is not…

Machine Learning · Statistics 2021-06-21 Mayana Pereira , Meghana Kshirsagar , Sumit Mukherjee , Rahul Dodhia , Juan Lavista Ferres

The private collection of multiple statistics from a population is a fundamental statistical problem. One possible approach to realize this is to rely on the local model of differential privacy (LDP). Numerous LDP protocols have been…

Cryptography and Security · Computer Science 2023-08-02 Héber H. Arcolezi , Sébastien Gambs , Jean-François Couchot , Catuscia Palamidessi

Train machine learning models on sensitive user data has raised increasing privacy concerns in many areas. Federated learning is a popular approach for privacy protection that collects the local gradient information instead of real data.…

Cryptography and Security · Computer Science 2021-05-24 Lichao Sun , Jianwei Qian , Xun Chen

Gradient leakage attacks are considered one of the wickedest privacy threats in deep learning as attackers covertly spy gradient updates during iterative training without compromising model training quality, and yet secretly reconstruct…

Machine Learning · Computer Science 2021-12-28 Wenqi Wei , Ling Liu

In-context learning (ICL) enables large language models (LLMs) to adapt to new tasks by conditioning on demonstrations of question-answer pairs and it has been shown to have comparable performance to costly model retraining and fine-tuning.…

Cryptography and Security · Computer Science 2024-03-12 Alycia N. Carey , Karuna Bhaila , Kennedy Edemacu , Xintao Wu