中文
相关论文

相关论文: Training Set Reconstruction from Differentially Pr…

200 篇论文

Differentially private (DP) mechanisms are difficult to interpret and calibrate because existing methods for mapping standard privacy parameters to concrete privacy risks -- re-identification, attribute inference, and data reconstruction --…

Differential Privacy (DP) provides an elegant mathematical framework for defining a provable disclosure risk in the presence of arbitrary adversaries; it guarantees that whether an individual is in a database or not, the results of a DP…

密码学与安全 · 计算机科学 2021-08-19 Aleksandra Slavkovic , Roberto Molinari

In this paper, we aim to develop a scalable algorithm to preserve differential privacy (DP) in adversarial learning for deep neural networks (DNNs), with certified robustness to adversarial examples. By leveraging the sequential composition…

密码学与安全 · 计算机科学 2020-09-16 NhatHai Phan , My T. Thai , Han Hu , Ruoming Jin , Tong Sun , Dejing Dou

Mechanisms used in privacy-preserving machine learning often aim to guarantee differential privacy (DP) during model training. Practical DP-ensuring training methods use randomization when fitting model parameters to privacy-sensitive data…

机器学习 · 计算机科学 2023-05-16 Bogdan Kulynych , Hsiang Hsu , Carmela Troncoso , Flavio P. Calmon

Language modeling is a keystone task in natural language processing. When training a language model on sensitive information, differential privacy (DP) allows us to quantify the degree to which our private data is protected. However,…

机器学习 · 计算机科学 2020-10-27 Gavin Kerrigan , Dylan Slack , Jens Tuyls

Federated Learning (FL) allows for the training of Machine Learning models in a collaborative manner without the need to share sensitive data. However, it remains vulnerable to Gradient Leakage Attacks (GLAs), which can reveal private…

机器学习 · 计算机科学 2025-10-29 Miguel Fernandez-de-Retana , Unai Zulaika , Rubén Sánchez-Corcuera , Aitor Almeida

Machine learning models are known to memorize private data to reduce their training loss, which can be inadvertently exploited by privacy attacks such as model inversion and membership inference. To protect against these attacks,…

机器学习 · 计算机科学 2023-11-30 Jie Fu , Qingqing Ye , Haibo Hu , Zhili Chen , Lulu Wang , Kuncan Wang , Xun Ran

Differential privacy (DP) is a compelling privacy definition that explains the privacy-utility tradeoff via formal, provable guarantees. Inspired by recent progress toward general-purpose data release algorithms, we propose a private…

数据结构与算法 · 计算机科学 2020-06-17 Benjamin Coleman , Anshumali Shrivastava

Broad adoption of machine learning techniques has increased privacy concerns for models trained on sensitive data such as medical records. Existing techniques for training differentially private (DP) models give rigorous privacy guarantees,…

机器学习 · 统计学 2019-10-04 Zhengli Zhao , Nicolas Papernot , Sameer Singh , Neoklis Polyzotis , Augustus Odena

Differential privacy (DP) is the de facto standard for training machine learning (ML) models, including neural networks, while ensuring the privacy of individual examples in the training set. Despite a rich literature on how to train ML…

机器学习 · 计算机科学 2022-02-10 Alexey Kurakin , Shuang Song , Steve Chien , Roxana Geambasu , Andreas Terzis , Abhradeep Thakurta

The leakage of data might have been an extreme effect on the personal level if it contains sensitive information. Common prevention methods like encryption-decryption, endpoint protection, intrusion detection system are prone to leakage.…

密码学与安全 · 计算机科学 2020-06-12 Poushali Sengupta , Sudipta Paul , Subhankar Mishra

Differential privacy (DP) is applied when fine-tuning pre-trained large language models (LLMs) to limit leakage of training examples. While most DP research has focused on improving a model's privacy-utility tradeoff, some find that DP can…

计算与语言 · 计算机科学 2024-10-25 Md. Khairul Islam , Andrew Wang , Tianhao Wang , Yangfeng Ji , Judy Fox , Jieyu Zhao

Data holders are increasingly seeking to protect their user's privacy, whilst still maximizing their ability to produce machine models with high quality predictions. In this work, we empirically evaluate various implementations of…

密码学与安全 · 计算机科学 2020-09-16 Benjamin Zi Hao Zhao , Mohamed Ali Kaafar , Nicolas Kourtellis

Differential Privacy (DP) was originally developed to protect privacy. However, it has recently been utilized to secure machine learning (ML) models from poisoning attacks, with DP-SGD receiving substantial attention. Nevertheless, a…

密码学与安全 · 计算机科学 2023-11-13 Fereshteh Razmi , Jian Lou , Li Xiong

Recent research shows that large language models are susceptible to privacy attacks that infer aspects of the training data. However, it is unclear if simpler generative models, like topic models, share similar vulnerabilities. In this…

密码学与安全 · 计算机科学 2024-09-24 Nico Manzonelli , Wanrong Zhang , Salil Vadhan

We introduce an optimization-based reconstruction attack capable of completely or near-completely reconstructing a dataset utilized for training a random forest. Notably, our approach relies solely on information readily available in…

机器学习 · 计算机科学 2024-08-16 Julien Ferry , Ricardo Fukasawa , Timothée Pascal , Thibaut Vidal

Differentially private stochastic gradient descent (DP-SGD) is the canonical approach to private deep learning. While the current privacy analysis of DP-SGD is known to be tight in some settings, several empirical results suggest that…

机器学习 · 计算机科学 2024-07-17 Anvith Thudi , Hengrui Jia , Casey Meehan , Ilia Shumailov , Nicolas Papernot

Differential privacy (DP) ensures that training a machine learning model does not leak private data. In practice, we may have access to auxiliary public data that is free of privacy concerns. In this work, we assume access to a given amount…

机器学习 · 计算机科学 2024-09-11 Andrew Lowy , Zeman Li , Tianjian Huang , Meisam Razaviyayn

Federated learning is distributed model training across several clients without disclosing raw data. Despite advancements in data privacy, risks still remain. Differential Privacy (DP) is a technique to protect sensitive data by adding…

机器学习 · 计算机科学 2025-10-14 Tejash Varsani

Differential privacy (DP) is a prominent method for protecting information about individuals during data analysis. Training neural networks with differentially private stochastic gradient descent (DPSGD) influences the model's learning…

机器学习 · 计算机科学 2025-10-10 Lea Demelius , Dominik Kowald , Simone Kopeinik , Roman Kern , Andreas Trügler