中文
相关论文

相关论文: Differentially Private Dropout

200 篇论文

Differentially private (DP) training preserves the data privacy usually at the cost of slower convergence (and thus lower accuracy), as well as more severe mis-calibration than its non-private counterpart. To analyze the convergence of DP…

机器学习 · 计算机科学 2023-06-21 Zhiqi Bu , Hua Wang , Zongyu Dai , Qi Long

Differential privacy is a widely adopted framework designed to safeguard the sensitive information of data providers within a data set. It is based on the application of controlled noise at the interface between the server that stores and…

密码学与安全 · 计算机科学 2024-05-06 Rūta Binkytė , Carlos Pinzón , Szilvia Lestyán , Kangsoo Jung , Héber H. Arcolezi , Catuscia Palamidessi

Differential privacy is becoming a gold standard for privacy research; it offers a guaranteed bound on loss of privacy due to release of query results, even under worst-case assumptions. The theory of differential privacy is an active…

In this paper, we present a notion of differential privacy (DP) for data that comes from different classes. Here, the class-membership is private information that needs to be protected. The proposed method is an output perturbation…

信号处理 · 电气工程与系统科学 2023-06-12 Raksha Ramakrishna , Anna Scaglione , Tong Wu , Nikhil Ravi , Sean Peisert

Differential privacy is one of the methods to solve the problem of privacy protection in federated learning. Setting the same privacy budget for each round will result in reduced accuracy in training. The existing methods of the adjustment…

密码学与安全 · 计算机科学 2024-08-20 Zhiqiang Wang , Xinyue Yu , Qianli Huang , Yongguang Gong

Nowadays, machine learning models and applications have become increasingly pervasive. With this rapid increase in the development and employment of machine learning models, a concern regarding privacy has risen. Thus, there is a legitimate…

机器学习 · 计算机科学 2022-11-22 Samah Baraheem , Zhongmei Yao

The collection of individuals' data has become commonplace in many industries. Local differential privacy (LDP) offers a rigorous approach to preserving privacy whereby the individual privatises their data locally, allowing only their…

机器学习 · 计算机科学 2022-05-17 Alex Mansbridge , Gregory Barbour , Davide Piras , Michael Murray , Christopher Frye , Ilya Feige , David Barber

Gradient perturbation, widely used for differentially private optimization, injects noise at every iterative update to guarantee differential privacy. Previous work first determines the noise level that can satisfy the privacy requirement…

机器学习 · 计算机科学 2020-10-27 Da Yu , Huishuai Zhang , Wei Chen , Tie-Yan Liu , Jian Yin

Differential privacy (DP) is a popular mechanism for training machine learning models with bounded leakage about the presence of specific points in the training data. The cost of differential privacy is a reduction in the model's accuracy.…

机器学习 · 计算机科学 2019-10-29 Eugene Bagdasaryan , Vitaly Shmatikov

Dropout is often used in deep neural networks to prevent over-fitting. Conventionally, dropout training invokes \textit{random drop} of nodes from the hidden layers of a Neural Network. It is our hypothesis that a guided selection of nodes…

机器学习 · 计算机科学 2018-12-11 Rohit Keshari , Richa Singh , Mayank Vatsa

Black-box machine learning models are used in critical decision-making domains, giving rise to several calls for more algorithmic transparency. The drawback is that model explanations can leak information about the training data and the…

机器学习 · 计算机科学 2020-06-17 Neel Patel , Reza Shokri , Yair Zick

We study the privacy risks that are associated with training a neural network's weights with self-supervised learning algorithms. Through empirical evidence, we show that the fine-tuning stage, in which the network weights are updated with…

机器学习 · 计算机科学 2022-05-26 Yunhao Yang , Parham Gohari , Ufuk Topcu

Differential privacy is achieved by the introduction of Laplacian noise in the response to a query, establishing a precise trade-off between the level of differential privacy and the accuracy of the database response (via the amount of…

数据库 · 计算机科学 2014-07-02 Maurizio Naldi , Giuseppe D'Acquisto

Differential privacy has gained popularity in machine learning as a strong privacy guarantee, in contrast to privacy mitigation techniques such as k-anonymity. However, applying differential privacy to n-gram counts significantly degrades…

密码学与安全 · 计算机科学 2021-02-01 Osman Ramadan , James Withers , Douglas Orr

Training generative models with differential privacy (DP) typically involves injecting noise into gradient updates or adapting the discriminator's training procedure. As a result, such approaches often struggle with hyper-parameter tuning…

机器学习 · 计算机科学 2024-10-29 Kristjan Greenewald , Yuancheng Yu , Hao Wang , Kai Xu

In a world where artificial intelligence and data science become omnipresent, data sharing is increasingly locking horns with data-privacy concerns. Differential privacy has emerged as a rigorous framework for protecting individual privacy…

密码学与安全 · 计算机科学 2022-06-06 March Boedihardjo , Thomas Strohmer , Roman Vershynin

Designing privacy-preserving machine learning algorithms has received great attention in recent years, especially in the setting when the data contains sensitive information. Differential privacy (DP) is a widely used mechanism for data…

机器学习 · 计算机科学 2025-09-11 Chunyang Liao , Deanna Needell , Hayden Schaeffer , Alexander Xue

Differential privacy is a mathematical framework for privacy-preserving data analysis. Changing the hyperparameters of a differentially private algorithm allows one to trade off privacy and utility in a principled way. Quantifying this…

机器学习 · 统计学 2020-07-23 Brendan Avent , Javier Gonzalez , Tom Diethe , Andrei Paleyes , Borja Balle

The problem of privately releasing data is to provide a version of a dataset without revealing sensitive information about the individuals who contribute to the data. The model of differential privacy allows such private release while…

数据库 · 计算机科学 2011-03-07 Graham Cormode , Magda Procopiuc , Divesh Srivastava , Thanh T. L. Tran

A major challenge in applying differential privacy to training deep neural network models is scalability.The widely-used training algorithm, differentially private stochastic gradient descent (DP-SGD), struggles with training…

机器学习 · 计算机科学 2023-03-09 Kamil Adamczewski , Mijung Park