English
Related papers

Related papers: Differentially Private Random Feature Model

200 papers

Differential Privacy (DP) is a widely adopted technique, valued for its effectiveness in protecting the privacy of task-specific datasets, making it a critical tool for large language models. However, its effectiveness in Multimodal Large…

Cryptography and Security · Computer Science 2025-06-10 Qianshan Wei , Jiaqi Li , Zihan You , Yi Zhan , Kecen Li , Jialin Wu , Xinfeng Li Hengjun Liu , Yi Yu , Bin Cao , Yiwen Xu , Yang Liu , Guilin Qi

The Differential Privacy (DP) literature often centers on meeting privacy constraints by introducing noise to the query, typically using a pre-specified parametric distribution model with one or two degrees of freedom. However, this…

Cryptography and Security · Computer Science 2024-09-30 Sachin Kadam , Anna Scaglione , Nikhil Ravi , Sean Peisert , Brent Lunghino , Aram Shumavon

Machine learning models are increasingly made available to the masses through public query interfaces. Recent academic work has demonstrated that malicious users who can query such models are able to infer sensitive information about…

Cryptography and Security · Computer Science 2017-12-27 Yunhui Long , Vincent Bindschaedler , Carl A. Gunter

Privacy preserving in machine learning is a crucial issue in industry informatics since data used for training in industries usually contain sensitive information. Existing differentially private machine learning algorithms have not…

Machine Learning · Computer Science 2020-10-08 Tao Zhang , Tianqing Zhu , Ping Xiong , Huan Huo , Zahir Tari , Wanlei Zhou

Many applications of machine learning, for example in health care, would benefit from methods that can guarantee privacy of data subjects. Differential privacy (DP) has become established as a standard for protecting learning results. The…

Machine Learning · Statistics 2017-05-30 Mikko Heikkilä , Eemil Lagerspetz , Samuel Kaski , Kana Shimizu , Sasu Tarkoma , Antti Honkela

Differential privacy is a widely accepted measure of privacy in the context of deep learning algorithms, and achieving it relies on a noisy training approach known as differentially private stochastic gradient descent (DP-SGD). DP-SGD…

Machine Learning · Computer Science 2023-07-26 Ce Feng , Nuo Xu , Wujie Wen , Parv Venkitasubramaniam , Caiwen Ding

Differential Privacy (DP) is a well-established framework to quantify privacy loss incurred by any algorithm. Traditional DP formulations impose a uniform privacy requirement for all users, which is often inconsistent with real-world…

Cryptography and Security · Computer Science 2023-05-18 Syomantak Chaudhuri , Thomas A. Courtade

We study privacy in a distributed learning framework, where clients collaboratively build a learning model iteratively through interactions with a server from whom we need privacy. Motivated by stochastic optimization and the federated…

Machine Learning · Computer Science 2021-07-20 Antonious M. Girgis , Deepesh Data , Suhas Diggavi

We address the problem of learning a machine learning model from training data that originates at multiple data owners while providing formal privacy guarantees regarding the protection of each owner's data. Existing solutions based on…

Cryptography and Security · Computer Science 2025-03-12 Sikha Pentyala , Davis Railsback , Ricardo Maia , Rafael Dowsley , David Melanson , Anderson Nascimento , Martine De Cock

Differential privacy (DP) techniques can be applied to the federated learning model to statistically guarantee data privacy against inference attacks to communication among the learning agents. While ensuring strong data privacy, however,…

Machine Learning · Computer Science 2022-02-22 Minseok Ryu , Kibaek Kim

Differentially private (DP) machine learning allows us to train models on private data while limiting data leakage. DP formalizes this data leakage through a cryptographic game, where an adversary must predict if a model was trained on a…

Machine Learning · Computer Science 2021-01-13 Milad Nasr , Shuang Song , Abhradeep Thakurta , Nicolas Papernot , Nicholas Carlini

Privacy issues of recommender systems have become a hot topic for the society as such systems are appearing in every corner of our life. In contrast to the fact that many secure multi-party computation protocols have been proposed to…

Cryptography and Security · Computer Science 2017-03-13 Jun Wang , Qiang Tang

In applications involving sensitive data, such as finance and healthcare, the necessity for preserving data privacy can be a significant barrier to machine learning model development. Differential privacy (DP) has emerged as one canonical…

Machine Learning · Computer Science 2022-11-15 Zachary Izzo , Jinsung Yoon , Sercan O. Arik , James Zou

A major challenge in applying differential privacy to training deep neural network models is scalability.The widely-used training algorithm, differentially private stochastic gradient descent (DP-SGD), struggles with training…

Machine Learning · Computer Science 2023-03-09 Kamil Adamczewski , Mijung Park

Graph Neural Networks have achieved tremendous success in modeling complex graph data in a variety of applications. However, there are limited studies investigating privacy protection in GNNs. In this work, we propose a learning framework…

Machine Learning · Computer Science 2024-08-07 Karuna Bhaila , Wen Huang , Yongkai Wu , Xintao Wu

To preserve client privacy in the data mining process, a variety of techniques based on random perturbation of data records have been proposed recently. In this paper, we present a generalized matrix-theoretic model of random perturbation,…

Databases · Computer Science 2007-05-23 Shipra Agrawal , Jayant R. Haritsa

In this paper, we focus on developing a novel mechanism to preserve differential privacy in deep neural networks, such that: (1) The privacy budget consumption is totally independent of the number of training steps; (2) It has the ability…

Cryptography and Security · Computer Science 2018-04-24 NhatHai Phan , Xintao Wu , Han Hu , Dejing Dou

Differential privacy (DP) has been applied in deep learning for preserving privacy of the underlying training sets. Existing DP practice falls into three categories - objective perturbation, gradient perturbation and output perturbation.…

Cryptography and Security · Computer Science 2022-04-28 Zhigang Lu , Hassan Jameel Asghar , Mohamed Ali Kaafar , Darren Webb , Peter Dickinson

Often we consider machine learning models or statistical analysis methods which we endeavour to alter, by introducing a randomized mechanism, to make the model conform to a differential privacy constraint. However, certain models can often…

Machine Learning · Computer Science 2024-05-24 Jack Fitzsimons , Agustín Freitas Pasqualini , Robert Pisarczyk , Dmitrii Usynin

Differential privacy (DP) is a rigorous notion of data privacy, used for private statistics. The canonical algorithm for differentially private mean estimation is to first clip the samples to a bounded range and then add noise to their…

Statistics Theory · Mathematics 2024-10-10 Gautam Kamath , Argyris Mouzakis , Matthew Regehr , Vikrant Singhal , Thomas Steinke , Jonathan Ullman