English
Related papers

Related papers: Principled Evaluation of Differentially Private Al…

200 papers

Differentially private training algorithms provide protection against one of the most popular attacks in machine learning: the membership inference attack. However, these privacy algorithms incur a loss of the model's classification…

Cryptography and Security · Computer Science 2021-10-13 Jiaxiang Liu , Simon Oya , Florian Kerschbaum

Differential Privacy (DP) is the leading approach to privacy preserving deep learning. As such, there are multiple efforts to provide drop-in integration of DP into popular frameworks. These efforts, which add noise to each gradient…

Machine Learning · Statistics 2021-06-08 Mathias Lécuyer

Decentralized optimization is gaining increased traction due to its widespread applications in large-scale machine learning and multi-agent systems. The same mechanism that enables its success, i.e., information sharing among participating…

Optimization and Control · Mathematics 2024-02-07 Yongqiang Wang , Angelia Nedic

We study a pitfall in the typical workflow for differentially private machine learning. The use of differentially private learning algorithms in a "drop-in" fashion -- without accounting for the impact of differential privacy (DP) noise…

Cryptography and Security · Computer Science 2022-05-16 Wenxuan Bao , Luke A. Bauer , Vincent Bindschaedler

Differential privacy is one of the methods to solve the problem of privacy protection in federated learning. Setting the same privacy budget for each round will result in reduced accuracy in training. The existing methods of the adjustment…

Cryptography and Security · Computer Science 2024-08-20 Zhiqiang Wang , Xinyue Yu , Qianli Huang , Yongguang Gong

This paper firstly considers the research problem of fairness in collaborative deep learning, while ensuring privacy. A novel reputation system is proposed through digital tokens and local credibility to ensure fairness, in combination with…

Cryptography and Security · Computer Science 2020-07-21 Lingjuan Lyu , Yitong Li , Karthik Nandakumar , Jiangshan Yu , Xingjun Ma

Differential privacy (DP) is a rigorous notion of data privacy, used for private statistics. The canonical algorithm for differentially private mean estimation is to first clip the samples to a bounded range and then add noise to their…

Statistics Theory · Mathematics 2024-10-10 Gautam Kamath , Argyris Mouzakis , Matthew Regehr , Vikrant Singhal , Thomas Steinke , Jonathan Ullman

Privacy preserving machine learning deployments in sensitive deep learning applications; from medical imaging to autonomous systems; increasingly require combining multiple techniques. Yet, practitioners lack systematic guidance to assess…

Cryptography and Security · Computer Science 2026-02-24 Nnaemeka Obiefuna , Samuel Oyeneye , Similoluwa Odunaiya , Iremide Oyelaja , Steven Kolawole

Confidence intervals for the population mean of normally distributed data are some of the most standard statistical outputs one might want from a database. In this work we give practical differentially private algorithms for this task. We…

Methodology · Statistics 2020-01-09 Wenxin Du , Canyon Foot , Monica Moniot , Andrew Bray , Adam Groce

Ensuring differential privacy of models learned from sensitive user data is an important goal that has been studied extensively in recent years. It is now known that for some basic learning problems, especially those involving…

Machine Learning · Computer Science 2018-05-10 Cynthia Dwork , Vitaly Feldman

With the growing volume of data in society, the need for privacy protection in data analysis also rises. In particular, private selection tasks, wherein the most important information is retrieved under differential privacy are emphasized…

Data Structures and Algorithms · Computer Science 2024-10-15 Akito Yamamoto , Tetsuo Shibuya

Differential privacy (DP) is a prominent method for protecting information about individuals during data analysis. Training neural networks with differentially private stochastic gradient descent (DPSGD) influences the model's learning…

Machine Learning · Computer Science 2025-10-10 Lea Demelius , Dominik Kowald , Simone Kopeinik , Roman Kern , Andreas Trügler

Data holders are increasingly seeking to protect their user's privacy, whilst still maximizing their ability to produce machine models with high quality predictions. In this work, we empirically evaluate various implementations of…

Cryptography and Security · Computer Science 2020-09-16 Benjamin Zi Hao Zhao , Mohamed Ali Kaafar , Nicolas Kourtellis

In this paper, we consider the problem of responding to a count query (or any other integer-valued queries) evaluated on a dataset containing sensitive attributes. To protect the privacy of individuals in the dataset, a standard practice is…

Information Theory · Computer Science 2020-07-21 Parastoo Sadeghi , Shahab Asoodeh , Flavio du Pin Calmon

Differentially private noise mechanisms commonly use symmetric noise distributions. This is attractive both for achieving the differential privacy definition, and for unbiased expectations in the noised answers. However, there are contexts…

Cryptography and Security · Computer Science 2021-10-18 Benjamin M. Case , James Honaker , Mahnush Movahedi

An important use of private data is to build machine learning classifiers. While there is a burgeoning literature on differentially private classification algorithms, we find that they are not practical in real applications due to two…

Machine Learning · Computer Science 2014-11-24 Ben Stoddard , Yan Chen , Ashwin Machanavajjhala

We study the problem of top-$k$ selection over a large domain universe subject to user-level differential privacy. Typically, the exponential mechanism or report noisy max are the algorithms used to solve this problem. However, these…

Cryptography and Security · Computer Science 2019-09-19 David Durfee , Ryan Rogers

This paper proposes a differentially private recursive least squares algorithm to estimate the parameter of autoregressive systems with exogenous inputs and multi-participants (MP-ARX systems) and protect each participant's sensitive…

Systems and Control · Electrical Eng. & Systems 2025-03-03 Jianwei Tan , Jimin Wang , Ji-Feng Zhang

Iterative algorithms, like gradient descent, are common tools for solving a variety of problems, such as model fitting. For this reason, there is interest in creating differentially private versions of them. However, their conversion to…

Machine Learning · Computer Science 2018-08-30 Jaewoo Lee , Daniel Kifer

Differential privacy is the leading mathematical framework for privacy protection, providing a probabilistic guarantee that safeguards individuals' private information when publishing statistics from a dataset. This guarantee is achieved by…

Methodology · Statistics 2025-08-19 Yuki Ohnishi , Jordan Awan