English
Related papers

Related papers: Private Posterior distributions from Variational a…

200 papers

Statistical model checking is a class of sequential algorithms that can verify specifications of interest on an ensemble of cyber-physical systems (e.g., whether 99% of cars from a batch meet a requirement on their energy efficiency). These…

Machine Learning · Computer Science 2022-06-29 Yu Wang , Hussein Sibai , Mark Yen , Sayan Mitra , Geir E. Dullerud

Shuffle model of differential privacy is a novel distributed privacy model based on a combination of local privacy mechanisms and a secure shuffler. It has been shown that the additional randomisation provided by the shuffler improves…

Cryptography and Security · Computer Science 2022-02-02 Antti Koskela , Mikko A. Heikkilä , Antti Honkela

Differential privacy has become a widely accepted notion of privacy, leading to the introduction and deployment of numerous privatization mechanisms. However, ensuring the privacy guarantee is an error-prone process, both in designing…

Information Theory · Computer Science 2019-05-27 Xiyang Liu , Sewoong Oh

We show how to achieve differential privacy with no or reduced added noise, based on the empirical noise in the data itself. Unlike previous works on noiseless privacy, the empirical viewpoint avoids making any explicit assumptions about…

Machine Learning · Computer Science 2023-01-05 Paul Burchard , Anthony Daoud , Dominic Dotterrer

In this brief, we present an enhanced privacy-preserving distributed estimation algorithm, referred to as the ``Double-Private Algorithm," which combines the principles of both differential privacy (DP) and cryptography. The proposed…

Signal Processing · Electrical Eng. & Systems 2024-03-19 Mehdi Korki , Fatemehsadat Hosseiniamin , Hadi Zayyani , Mehdi Bekrani

We consider a refinement of differential privacy --- per instance differential privacy (pDP), which captures the privacy of a specific individual with respect to a fixed data set. We show that this is a strict generalization of the standard…

Machine Learning · Statistics 2018-11-15 Yu-Xiang Wang

We consider the problem of Bayesian learning on sensitive datasets and present two simple but somewhat surprising results that connect Bayesian learning to "differential privacy:, a cryptographic approach to protect individual-level privacy…

Machine Learning · Statistics 2015-04-14 Yu-Xiang Wang , Stephen E. Fienberg , Alex Smola

We design a class of additive noise mechanisms that satisfy \((\varepsilon, \delta)\)-differential privacy (DP) for scalar, real-valued query functions with known sensitivities, with a particular focus on moderate and low-privacy regimes.…

Cryptography and Security · Computer Science 2026-05-28 Huikang Liu , Aras Selvi , Wolfram Wiesemann

In this paper, we focus on developing a novel mechanism to preserve differential privacy in deep neural networks, such that: (1) The privacy budget consumption is totally independent of the number of training steps; (2) It has the ability…

Cryptography and Security · Computer Science 2018-04-24 NhatHai Phan , Xintao Wu , Han Hu , Dejing Dou

The randomized power method has gained significant interest due to its simplicity and efficient handling of large-scale spectral analysis and recommendation tasks. However, its application to large datasets containing personal information…

Machine Learning · Computer Science 2025-06-13 Julien Nicolas , César Sabater , Mohamed Maouche , Sonia Ben Mokhtar , Mark Coates

Differential privacy (DP) is becoming increasingly important for deployed machine learning applications because it provides strong guarantees for protecting the privacy of individuals whose data is used to train models. However, DP…

Balancing privacy and accuracy is a major challenge in designing differentially private machine learning algorithms. One way to improve this tradeoff for free is to leverage the noise in common data operations that already use randomness.…

Machine Learning · Computer Science 2021-10-20 Jacob Imola , Kamalika Chaudhuri

With the growing volume of data in society, the need for privacy protection in data analysis also rises. In particular, private selection tasks, wherein the most important information is retrieved under differential privacy are emphasized…

Data Structures and Algorithms · Computer Science 2024-10-15 Akito Yamamoto , Tetsuo Shibuya

Data privacy is an important concern in machine learning, and is fundamentally at odds with the task of training useful learning models, which typically require the acquisition of large amounts of private user data. One possible way of…

Machine Learning · Computer Science 2019-02-14 Mehrdad Showkatbakhsh , Can Karakus , Suhas Diggavi

The Probably Approximately Correct (PAC) Bayes framework (McAllester, 1999) can incorporate knowledge about the learning algorithm and (data) distribution through the use of distribution-dependent priors, yielding tighter generalization…

Machine Learning · Computer Science 2019-04-22 Gintare Karolina Dziugaite , Daniel M. Roy

Differential privacy is a framework for privately releasing summaries of a database. Previous work has focused mainly on methods for which the output is a finite dimensional vector, or an element of some discrete set. We develop methods for…

Machine Learning · Statistics 2012-03-13 Rob Hall , Alessandro Rinaldo , Larry Wasserman

Statistical agencies rely on sampling techniques to collect socio-demographic data crucial for policy-making and resource allocation. This paper shows that surveys of important societal relevance introduce sampling errors that unevenly…

Cryptography and Security · Computer Science 2025-01-22 Joonhyuk Ko , Juba Ziani , Saswat Das , Matt Williams , Ferdinando Fioretto

To meet the standard of differential privacy, noise is usually added into the original data, which inevitably deteriorates the predicting performance of subsequent learning algorithms. In this paper, motivated by the success of improving…

Machine Learning · Computer Science 2019-06-04 Quanming Yao , Xiawei Guo , James T. Kwok , WeiWei Tu , Yuqiang Chen , Wenyuan Dai , Qiang Yang

We derive the optimal $(0, \delta)$-differentially private query-output independent noise-adding mechanism for single real-valued query function under a general cost-minimization framework. Under a mild technical condition, we show that the…

Cryptography and Security · Computer Science 2019-02-06 Quan Geng , Wei Ding , Ruiqi Guo , Sanjiv Kumar

Training generative models with differential privacy (DP) typically involves injecting noise into gradient updates or adapting the discriminator's training procedure. As a result, such approaches often struggle with hyper-parameter tuning…

Machine Learning · Computer Science 2024-10-29 Kristjan Greenewald , Yuancheng Yu , Hao Wang , Kai Xu