English
Related papers

Related papers: Differentially Private Bayesian Inference for Gaus…

200 papers

Differential privacy has seen remarkable success as a rigorous and practical formalization of data privacy in the past decade. This privacy definition and its divergence based relaxations, however, have several acknowledged weaknesses,…

Machine Learning · Computer Science 2019-06-03 Jinshuo Dong , Aaron Roth , Weijie J. Su

We present a general method for privacy-preserving Bayesian inference in Poisson factorization, a broad class of models that includes some of the most widely used models in the social sciences. Our method satisfies limited precision local…

Machine Learning · Statistics 2019-02-25 Aaron Schein , Zhiwei Steven Wu , Alexandra Schofield , Mingyuan Zhou , Hanna Wallach

Learning a privacy-preserving model from sensitive data which are distributed across multiple devices is an increasingly important problem. The problem is often formulated in the federated learning context, with the aim of learning a single…

Machine Learning · Computer Science 2023-04-20 Mikko A. Heikkilä , Matthew Ashman , Siddharth Swaroop , Richard E. Turner , Antti Honkela

In practice, differentially private data releases are designed to support a variety of applications. A data release is fit for use if it meets target accuracy requirements for each application. In this paper, we consider the problem of…

Databases · Computer Science 2021-06-15 Yingtai Xiao , Zeyu Ding , Yuxin Wang , Danfeng Zhang , Daniel Kifer

Since being proposed in 2006, differential privacy has become a standard method for quantifying certain risks in publishing or sharing analyses of sensitive data. At its heart, differential privacy measures risk in terms of the differences…

Information Theory · Computer Science 2025-11-19 Anand D. Sarwate , Flavio P. Calmon , Oliver Kosut , Lalitha Sankar

Differential privacy is a cryptographically-motivated definition of privacy which has gained significant attention over the past few years. Differentially private solutions enforce privacy by adding random noise to a function computed over…

Machine Learning · Computer Science 2012-07-03 Kamalika Chaudhuri , Daniel Hsu

Learning the joint dependence of discrete variables is a fundamental problem in machine learning, with many applications including prediction, clustering and dimensionality reduction. More recently, the framework of copula modeling has…

Machine Learning · Statistics 2013-11-15 Alfredo Kalaitzis , Ricardo Silva

Instance-wise feature selection and ranking methods can achieve a good selection of task-friendly features for each sample in the context of neural networks. However, existing approaches that assume feature subsets to be independent are…

Machine Learning · Computer Science 2023-08-02 Hanyu Peng , Guanhua Fang , Ping Li

We develop lower bounds for estimation under local privacy constraints---including differential privacy and its relaxations to approximate or R\'{e}nyi differential privacy---by showing an equivalence between private estimation and…

Statistics Theory · Mathematics 2019-05-07 John Duchi , Ryan Rogers

Differential privacy comes equipped with multiple analytical tools for the design of private data analyses. One important tool is the so-called "privacy amplification by subsampling" principle, which ensures that a differentially private…

Machine Learning · Computer Science 2018-11-26 Borja Balle , Gilles Barthe , Marco Gaboardi

We develop a sharp, experiment-level privacy theory for amplification by shuffling in the Gaussian regime: a fixed finite-output local randomizer with full support and neighboring binary datasets differing in one user. We first prove exact…

Information Theory · Computer Science 2026-03-24 Alex Shvets

We present simple differentially private estimators for the mean and covariance of multivariate sub-Gaussian data that are accurate at small sample sizes. We demonstrate the effectiveness of our algorithms both theoretically and empirically…

Machine Learning · Statistics 2026-02-10 Sourav Biswas , Yihe Dong , Gautam Kamath , Jonathan Ullman

In this rejoinder, we aim to address two broad issues that cover most comments made in the discussion. First, we discuss some theoretical aspects of our work and comment on how this work might impact the theoretical foundation of…

Cryptography and Security · Computer Science 2021-06-29 Jinshuo Dong , Aaron Roth , Weijie J. Su

This paper studies how to approximate pufferfish privacy when the adversary's prior belief of the published data is Gaussian distributed. Using Monge's optimal transport plan, we show that $(\epsilon, \delta)$-pufferfish privacy is attained…

Information Theory · Computer Science 2024-05-08 Ni Ding

Differential privacy schemes have been widely adopted in recent years to address issues of data privacy protection. We propose a new Gaussian scheme combining with another data protection technique, called random orthogonal matrix masking,…

Cryptography and Security · Computer Science 2023-04-13 A. Adam Ding , Samuel S. Wu , Guanhong Miao , Shigang Chen

The wide deployment of machine learning in recent years gives rise to a great demand for large-scale and high-dimensional data, for which the privacy raises serious concern. Differential privacy (DP) mechanisms are conventionally developed…

Cryptography and Security · Computer Science 2021-05-03 Jungang Yang , Liyao Xiang , Weiting Li , Wei Liu , Xinbing Wang

In this manuscript, we provide a set of tools (in terms of semidefinite programs) to synthesize Gaussian mechanisms to maximize privacy of databases. Information about the database is disclosed through queries requested by (potentially)…

Systems and Control · Electrical Eng. & Systems 2022-03-30 Haleh Hayati , Carlos Murguia , Nathan van de Wouw

In recent years, local differential privacy (LDP) has emerged as a technique of choice for privacy-preserving data collection in several scenarios when the aggregator is not trustworthy. LDP provides client-side privacy by adding noise at…

Machine Learning · Statistics 2021-10-28 Tejas Kulkarni , Joonas Jälkö , Samuel Kaski , Antti Honkela

We provide optimal lower bounds for two well-known parameter estimation (also known as statistical estimation) tasks in high dimensions with approximate differential privacy. First, we prove that for any $\alpha \le O(1)$, estimating the…

Statistics Theory · Mathematics 2024-01-05 Shyam Narayanan

Correlation clustering is a widely used technique in unsupervised machine learning. Motivated by applications where individual privacy is a concern, we initiate the study of differentially private correlation clustering. We propose an…

Machine Learning · Computer Science 2021-02-18 Mark Bun , Marek Eliáš , Janardhan Kulkarni