English
Related papers

Related papers: Computation-Utility-Privacy Tradeoffs in Bayesian …

200 papers

In this work, we give efficient algorithms for privately estimating a Gaussian distribution in both pure and approximate differential privacy (DP) models with optimal dependence on the dimension in the sample complexity. In the pure DP…

Data Structures and Algorithms · Computer Science 2023-06-02 Daniel Alabi , Pravesh K. Kothari , Pranay Tankala , Prayaag Venkat , Fred Zhang

We investigate unbiased high-dimensional mean estimators in differential privacy. We consider differentially private mechanisms whose expected output equals the mean of the input dataset, for every dataset drawn from a fixed bounded…

Statistics Theory · Mathematics 2023-12-22 Aleksandar Nikolov , Haohua Tang

Differential privacy guarantees allow the results of a statistical analysis involving sensitive data to be released without compromising the privacy of any individual taking part. Achieving such guarantees generally requires the injection…

Machine Learning · Statistics 2023-10-31 Jack Jewson , Sahra Ghalebikesabi , Chris Holmes

Bayesian optimization is a class of global optimization techniques. In Bayesian optimization, the underlying objective function is modeled as a realization of a Gaussian process. Although the Gaussian process assumption implies a random…

Statistics Theory · Mathematics 2023-05-08 Rui Tuo , Wenjia Wang

We propose a novel Bayesian inference framework for distributed differentially private linear regression. We consider a distributed setting where multiple parties hold parts of the data and share certain summary statistics of their portions…

Machine Learning · Statistics 2023-06-08 Barış Alparslan , Sinan Yıldırım , Ş. İlker Birbil

Differential privacy has emerged as an significant cornerstone in the realm of scientific hypothesis testing utilizing confidential data. In reporting scientific discoveries, Bayesian tests are widely adopted since they effectively…

Machine Learning · Statistics 2025-12-22 Abhisek Chakraborty , Saptati Datta

Bayesian inference has great promise for the privacy-preserving analysis of sensitive data, as posterior sampling automatically preserves differential privacy, an algorithmic notion of data privacy, under certain conditions (Dimitrakakis et…

Machine Learning · Computer Science 2016-06-10 James Foulds , Joseph Geumlek , Max Welling , Kamalika Chaudhuri

The Gaussian mechanism is an essential building block used in multitude of differentially private data analysis algorithms. In this paper we revisit the Gaussian mechanism and show that the original analysis has several important…

Machine Learning · Computer Science 2018-06-08 Borja Balle , Yu-Xiang Wang

The Gaussian mechanism is one differential privacy mechanism commonly used to protect numerical data. However, it may be ill-suited to some applications because it has unbounded support and thus can produce invalid numerical answers to…

Cryptography and Security · Computer Science 2022-12-01 Bo Chen , Matthew Hale

Bayesian Optimization is a popular approach for optimizing expensive black-box functions. Its key idea is to use a surrogate model to approximate the objective and, importantly, quantify the associated uncertainty that allows a sequential…

Machine Learning · Statistics 2025-02-05 Haoxian Chen , Henry Lam

We consider the problem of Bayesian learning on sensitive datasets and present two simple but somewhat surprising results that connect Bayesian learning to "differential privacy:, a cryptographic approach to protect individual-level privacy…

Machine Learning · Statistics 2015-04-14 Yu-Xiang Wang , Stephen E. Fienberg , Alex Smola

Bayesian optimization has emerged as a strong candidate tool for global optimization of functions with expensive evaluation costs. However, due to the dynamic nature of research in Bayesian approaches, and the evolution of computing…

Applications · Statistics 2018-08-24 Ran Rubin

We provide computationally efficient, differentially private algorithms for the classical regression settings of Least Squares Fitting, Binary Regression and Linear Regression with unbounded covariates. Prior to our work, privacy…

Cryptography and Security · Computer Science 2022-02-24 Jason Milionis , Alkis Kalavasis , Dimitris Fotakis , Stratis Ioannidis

We consider the problem of reinforcing federated learning with formal privacy guarantees. We propose to employ Bayesian differential privacy, a relaxation of differential privacy for similarly distributed data, to provide sharper privacy…

Machine Learning · Computer Science 2020-03-26 Aleksei Triastcyn , Boi Faltings

Bayesian optimization is a methodology for global optimization of unknown and expensive objectives. It combines a surrogate Bayesian regression model with an acquisition function to decide where to evaluate the objective. Typical regression…

Machine Learning · Computer Science 2023-04-04 Afonso Eduardo , Michael U. Gutmann

Bayesian optimization is an approach to optimizing objective functions that take a long time (minutes or hours) to evaluate. It is best-suited for optimization over continuous domains of less than 20 dimensions, and tolerates stochastic…

Machine Learning · Statistics 2018-07-10 Peter I. Frazier

Bayesian optimization is a popular tool for data-efficient optimization of expensive objective functions. In real-life applications like engineering design, the designer often wants to take multiple objectives as well as input uncertainty…

Artificial Intelligence · Computer Science 2022-02-28 J. Qing , I. Couckuyt , T. Dhaene

This paper concerns differentially private Bayesian estimation of the parameters of a population distribution, when a statistic of a sample from that population is shared in noise to provide differential privacy. This work mainly addresses…

Methodology · Statistics 2023-01-09 Baris Alparslan , Sinan Yildirim

Many modern statistical analysis and machine learning applications require training models on sensitive user data. Under a formal definition of privacy protection, differentially private algorithms inject calibrated noise into the…

Machine Learning · Statistics 2025-04-01 Yifei Xiong , Nianqiao Phyllis Ju , Sanguo Zhang

The increased use of differential privacy (DP) has allowed the sharing of large amounts of data while reducing the risk of disclosure of sensitive information at the individual level. However, the noise introduced by DP methods makes…

Methodology · Statistics 2026-04-29 Jordan Awan , Xi Chen , Roberto Molinari