English
Related papers

Related papers: Computation-Utility-Privacy Tradeoffs in Bayesian …

200 papers

The synthetic data approach to data confidentiality has been actively researched on, and for the past decade or so, a good number of high quality work on developing innovative synthesizers, creating appropriate utility measures and risk…

Methodology · Statistics 2021-05-11 Jingchen Hu

Differential privacy is a restriction on data processing algorithms that provides strong confidentiality guarantees for individual records in the data. However, research on proper statistical inference, that is, research on properly…

Cryptography and Security · Computer Science 2021-07-06 Joerg Drechsler , Ira Globus-Harris , Audra McMillan , Jayshree Sarathy , Adam Smith

We propose a novel theoretical and methodological framework for Gaussian process regression subject to privacy constraints. The proposed method can be used when a data owner is unwilling to share a high-fidelity supervised learning model…

Machine Learning · Computer Science 2025-10-14 Rui Tuo , Haoyuan Chen , Raktim Bhattacharya

Median regression analysis has robustness properties which make it attractive compared with regression based on the mean, while differential privacy can protect individual privacy during statistical analysis of certain datasets. In this…

Computation · Statistics 2020-06-05 E Chen , Ying Miao , Yu Tang

Differential privacy mechanisms such as the Gaussian or Laplace mechanism have been widely used in data analytics for preserving individual privacy. However, they are mostly designed for continuous outputs and are unsuitable for scenarios…

Cryptography and Security · Computer Science 2024-06-06 Zhongteng Cai , Xueru Zhang , Mohammad Mahdi Khalili

Ratio statistics--such as relative risk and odds ratios--play a central role in hypothesis testing, model evaluation, and decision-making across many areas of machine learning, including causal inference and fairness analysis. However,…

Machine Learning · Statistics 2025-05-28 Tomer Shoham , Katrina Ligettt

We study the problem of fitting the high dimensional sparse linear regression model with sub-Gaussian covariates and responses, where the data are provided by strategic or self-interested agents (individuals) who prioritize their privacy of…

Computer Science and Game Theory · Computer Science 2024-10-18 Liyang Zhu , Amina Manseur , Meng Ding , Jinyan Liu , Jinhui Xu , Di Wang

We consider Bayesian optimization of the output of a network of functions, where each function takes as input the output of its parent nodes, and where the network takes significant time to evaluate. Such problems arise, for example, in…

Machine Learning · Computer Science 2022-01-03 Raul Astudillo , Peter I. Frazier

Bayesian optimization is a coherent, ubiquitous approach to decision-making under uncertainty, with applications including multi-arm bandits, active learning, and black-box optimization. Bayesian optimization selects decisions (i.e.…

Machine Learning · Computer Science 2023-12-13 Samuel Stanton , Wesley Maddox , Andrew Gordon Wilson

Bayesian optimization is a powerful tool for expensive stochastic black-box optimization problems such as simulation-based optimization or machine learning hyperparameter tuning. Many stochastic objective functions implicitly require a…

Machine Learning · Statistics 2019-10-22 Michael Pearce , Matthias Poloczek , Juergen Branke

Private inference refers to a two-party setting in which one has a model (e.g., a linear classifier), the other has data, and the model is to be applied over the data while safeguarding the privacy of both parties. In particular, models in…

Information Theory · Computer Science 2023-05-09 Zirui Deng , Netanel Raviv

Differential privacy formalises privacy-preserving mechanisms that provide access to a database. We pose the question of whether Bayesian inference itself can be used directly to provide private access to data, with no modification. The…

We investigate the problem of estimating a random variable $Y\in \mathcal{Y}$ under a privacy constraint dictated by another random variable $X\in \mathcal{X}$, where estimation efficiency and privacy are assessed in terms of two different…

Information Theory · Computer Science 2018-08-14 Shahab Asoodeh , Mario Diaz , Fady Alajaji , Tamas Linder

We develop lower bounds for estimation under local privacy constraints---including differential privacy and its relaxations to approximate or R\'{e}nyi differential privacy---by showing an equivalence between private estimation and…

Statistics Theory · Mathematics 2019-05-07 John Duchi , Ryan Rogers

A common approach of system identification and machine learning is to generate a model by using training data to predict the test data instances as accurate as possible. Nonetheless, concerns about data privacy are increasingly raised, but…

Machine Learning · Computer Science 2023-04-18 Jaron Skovsted Gundersen , Bulut Kuskonmaz , Rafael Wisniewski

Bayesian optimization is a sample-efficient method for solving expensive, black-box optimization problems. Stochastic programming concerns optimization under uncertainty where, typically, average performance is the quantity of interest. In…

Machine Learning · Statistics 2025-02-19 Jack M. Buckingham , Ivo Couckuyt , Juergen Branke

Machine learning algorithms frequently require careful tuning of model hyperparameters, regularization terms, and optimization parameters. Unfortunately, this tuning is often a "black art" that requires expert experience, unwritten rules of…

Machine Learning · Statistics 2012-08-30 Jasper Snoek , Hugo Larochelle , Ryan P. Adams

Many machine learning applications are based on data collected from people, such as their tastes and behaviour as well as biological traits and genetic data. Regardless of how important the application might be, one has to make sure…

Machine Learning · Statistics 2017-04-11 Joonas Jälkö , Onur Dikmen , Antti Honkela

We study the problem of differentially private optimization with linear constraints when the right-hand-side of the constraints depends on private data. This type of problem appears in many applications, especially resource allocation.…

Machine Learning · Computer Science 2020-11-05 Andrés Muñoz Medina , Umar Syed , Sergei Vassilvitskii , Ellen Vitercik

Data analysis has high value both for commercial and research purposes. However, disclosing analysis results may pose severe privacy risk to individuals. Privug is a method to quantify privacy risks of data analytics programs by analyzing…

Cryptography and Security · Computer Science 2023-09-01 Rasmus C. Rønneberg , Raúl Pardo , Andrzej Wąsowski