English
Related papers

Related papers: Differentially private methods for managing model …

200 papers

We introduce a novel rule-based approach for handling regression problems. The new methodology carries elements from two frameworks: (i) it provides information about the uncertainty of the parameters of interest using Bayesian inference,…

Machine Learning · Statistics 2021-10-11 Themistoklis Botsas , Lachlan R. Mason , Indranil Pan

Point process models are of great importance in real world applications. In certain critical applications, estimation of point process models involves large amounts of sensitive personal data from users. Privacy concerns naturally arise…

Machine Learning · Computer Science 2022-09-16 Simiao Zuo , Tianyi Liu , Tuo Zhao , Hongyuan Zha

Bayesian model comparison (BMC) offers a principled probabilistic approach to study and rank competing models. In standard BMC, we construct a discrete probability distribution over the set of possible models, conditional on the observed…

Machine Learning · Statistics 2023-02-22 Marvin Schmitt , Stefan T. Radev , Paul-Christian Bürkner

We propose the approach of model-based differentially private synthesis (modips) in the Bayesian framework for releasing individual-level surrogate/synthetic datasets with privacy guarantees given the original data. The modips technique…

Methodology · Statistics 2021-04-27 Fang Liu

We show how to treat systematic uncertainties using Bayesian deep networks for regression. First, we analyze how these networks separately trace statistical and systematic uncertainties on the momenta of boosted top quarks forming fat jets.…

High Energy Physics - Phenomenology · Physics 2020-12-23 Gregor Kasieczka , Michel Luchmann , Florian Otterpohl , Tilman Plehn

Differential privacy is the leading mathematical framework for privacy protection, providing a probabilistic guarantee that safeguards individuals' private information when publishing statistics from a dataset. This guarantee is achieved by…

Methodology · Statistics 2025-08-19 Yuki Ohnishi , Jordan Awan

Model uncertainty is a central challenge in statistical models for binary outcomes such as logistic regression, arising when it is unclear which predictors should be included in the model. Many methods have been proposed to address this…

One of the big challenges in machine learning applications is that training data can be different from the real-world data faced by the algorithm. In language modeling, users' language (e.g. in private messaging) could change in a year and…

Computation and Language · Computer Science 2018-03-07 Vadim Popov , Mikhail Kudinov , Irina Piontkovskaya , Petr Vytovtov , Alex Nevidomsky

We investigate the problems of identity and closeness testing over a discrete population from random samples. Our goal is to develop efficient testers while guaranteeing Differential Privacy to the individuals of the population. We describe…

Machine Learning · Computer Science 2017-07-19 Maryam Aliakbarpour , Ilias Diakonikolas , Ronitt Rubinfeld

We propose a methodology for modeling and comparing probability distributions within a Bayesian nonparametric framework. Building on dependent normalized random measures, we consider a prior distribution for a collection of discrete random…

Methodology · Statistics 2022-06-01 Mario Beraha , Jim E. Griffin

Economics and social science research often require analyzing datasets of sensitive personal information at fine granularity, with models fit to small subsets of the data. Unfortunately, such fine-grained analysis can easily reveal…

Machine Learning · Computer Science 2020-07-13 Daniel Alabi , Audra McMillan , Jayshree Sarathy , Adam Smith , Salil Vadhan

The goal of this paper is to develop a practical and general-purpose approach to construct confidence intervals for differentially private parametric estimation. We find that the parametric bootstrap is a simple and effective solution. It…

Machine Learning · Computer Science 2021-10-13 Cecilia Ferrando , Shufan Wang , Daniel Sheldon

We present a framework to statistically audit the privacy guarantee conferred by a differentially private machine learner in practice. While previous works have taken steps toward evaluating privacy loss through poisoning attacks or…

Machine Learning · Computer Science 2023-01-10 Fred Lu , Joseph Munoz , Maya Fuchs , Tyler LeBlond , Elliott Zaresky-Williams , Edward Raff , Francis Ferraro , Brian Testa

We present a method for identification of models with good predictive performances in the family of Bayesian log-linear mixed models with Dirichlet process random effects. Such a problem arises in many different applications; here we…

Methodology · Statistics 2018-01-17 Cinzia Carota , Maurizio Filippone , Silvia Polettini

We explore probability modelling of discretization uncertainty for system states defined implicitly by ordinary or partial differential equations. Accounting for this uncertainty can avoid posterior under-coverage when likelihoods are…

Methodology · Statistics 2016-10-25 Oksana A. Chkrebtii , David A. Campbell , Ben Calderhead , Mark A. Girolami

We present a novel method for accurately auditing the differential privacy (DP) guarantees of DP mechanisms. In particular, our solution is applicable to auditing DP guarantees of machine learning (ML) models. Previous auditing methods…

Machine Learning · Computer Science 2026-01-14 Antti Koskela , Jafar Mohammadi

Local differential privacy is a differential privacy paradigm in which individuals first apply a privacy mechanism to their data (often by adding noise) before transmitting the result to a curator. The noise for privacy results in…

Methodology · Statistics 2023-10-17 Yuki Ohnishi , Jordan Awan

Median regression analysis has robustness properties which make it attractive compared with regression based on the mean, while differential privacy can protect individual privacy during statistical analysis of certain datasets. In this…

Computation · Statistics 2020-06-05 E Chen , Ying Miao , Yu Tang

We consider the problem of reinforcing federated learning with formal privacy guarantees. We propose to employ Bayesian differential privacy, a relaxation of differential privacy for similarly distributed data, to provide sharper privacy…

Machine Learning · Computer Science 2020-03-26 Aleksei Triastcyn , Boi Faltings

We provide an improved analysis of standard differentially private gradient descent for linear regression under the squared error loss. Under modest assumptions on the input, we characterize the distribution of the iterate at each time…

Machine Learning · Computer Science 2024-02-22 Gavin Brown , Krishnamurthy Dvijotham , Georgina Evans , Daogao Liu , Adam Smith , Abhradeep Thakurta