English
Related papers

Related papers: Variational Bayes In Private Settings (VIPS)

200 papers

Many applications of machine learning, for example in health care, would benefit from methods that can guarantee privacy of data subjects. Differential privacy (DP) has become established as a standard for protecting learning results. The…

Machine Learning · Statistics 2017-05-30 Mikko Heikkilä , Eemil Lagerspetz , Samuel Kaski , Kana Shimizu , Sasu Tarkoma , Antti Honkela

Making evidence based decisions requires data. However for real-world applications, the privacy of data is critical. Using synthetic data which reflects certain statistical properties of the original data preserves the privacy of the…

Machine Learning · Computer Science 2021-05-28 Varun Chandrasekaran , Darren Edge , Somesh Jha , Amit Sharma , Cheng Zhang , Shruti Tople

Data integration and sharing maximally enhance the potential for novel and meaningful discoveries. However, it is a non-trivial task as integrating data from multiple sources can put sensitive information of study participants at risk. To…

Cryptography and Security · Computer Science 2020-05-25 Yeongjae Gil , Xiaoqian Jiang , Miran Kim , Junghye Lee

Many commonly used learning algorithms work by iteratively updating an intermediate solution using one or a few data points in each iteration. Analysis of differential privacy for such algorithms often involves ensuring privacy of each step…

Machine Learning · Computer Science 2018-12-12 Vitaly Feldman , Ilya Mironov , Kunal Talwar , Abhradeep Thakurta

In this article, we propose a new variational approach to learn private and/or fair representations. This approach is based on the Lagrangians of a new formulation of the privacy and fairness optimization problems that we propose. In this…

Machine Learning · Statistics 2021-09-07 Borja Rodríguez-Gálvez , Ragnar Thobaben , Mikael Skoglund

In machine learning, classification models need to be trained in order to predict class labels. When the training data contains personal information about individuals, collecting training data becomes difficult due to privacy concerns.…

Machine Learning · Computer Science 2019-05-06 Emre Yilmaz , Mohammad Al-Rubaie , J. Morris Chang

Variational Bayes (VB), a method originating from machine learning, enables fast and scalable estimation of complex probabilistic models. Thus far, applications of VB in discrete choice analysis have been limited to mixed logit models with…

Methodology · Statistics 2020-01-17 Rico Krueger , Prateek Bansal , Michel Bierlaire , Ricardo A. Daziano , Taha H. Rashidi

Formal disclosure avoidance techniques are necessary to ensure that published data can not be used to identify information about individuals. The addition of statistical noise to unpublished data can be implemented to achieve differential…

Methodology · Statistics 2024-06-10 Ryan Janicki , Scott H. Holan , Kyle M. Irimata , James Livsey , Andrew Raim

Differentially private machine learning trains models while protecting privacy of the sensitive training data. The key to obtain differentially private models is to introduce noise/randomness to the training process. In particular, existing…

Cryptography and Security · Computer Science 2020-08-25 Hongbin Liu , Jinyuan Jia , Neil Zhenqiang Gong

Variational Bayes (VB) has been used to facilitate the calculation of the posterior distribution in the context of Bayesian inference of the parameters of nonlinear models from data. Previously an analytical formulation of VB has been…

Signal Processing · Electrical Eng. & Systems 2020-07-06 Michael A. Chappell , Martin S. Craig , Mark W. Woolrich

Despite the popularism of Bayesian neural networks in recent years, its use is somewhat limited in complex and big data situations due to the computational cost associated with full posterior evaluations. Variational Bayes (VB) provides a…

Machine Learning · Statistics 2020-06-30 Shrijita Bhattacharya , Tapabrata Maiti

Differential privacy is the state-of-the-art definition for privacy, guaranteeing that any analysis performed on a sensitive dataset leaks no information about the individuals whose data are contained therein. In this thesis, we develop…

Machine Learning · Computer Science 2023-11-29 Vassilis Digalakis

We study instrumental variable regression (IVaR) under differential privacy constraints. Classical IVaR methods (like two-stage least squares regression) rely on solving moment equations that directly use sensitive covariates and…

Machine Learning · Statistics 2026-02-17 Haodong Liang , Yanhao Jin , Krishnakumar Balasubramanian , Lifeng Lai

Variational Bayes (VB) is a recent approximate method for Bayesian inference. It has the merit of being a fast and scalable alternative to Markov Chain Monte Carlo (MCMC) but its approximation error is often unknown. In this paper, we…

Machine Learning · Statistics 2019-03-05 Reza Hajargasht

Inverse problems involving partial differential equations (PDEs) are widely used in science and engineering. Although such problems are generally ill-posed, different regularisation approaches have been developed to ameliorate this problem.…

Applications · Statistics 2022-03-23 Jan Povala , Ieva Kazlauskaite , Eky Febrianto , Fehmi Cirak , Mark Girolami

The randomized power method has gained significant interest due to its simplicity and efficient handling of large-scale spectral analysis and recommendation tasks. However, its application to large datasets containing personal information…

Machine Learning · Computer Science 2025-06-13 Julien Nicolas , César Sabater , Mohamed Maouche , Sonia Ben Mokhtar , Mark Coates

Federated learning (FL) aims to protect data privacy by cooperatively learning a model without sharing private data among users. For Federated Learning of Deep Neural Network with billions of model parameters, existing privacy-preserving…

Machine Learning · Computer Science 2021-09-28 Hanlin Gu , Lixin Fan , Bowen Li , Yan Kang , Yuan Yao , Qiang Yang

We study private prediction where differential privacy is achieved by adding noise to the outputs of a non-private model. Existing methods rely on noise proportional to the global sensitivity of the model, often resulting in sub-optimal…

This paper develops a novel differentially private framework to solve convex optimization problems with sensitive optimization data and complex physical or operational constraints. Unlike standard noise-additive algorithms, that act…

Cryptography and Security · Computer Science 2020-06-23 Vladimir Dvorkin , Ferdinando Fioretto , Pascal Van Hentenryck , Jalal Kazempour , Pierre Pinson

Artificial intelligence and machine learning have been integrated into all aspects of our lives and the privacy of personal data has attracted more and more attention. Since the generation of the model needs to extract the effective…

Cryptography and Security · Computer Science 2022-02-14 Ruikang Yang , Jianfeng Ma , Yinbin Miao , Xindi Ma