English
Related papers

Related papers: Local Differential Privacy for Bayesian Optimizati…

200 papers

Training with differential privacy (DP) provides a guarantee to members in a dataset that they cannot be identified by users of the released model. However, those data providers, and, in general, the public, lack methods to efficiently…

Machine Learning · Computer Science 2025-12-04 Zoë Ruha Bell , Anvith Thudi , Olive Franzese-McLaughlin , Nicolas Papernot , Shafi Goldwasser

An algorithm is developed to gradually relax the Differential Privacy (DP) guarantee of a randomized response. The output from each relaxation maintains the same probability distribution as a standard randomized response with the equivalent…

Cryptography and Security · Computer Science 2024-01-26 Mingen Pan

Existing Bayesian Optimization (BO) methods typically balance exploration and exploitation to optimize costly objective functions. However, these methods often suffer from a significant one-step bias, which may lead to convergence towards…

Machine Learning · Computer Science 2025-10-23 Ruiyao Miao , Junren Xiao , Shiya Tsang , Hui Xiong , Yingnian Wu

The rise of massive networks across diverse domains necessitates sophisticated graph analytics, often involving sensitive data and raising privacy concerns. This paper addresses these challenges using local differential privacy (LDP), which…

Data Structures and Algorithms · Computer Science 2025-08-28 Pranay Mundra , Charalampos Papamanthou , Julian Shun , Quanquan C. Liu

Data privacy is an important concern in learning, when datasets contain sensitive information about individuals. This paper considers consensus-based distributed optimization under data privacy constraints. Consensus-based optimization…

Machine Learning · Computer Science 2019-03-20 Mehrdad Showkatbakhsh , Can Karakus , Suhas Diggavi

Bayesian optimization (BO) is well known to be sample-efficient for solving black-box problems. However, the BO algorithms can sometimes get stuck in suboptimal solutions even with plenty of samples. Intrinsically, such suboptimal problem…

Machine Learning · Computer Science 2025-01-24 Zhendong Guo , Yew-Soon Ong , Tiantian He , Haitao Liu

The increased application of machine learning (ML) in sensitive domains requires protecting the training data through privacy frameworks, such as differential privacy (DP). DP requires to specify a uniform privacy level $\varepsilon$ that…

Machine Learning · Computer Science 2024-01-31 Krishna Acharya , Franziska Boenisch , Rakshit Naidu , Juba Ziani

Local Differential Privacy (LDP) addresses significant privacy concerns in sensitive data collection. In this work, we focus on numerical data collection under LDP, targeting a significant gap in the literature: existing LDP mechanisms are…

Cryptography and Security · Computer Science 2025-10-14 Incheol Baek , Yon Dohn Chung

Gaussian differential privacy (GDP) is a single-parameter family of privacy notions that provides coherent guarantees to avoid the exposure of sensitive individual information. Despite the extra interpretability and tighter bounds under…

Cryptography and Security · Computer Science 2022-10-18 Yi Liu , Ke Sun , Linglong Kong , Bei Jiang

We investigate the local differential privacy (LDP) guarantees of a randomized privacy mechanism via its contraction properties. We first show that LDP constraints can be equivalently cast in terms of the contraction coefficient of the…

Information Theory · Computer Science 2023-02-12 Shahab Asoodeh , Maryam Aliakbarpour , Flavio P. Calmon

Differential Privacy (DP) provides a formal framework for training machine learning models with individual example level privacy. In the field of deep learning, Differentially Private Stochastic Gradient Descent (DP-SGD) has emerged as a…

Machine Learning · Computer Science 2022-05-24 Harsh Mehta , Abhradeep Thakurta , Alexey Kurakin , Ashok Cutkosky

Local differential privacy is a differential privacy paradigm in which individuals first apply a privacy mechanism to their data (often by adding noise) before transmitting the result to a curator. The noise for privacy results in…

Methodology · Statistics 2023-10-17 Yuki Ohnishi , Jordan Awan

Bayesian Optimization (BO) is used to find the global optima of black box functions. In this work, we propose a practical BO method of function compositions where the form of the composition is known but the constituent functions are…

Machine Learning · Computer Science 2023-05-02 Kunal Jain , Prabuchandran K. J. , Tejas Bodas

Conformal prediction (CP) provides sets of candidate classes with a guaranteed probability of containing the true class. However, it typically relies on a calibration set with clean labels. We address privacy-sensitive scenarios where the…

Machine Learning · Computer Science 2025-12-08 Coby Penso , Bar Mahpud , Jacob Goldberger , Or Sheffet

Machine learning (ML) algorithms rely primarily on the availability of training data, and, depending on the domain, these data may include sensitive information about the data providers, thus leading to significant privacy issues.…

Machine Learning · Computer Science 2024-05-24 Karima Makhlouf , Tamara Stefanovic , Heber H. Arcolezi , Catuscia Palamidessi

Machine learning (ML) models trained by differentially private stochastic gradient descent (DP-SGD) have much lower utility than the non-private ones. To mitigate this degradation, we propose a DP Laplacian smoothing SGD (DP-LSSGD) to train…

Machine Learning · Computer Science 2019-12-10 Bao Wang , Quanquan Gu , March Boedihardjo , Farzin Barekat , Stanley J. Osher

We study the privacy risks that are associated with training a neural network's weights with self-supervised learning algorithms. Through empirical evidence, we show that the fine-tuning stage, in which the network weights are updated with…

Machine Learning · Computer Science 2022-05-26 Yunhao Yang , Parham Gohari , Ufuk Topcu

Federated Learning (FL) allows multiple participants to train machine learning models collaboratively by keeping their datasets local while only exchanging model updates. Alas, this is not necessarily free from privacy and robustness…

Cryptography and Security · Computer Science 2022-05-30 Mohammad Naseri , Jamie Hayes , Emiliano De Cristofaro

We design a class of additive noise mechanisms that satisfy \((\varepsilon, \delta)\)-differential privacy (DP) for scalar, real-valued query functions with known sensitivities, with a particular focus on moderate and low-privacy regimes.…

Cryptography and Security · Computer Science 2026-05-28 Huikang Liu , Aras Selvi , Wolfram Wiesemann

Differential privacy (DP) is becoming increasingly important for deployed machine learning applications because it provides strong guarantees for protecting the privacy of individuals whose data is used to train models. However, DP…