English
Related papers

Related papers: Towards Sharper Utility Bounds for Differentially …

200 papers

We consider the binary classification problem in a setup that preserves the privacy of the original sample. We provide a privacy mechanism that is locally differentially private and then construct a classifier based on the private sample…

Statistics Theory · Mathematics 2019-12-11 Thomas Berrett , Cristina Butucea

In order to both learn and protect sensitive training data, there has been a growing interest in privacy preserving machine learning methods. Differential privacy has emerged as an important measure of privacy. We are interested in the…

Cryptography and Security · Computer Science 2025-02-11 Antoine Barczewski , Amal Mawass , Jan Ramon

We describe Bayesian inference for the parameters of Gaussian models of bounded data protected by differential privacy. Using this setting, we demonstrate that analysts can and should take constraints imposed by the bounds into account when…

Methodology · Statistics 2024-10-18 Zeki Kazan , Jerome P. Reiter

This paper considers the generalization performance of differentially private convex learning. We demonstrate that the convergence analysis of Langevin algorithms can be used to obtain new generalization bounds with differential privacy…

Machine Learning · Computer Science 2022-06-07 Yi-An Ma , Teodor Vanislavov Marinov , Tong Zhang

Machine learning models are increasingly used in high-stakes decision-making systems. In such applications, a major concern is that these models sometimes discriminate against certain demographic groups such as individuals with certain…

Machine Learning · Computer Science 2023-06-06 Andrew Lowy , Devansh Gupta , Meisam Razaviyayn

Convex programming with linear constraints plays an important role in the operation of a number of everyday systems. However, absent any additional protections, revealing or acting on the solutions to such problems may reveal information…

Optimization and Control · Mathematics 2024-09-16 Alexander Benvenuti , Brendan Bialy , Miriam Dennis , Matthew Hale

Federated learning aims to protect data privacy by collaboratively learning a model without sharing private data among users. However, an adversary may still be able to infer the private training data by attacking the released model.…

Machine Learning · Computer Science 2021-09-13 Zhicong Liang , Bao Wang , Quanquan Gu , Stanley Osher , Yuan Yao

We consider the problem of empirical risk minimization given a database, using the gradient descent algorithm. We note that the function to be optimized may be non-convex, consisting of saddle points which impede the convergence of the…

Machine Learning · Computer Science 2021-01-19 Thulasi Tholeti , Sheetal Kalyani

In federated learning collaborative learning takes place by a set of clients who each want to remain in control of how their local training data is used, in particular, how can each client's local training data remain private? Differential…

Machine Learning · Computer Science 2023-07-18 Marten van Dijk , Phuong Ha Nguyen

A private learner is trained on a sample of labeled points and generates a hypothesis that can be used for predicting the labels of newly sampled points while protecting the privacy of the training set [Kasiviswannathan et al., FOCS 2008].…

Machine Learning · Computer Science 2023-05-17 Moni Naor , Kobbi Nissim , Uri Stemmer , Chao Yan

Differentially private training algorithms provide protection against one of the most popular attacks in machine learning: the membership inference attack. However, these privacy algorithms incur a loss of the model's classification…

Cryptography and Security · Computer Science 2021-10-13 Jiaxiang Liu , Simon Oya , Florian Kerschbaum

In recent years, differential privacy has emerged as the de facto standard for sharing statistics of datasets while limiting the disclosure of private information about the involved individuals. This is achieved by randomly perturbing the…

Cryptography and Security · Computer Science 2024-12-18 Aras Selvi , Huikang Liu , Wolfram Wiesemann

Differential privacy (DP) is a mathematical framework that guarantees individual privacy; however, systematic evaluation of its impact on statistical utility in survival analyses remains limited. In this study, we systematically evaluated…

Cryptography and Security · Computer Science 2026-04-24 Keita Fukuyama , Yukiko Mori , Tomohiro Kuroda , Hiroaki Kikuchi

The success of large neural networks is crucially determined by the availability of data. It has been observed that training only on a small amount of public data, or privately on the abundant private data can lead to undesirable…

Machine Learning · Computer Science 2023-10-03 Ruixuan Liu , Zhiqi Bu , Yu-xiang Wang , Sheng Zha , George Karypis

Machine learning models are susceptible to membership inference attacks (MIAs), which aim to infer whether a sample is in the training set. Existing work utilizes gradient ascent to enlarge the loss variance of training data, alleviating…

Machine Learning · Computer Science 2024-06-19 Zhenlong Liu , Lei Feng , Huiping Zhuang , Xiaofeng Cao , Hongxin Wei

We study the problem of learning exponential distributions under differential privacy. Given $n$ i.i.d.\ samples from $\mathrm{Exp}(\lambda)$, the goal is to privately estimate $\lambda$ so that the learned distribution is close in total…

Data Structures and Algorithms · Computer Science 2026-03-31 Bar Mahpud , Or Sheffet

We provide sample complexity upper bounds for agnostically learning multivariate Gaussians under the constraint of approximate differential privacy. These are the first finite sample upper bounds for general Gaussians which do not impose…

Machine Learning · Statistics 2020-10-21 Ishaq Aden-Ali , Hassan Ashtiani , Gautam Kamath

In this paper, we revisit the problem of using in-distribution public data to improve the privacy/utility trade-offs for differentially private (DP) model training. (Here, public data refers to auxiliary data sets that have no privacy…

Label differential privacy (DP) is designed for learning problems involving private labels and public features. While various methods have been proposed for learning under label DP, the theoretical limits remain largely unexplored. In this…

Machine Learning · Computer Science 2025-03-04 Puning Zhao , Chuan Ma , Li Shen , Shaowei Wang , Rongfei Fan

There has been a recent wave of interest in intermediate trust models for differential privacy that eliminate the need for a fully trusted central data collector, but overcome the limitations of local differential privacy. This interest has…

Data Structures and Algorithms · Computer Science 2020-12-07 Albert Cheu , Jonathan Ullman