English
Related papers

Related papers: PLAN: Variance-Aware Private Mean Estimation

200 papers

We present differentially private efficient algorithms for learning union of polygons in the plane (which are not necessarily convex). Our algorithms achieve $(\alpha,\beta)$-PAC learning and $(\epsilon,\delta)$-differential privacy using a…

Machine Learning · Computer Science 2019-02-14 Haim Kaplan , Yishay Mansour , Yossi Matias , Uri Stemmer

Deep learning techniques have achieved remarkable performance in wide-ranging tasks. However, when trained on privacy-sensitive datasets, the model parameters may expose private information in training data. Prior attempts for…

Machine Learning · Computer Science 2021-06-22 Wenxiao Wang , Tianhao Wang , Lun Wang , Nanqing Luo , Pan Zhou , Dawn Song , Ruoxi Jia

Language models are capable of memorizing detailed patterns and information, leading to a double-edged effect: they achieve impressive modeling performance on downstream tasks with the stored knowledge but also raise significant privacy…

Artificial Intelligence · Computer Science 2024-10-07 Xianzhi Li , Ran Zmigrod , Zhiqiang Ma , Xiaomo Liu , Xiaodan Zhu

A vast amount of valuable data is produced and is becoming available for analysis as a result of advancements in smart cyber-physical systems. The data comes from various sources, such as healthcare, smart homes, smart vehicles, and often…

Cryptography and Security · Computer Science 2019-08-01 M. A. P. Chamikara , P. Bertok , D. Liu , S. Camtepe , I. Khalil

We study $L_2$ mean estimation under central differential privacy and communication constraints, and address two key challenges: firstly, existing mean estimation schemes that simultaneously handle both constraints are usually optimized for…

Cryptography and Security · Computer Science 2024-05-07 Wei-Ning Chen , Berivan Isik , Peter Kairouz , Albert No , Sewoong Oh , Zheng Xu

This paper introduces the first provably accurate algorithms for differentially private, top-down decision tree learning in the distributed setting (Balcan et al., 2012). We propose DP-TopDown, a general privacy preserving decision tree…

Machine Learning · Computer Science 2021-02-24 Kaiwen Wang , Travis Dick , Maria-Florina Balcan

Privacy-preserving data analysis is a rising challenge in contemporary statistics, as the privacy guarantees of statistical methods are often achieved at the expense of accuracy. In this paper, we investigate the tradeoff between…

Machine Learning · Statistics 2020-11-11 T. Tony Cai , Yichen Wang , Linjun Zhang

In this paper, we present a notion of differential privacy (DP) for data that comes from different classes. Here, the class-membership is private information that needs to be protected. The proposed method is an output perturbation…

Signal Processing · Electrical Eng. & Systems 2023-06-12 Raksha Ramakrishna , Anna Scaglione , Tong Wu , Nikhil Ravi , Sean Peisert

In many applications, the labeled data at the learner's disposal is subject to privacy constraints and is relatively limited. To derive a more accurate predictor for the target domain, it is often beneficial to leverage publicly available…

Machine Learning · Computer Science 2024-02-06 Raef Bassily , Corinna Cortes , Anqi Mao , Mehryar Mohri

Recently, due to the popularity of deep neural networks and other methods whose training typically relies on the optimization of an objective function, and due to concerns for data privacy, there is a lot of interest in differentially…

Machine Learning · Computer Science 2025-02-12 Antoine Barczewski , Jan Ramon

Differential privacy (DP) provides a mathematical guarantee limiting what an adversary can learn about any individual from released data. However, achieving this protection typically requires adding noise, and noise can accumulate when many…

Machine Learning · Computer Science 2026-02-12 Amir Asiaee , Chao Yan , Zachary B. Abrams , Bradley A. Malin

The application of Differential Privacy to Natural Language Processing techniques has emerged in relevance in recent years, with an increasing number of studies published in established NLP outlets. In particular, the adaptation of…

Computation and Language · Computer Science 2024-04-05 Stephen Meisenbacher , Nihildev Nandakumar , Alexandra Klymenko , Florian Matthes

We study a basic private estimation problem: each of $n$ users draws a single i.i.d. sample from an unknown Gaussian distribution, and the goal is to estimate the mean of this Gaussian distribution while satisfying local differential…

Machine Learning · Computer Science 2019-10-29 Matthew Joseph , Janardhan Kulkarni , Jieming Mao , Zhiwei Steven Wu

Protecting user data privacy can be achieved via many methods, from statistical transformations to generative models. However, all of them have critical drawbacks. For example, creating a transformed data set using traditional techniques is…

Machine Learning · Computer Science 2024-04-24 Tânia Carvalho , Nuno Moniz , Luís Antunes , Nitesh Chawla

In distributed optimization and iterative consensus literature, a standard problem is for $N$ agents to minimize a function $f$ over a subset of Euclidean space, where the cost function is expressed as a sum $\sum f_i$. In this paper, we…

Cryptography and Security · Computer Science 2014-01-14 Zhenqi Huang , Sayan Mitra , Nitin Vaidya

Estimating heterogeneous treatment effects in domains such as healthcare or social science often involves sensitive data where protecting privacy is important. We introduce a general meta-algorithm for estimating conditional average…

Machine Learning · Statistics 2022-02-23 Fengshi Niu , Harsha Nori , Brian Quistorff , Rich Caruana , Donald Ngwe , Aadharsh Kannan

Privacy preserving mechanisms such as differential privacy inject additional randomness in the form of noise in the data, beyond the sampling mechanism. Ignoring this additional noise can lead to inaccurate and invalid inferences. In this…

Machine Learning · Statistics 2015-11-26 Vishesh Karwa , Dan Kifer , Aleksandra B. Slavković

Fueled by the ever-increasing need for statistics that guarantee the privacy of their training sets, this article studies the centrally-private estimation of Sobolev-smooth densities of probability over the hypercube in dimension d. The…

Statistics Theory · Mathematics 2024-09-17 Clément Lalanne , Sébastien Gadat

In this work, we introduce a novel framework for privately optimizing objectives that rely on Wasserstein distances between data-dependent empirical measures. Our main theoretical contribution is, based on an explicit formulation of the…

Machine Learning · Computer Science 2025-05-22 David Rodríguez-Vítores , Clément Lalanne , Jean-Michel Loubes

Recent research in differential privacy demonstrated that (sub)sampling can amplify the level of protection. For example, for $\epsilon$-differential privacy and simple random sampling with sampling rate $r$, the actual privacy guarantee is…

Applications · Statistics 2022-02-22 Jingchen Hu , Joerg Drechsler , Hang J. Kim