English
Related papers

Related papers: Continual Mean Estimation Under User-Level Privacy

200 papers

In modern settings of data analysis, we may be running our algorithms on datasets that are sensitive in nature. However, classical machine learning and statistical algorithms were not designed with these risks in mind, and it has been…

Data Structures and Algorithms · Computer Science 2021-08-21 Huanyu Zhang

Federated analytics seeks to compute accurate statistics from data distributed across users' devices while providing a suitable privacy guarantee and being practically feasible to implement and scale. In this paper, we show how a strong…

Cryptography and Security · Computer Science 2022-03-10 Akash Bharadwaj , Graham Cormode

Differential privacy is a formal mathematical {stand-ard} for quantifying the degree of that individual privacy in a statistical database is preserved. To guarantee differential privacy, a typical method is adding random noise to the…

Information Theory · Computer Science 2017-03-08 Jianping He , Lin Cai

We study a basic private estimation problem: each of $n$ users draws a single i.i.d. sample from an unknown Gaussian distribution, and the goal is to estimate the mean of this Gaussian distribution while satisfying local differential…

Machine Learning · Computer Science 2019-10-29 Matthew Joseph , Janardhan Kulkarni , Jieming Mao , Zhiwei Steven Wu

Local differential privacy (LDP) can provide each user with strong privacy guarantees under untrusted data curators while ensuring accurate statistics derived from privatized data. Due to its powerfulness, LDP has been widely adopted to…

Cryptography and Security · Computer Science 2019-06-06 Teng Wang , Jun Zhao , Xinyu Yang , Xuebin Ren

Differential privacy is a rigorous definition for privacy that guarantees that any analysis performed on a sensitive dataset leaks no information about the individuals whose data are contained therein. In this work, we develop new…

Cryptography and Security · Computer Science 2021-11-18 Vassilis Digalakis , George N. Karystinos , Minos N. Garofalakis

Differentially private (DP) mechanisms protect individual-level information by introducing randomness into the statistical analysis procedure. Despite the availability of numerous DP tools, there remains a lack of general techniques for…

Machine Learning · Statistics 2025-09-25 Zhanyu Wang , Guang Cheng , Jordan Awan

We consider a refinement of differential privacy --- per instance differential privacy (pDP), which captures the privacy of a specific individual with respect to a fixed data set. We show that this is a strict generalization of the standard…

Machine Learning · Statistics 2018-11-15 Yu-Xiang Wang

Differentially private distributed mean estimation (DP-DME) is a fundamental building block in privacy-preserving federated learning, where a central server estimates the mean of $d$-dimensional vectors held by $n$ users while ensuring…

Information Theory · Computer Science 2025-01-09 Sajani Vithana , Viveck R. Cadambe , Flavio P. Calmon , Haewon Jeong

Motivated by understanding the dynamics of sensitive social networks over time, we consider the problem of continual release of statistics in a network that arrives online, while preserving privacy of its participants. For our privacy…

Cryptography and Security · Computer Science 2018-09-20 Shuang Song , Susan Little , Sanjay Mehta , Staal Vinterbo , Kamalika Chaudhuri

(Gradient) Expectation Maximization (EM) is a widely used algorithm for estimating the maximum likelihood of mixture models or incomplete data problems. A major challenge facing this popular technique is how to effectively preserve the…

Machine Learning · Computer Science 2022-01-19 Di Wang , Jiahao Ding , Lijie Hu , Zejun Xie , Miao Pan , Jinhui Xu

Aggregate time-series data like traffic flow and site occupancy repeatedly sample statistics from a population across time. Such data can be profoundly useful for understanding trends within a given population, but also pose a significant…

Cryptography and Security · Computer Science 2022-01-14 Tatsuki Koga , Casey Meehan , Kamalika Chaudhuri

Several official statistics agencies release synthetic data as public use microdata files. In practice, synthetic data do not admit accurate results for every analysis. Thus, it is beneficial for agencies to provide users with feedback on…

Cryptography and Security · Computer Science 2024-04-04 Tong Lin , Jerome P. Reiter

In this paper, we investigate the differentially private estimation of data depth functions and their associated medians. We introduce several methods for privatizing depth values at a fixed point, and show that for some depth functions,…

Statistics Theory · Mathematics 2021-04-09 Kelly Ramsay , Shoja'eddin Chenouri

Privacy-preserving average consensus aims to guarantee the privacy of initial states and asymptotic consensus on the exact average of the initial value. In existing work, it is achieved by adding and subtracting variance decaying and…

Systems and Control · Computer Science 2017-02-10 Jianping He , Lin Cai , Chengcheng Zhao , Peng Cheng , Xinping Guan

Many differentially private (DP) data release systems either output DP synthetic data and leave analysts to perform inference as usual, which can lead to severe miscalibration, or output a DP point estimate without a principled way to do…

Machine Learning · Computer Science 2026-03-03 Amir Asiaee , Samhita Pal

We propose Joint Moment Estimation (JME), a method for continually and privately estimating both the first and second moments of data with reduced noise compared to naive approaches. JME uses the matrix mechanism and a joint sensitivity…

Machine Learning · Computer Science 2025-06-05 Nikita P. Kalinin , Jalaj Upadhyay , Christoph H. Lampert

We present \textit{universal} estimators for the statistical mean, variance, and scale (in particular, the interquartile range) under pure differential privacy. These estimators are universal in the sense that they work on an arbitrary,…

Cryptography and Security · Computer Science 2023-04-04 Wei Dong , Ke Yi

Differential privacy (DP) ensures that training a machine learning model does not leak private data. In practice, we may have access to auxiliary public data that is free of privacy concerns. In this work, we assume access to a given amount…

Machine Learning · Computer Science 2024-09-11 Andrew Lowy , Zeman Li , Tianjian Huang , Meisam Razaviyayn

Data privacy is an important concern in learning, when datasets contain sensitive information about individuals. This paper considers consensus-based distributed optimization under data privacy constraints. Consensus-based optimization…

Machine Learning · Computer Science 2019-03-20 Mehrdad Showkatbakhsh , Can Karakus , Suhas Diggavi