English
Related papers

Related papers: Differentially Private High Dimensional Sparse Cov…

200 papers

In this paper, we present a framework based on differential privacy (DP) for querying electric power measurements to detect system anomalies or bad data. Our DP approach conceals consumption and system matrix data, while simultaneously…

Signal Processing · Electrical Eng. & Systems 2024-03-26 Nikhil Ravi , Anna Scaglione , Sean Peisert , Parth Pradhan

Leveraging information from public data has become increasingly crucial in enhancing the utility of differentially private (DP) methods. Traditional DP approaches often require adding noise based solely on private data, which can…

Machine Learning · Computer Science 2025-08-26 Zilong Cao , Hai Zhang

This work studies the distributed empirical risk minimization (ERM) problem under differential privacy (DP) constraint. Standard distributed algorithms achieve DP typically by perturbing all local subgradients with noise, leading to…

Optimization and Control · Mathematics 2023-07-04 Changxin Liu , Karl H. Johansson , Yang Shi

In this work we consider the problem of differentially private computation of quantiles for the data, especially the highest quantiles such as maximum, but with an unbounded range for the dataset. We show that this can be done efficiently…

Data Structures and Algorithms · Computer Science 2023-10-17 David Durfee

In this paper, we consider the $k$-approximate pattern matching problem under differential privacy, where the goal is to report or count all substrings of a given string $S$ which have a Hamming distance at most $k$ to a pattern $P$, or…

Data Structures and Algorithms · Computer Science 2023-11-14 Teresa Anna Steiner

We propose a new estimator for the high-dimensional linear regression model with observation error in the design where the number of coefficients is potentially larger than the sample size. The main novelty of our procedure is that the…

Methodology · Statistics 2019-09-09 Alexandre Belloni , Abhishek Kaul , Mathieu Rosenbaum

Bounding privacy leakage over compositions, i.e., privacy accounting, is a key challenge in differential privacy (DP). The privacy parameter ($\eps$ or $\delta$) is often easy to estimate but hard to bound. In this paper, we propose a new…

Cryptography and Security · Computer Science 2023-11-22 Jiachen T. Wang , Saeed Mahloujifar , Tong Wu , Ruoxi Jia , Prateek Mittal

A major challenge for machine learning is increasing the availability of data while respecting the privacy of individuals. Here we combine the provable privacy guarantees of the differential privacy framework with the flexibility of…

Machine Learning · Statistics 2019-01-18 Michael Thomas Smith , Max Zwiessele , Neil D. Lawrence

Despite intense interest and considerable effort, the current generation of neural networks suffers a significant loss of accuracy under most practically relevant privacy training regimes. One particularly challenging class of neural…

Machine Learning · Computer Science 2021-06-07 Huanyu Zhang , Ilya Mironov , Meisam Hejazinia

Motivated by differential co-expression analysis in genomics, we consider in this paper estimation and testing of high-dimensional differential correlation matrices. An adaptive thresholding procedure is introduced and theoretical…

Methodology · Statistics 2015-10-22 T. Tony Cai , Anru Zhang

Distributed machine learning is an approach allowing different parties to learn a model over all data sets without disclosing their own data. In this paper, we propose a weighted distributed differential privacy (WD-DP) empirical risk…

Machine Learning · Computer Science 2021-10-22 Yilin Kang , Yong Liu , Weiping Wang

We study $L_2$ mean estimation under central differential privacy and communication constraints, and address two key challenges: firstly, existing mean estimation schemes that simultaneously handle both constraints are usually optimized for…

Cryptography and Security · Computer Science 2024-05-07 Wei-Ning Chen , Berivan Isik , Peter Kairouz , Albert No , Sewoong Oh , Zheng Xu

We prove new lower bounds for statistical estimation tasks under the constraint of $(\varepsilon, \delta)$-differential privacy. First, we provide tight lower bounds for private covariance estimation of Gaussian distributions. We show that…

Data Structures and Algorithms · Computer Science 2023-03-29 Gautam Kamath , Argyris Mouzakis , Vikrant Singhal

Differential privacy is a cryptographically-motivated definition of privacy which has gained significant attention over the past few years. Differentially private solutions enforce privacy by adding random noise to a function computed over…

Machine Learning · Computer Science 2012-07-03 Kamalika Chaudhuri , Daniel Hsu

We study continual mean estimation, where data vectors arrive sequentially and the goal is to maintain accurate estimates of the running mean. We address this problem under user-level differential privacy, which protects each user's entire…

Machine Learning · Computer Science 2026-05-12 Nikita P. Kalinin , Ali Najar , Valentin Roth , Christoph H. Lampert

The variance--covariance matrix plays a central role in the inferential theories of high-dimensional factor models in finance and economics. Popular regularization methods of directly exploiting sparsity are not directly applicable to many…

Methodology · Statistics 2012-03-15 Jianqing Fan , Yuan Liao , Martina Mincheva

In this paper, we introduce the $\ell_p^p$-error metric (for $p \geq 2$) when answering linear queries under the constraint of differential privacy. We characterize such an error under $(\epsilon,\delta)$-differential privacy. Before this…

Cryptography and Security · Computer Science 2024-06-05 Jingcheng Liu , Jalaj Upadhyay , Zongrui Zou

Many differentially private (DP) data release systems either output DP synthetic data and leave analysts to perform inference as usual, which can lead to severe miscalibration, or output a DP point estimate without a principled way to do…

Machine Learning · Computer Science 2026-03-03 Amir Asiaee , Samhita Pal

Distribution estimation under local differential privacy (LDP) is a fundamental and challenging task. Significant progresses have been made on categorical data. However, due to different evaluation metrics, these methods do not work well…

Machine Learning · Computer Science 2025-09-25 Puning Zhao , Zhikun Zhang , Bo Sun , Li Shen , Liang Zhang , Shaowei Wang , Zhe Liu

We present two sample-efficient differentially private mean estimators for $d$-dimensional (sub)Gaussian distributions with unknown covariance. Informally, given $n \gtrsim d/\alpha^2$ samples from such a distribution with mean $\mu$ and…

Machine Learning · Computer Science 2024-03-27 Gavin Brown , Marco Gaboardi , Adam Smith , Jonathan Ullman , Lydia Zakynthinou