English
Related papers

Related papers: On Purely Private Covariance Estimation

200 papers

We study the problem of estimating the covariance matrix of a high-dimensional distribution when a small constant fraction of the samples can be arbitrarily corrupted. Recent work gave the first polynomial time algorithms for this problem…

Machine Learning · Computer Science 2019-06-12 Yu Cheng , Ilias Diakonikolas , Rong Ge , David Woodruff

We study computing the convolution of a private input $x$ with a public input $h$, while satisfying the guarantees of $(\epsilon, \delta)$-differential privacy. Convolution is a fundamental operation, intimately related to Fourier…

Data Structures and Algorithms · Computer Science 2013-01-29 Nadia Fawaz , S. Muthukrishnan , Aleksandar Nikolov

Motivated by growing concerns over ensuring privacy on social networks, we develop new algorithms and impossibility results for fitting complex statistical models to network data subject to rigorous privacy guarantees. We consider the…

Statistics Theory · Mathematics 2018-10-05 Christian Borgs , Jennifer Chayes , Adam Smith , Ilias Zadik

We study Stochastic Convex Optimization in the Differential Privacy model (DP-SCO). Unlike previous studies, here we assume the population risk function satisfies the Tsybakov Noise Condition (TNC) with some parameter $\theta>1$, where the…

Machine Learning · Computer Science 2025-09-08 Difei Xu , Meng Ding , Zihang Xiang , Jinhui Xu , Di Wang

Given $n$ i.i.d. random matrices $A_i \in \mathbb{R}^{d \times d}$ that share a common expectation $\Sigma$, the objective of Differentially Private Stochastic PCA is to identify a subspace of dimension $k$ that captures the largest…

Machine Learning · Statistics 2025-08-15 Johanna Düngler , Amartya Sanyal

We give a new algorithm for the estimation of the cross-covariance matrix $\mathbb{E} XY'$ of two large dimensional signals $X\in\mathbb{R}^n$, $Y\in \mathbb{R}^p$ in the context where the number $T$ of observations of the pair $(X,Y)$ is…

Statistics Theory · Mathematics 2021-11-19 Florent Benaych-Georges , Jean-Philippe Bouchaud , Marc Potters

Differentially private mean estimation is an important building block in privacy-preserving algorithms for data analysis and machine learning. Though the trade-off between privacy and utility is well understood in the worst case, many…

Cryptography and Security · Computer Science 2024-04-11 Martin Aumüller , Christian Janos Lebeda , Boel Nelson , Rasmus Pagh

In this work, we study trade-offs between accuracy and privacy in the context of linear queries over histograms. This is a rich class of queries that includes contingency tables and range queries, and has been a focus of a long line of…

Data Structures and Algorithms · Computer Science 2013-08-05 Aleksandar Nikolov , Kunal Talwar , Li Zhang

We present an algorithm that releases a pure differentially private (under the replacement neighboring relation) sparse histogram for $n$ participants over a domain of size $d \gg n$. Our method achieves the optimal $\ell_\infty$-estimation…

Data Structures and Algorithms · Computer Science 2025-12-25 Florian Kerschbaum , Steven Lee , Hao Wu

Differential privacy guarantees allow the results of a statistical analysis involving sensitive data to be released without compromising the privacy of any individual taking part. Achieving such guarantees generally requires the injection…

Machine Learning · Statistics 2023-10-31 Jack Jewson , Sahra Ghalebikesabi , Chris Holmes

Differential privacy is the leading mathematical framework for privacy protection, providing a probabilistic guarantee that safeguards individuals' private information when publishing statistics from a dataset. This guarantee is achieved by…

Methodology · Statistics 2025-08-19 Yuki Ohnishi , Jordan Awan

We study the problem of differentially private second moment estimation and present a new algorithm that achieve strong privacy-utility trade-offs even for worst-case inputs under subsamplability assumptions on the data. We call an input…

Machine Learning · Computer Science 2025-05-21 Bar Mahpud , Or Sheffet

Differential privacy provides a rigorous framework to quantify data privacy, and has received considerable interest recently. A randomized mechanism satisfying $(\epsilon, \delta)$-differential privacy (DP) roughly means that, except with a…

Cryptography and Security · Computer Science 2019-12-10 Jun Zhao , Teng Wang , Tao Bai , Kwok-Yan Lam , Zhiying Xu , Shuyu Shi , Xuebin Ren , Xinyu Yang , Yang Liu , Han Yu

We study the problem of mean estimation of $\ell_2$-bounded vectors under the constraint of local differential privacy. While the literature has a variety of algorithms that achieve the asymptotically optimal rates for this problem, the…

Machine Learning · Computer Science 2022-05-06 Hilal Asi , Vitaly Feldman , Kunal Talwar

We introduce a new zeroth-order algorithm for private stochastic optimization on nonconvex and nonsmooth objectives. Given a dataset of size $M$, our algorithm ensures $(\alpha,\alpha\rho^2/2)$-R\'enyi differential privacy and finds a…

Optimization and Control · Mathematics 2024-07-01 Qinzi Zhang , Hoang Tran , Ashok Cutkosky

We study spectral graph clustering under edge differential privacy. We propose a matrix shuffling mechanism that combines randomized edge flipping with a random permutation of the adjacency matrix. While edge flipping alone provides only a…

Information Theory · Computer Science 2026-05-12 Antti Koskela , Mohamed Seif , H. Vincent Poor , Andrea J. Goldsmith

In this brief, we present an enhanced privacy-preserving distributed estimation algorithm, referred to as the ``Double-Private Algorithm," which combines the principles of both differential privacy (DP) and cryptography. The proposed…

Signal Processing · Electrical Eng. & Systems 2024-03-19 Mehdi Korki , Fatemehsadat Hosseiniamin , Hadi Zayyani , Mehdi Bekrani

We consider the problem of differentially private query release through a synthetic database approach. Departing from the existing approaches that require the query set to be specified in advance, we advocate to devise query-set independent…

Cryptography and Security · Computer Science 2014-12-02 Weina Wang , Lei Ying , Junshan Zhang

We revisit the input perturbations framework for differential privacy where noise is added to the input $A\in \mathcal{S}$ and the result is then projected back to the space of admissible datasets $\mathcal{S}$. Through this framework, we…

Machine Learning · Computer Science 2024-08-09 Vincent Cohen-Addad , Tommaso d'Orsi , Alessandro Epasto , Vahab Mirrokni , Peilin Zhong

Differential privacy has become crucial in the real-world deployment of statistical and machine learning algorithms with rigorous privacy guarantees. The earliest statistical queries, for which differential privacy mechanisms have been…

Statistics Theory · Mathematics 2023-02-13 Saiteja Utpala , Praneeth Vepakomma , Nina Miolane