English
Related papers

Related papers: Improved Utility Analysis of Private CountSketch

200 papers

Many privacy mechanisms reveal high-level information about a data distribution through noisy measurements. It is common to use this information to estimate the answers to new queries. In this work, we provide an approach to solve this…

Machine Learning · Computer Science 2019-01-29 Ryan McKenna , Daniel Sheldon , Gerome Miklau

Motivated by the rapid rise in statistical tools in Functional Data Analysis, we consider the Gaussian mechanism for achieving differential privacy with parameter estimates taking values in a, potentially infinite-dimensional, separable…

Statistics Theory · Mathematics 2019-01-29 Ardalan Mirshani , Matthew Reimherr , Aleksandra Slavkovic

Gaussian copulas are widely used to estimate multivariate distributions and relationships. We present algorithms for estimating Gaussian copula correlations that ensure differential privacy. We first convert data values into sets of two-way…

Methodology · Statistics 2026-01-08 Shuo Wang , Joseph Feldman , Jerome P. Reiter

This paper concerns differentially private Bayesian estimation of the parameters of a population distribution, when a statistic of a sample from that population is shared in noise to provide differential privacy. This work mainly addresses…

Methodology · Statistics 2023-01-09 Baris Alparslan , Sinan Yildirim

Categorical attributes are those that can take a discrete set of values, e.g., colours. This work is about compressing vectors over categorical attributes to low-dimension discrete vectors. The current hash-based methods compressing vectors…

Machine Learning · Computer Science 2021-12-08 Debajyoti Bera , Rameshwar Pratap , Bhisham Dev Verma

A continuing challenge for machine learning is providing methods to perform computation on data while ensuring the data remains private. In this paper we build on the provable privacy guarantees of differential privacy which has been…

Machine Learning · Computer Science 2019-09-23 Michael Thomas Smith , Mauricio A. Alvarez , Neil D. Lawrence

Differential privacy has gained popularity in machine learning as a strong privacy guarantee, in contrast to privacy mitigation techniques such as k-anonymity. However, applying differential privacy to n-gram counts significantly degrades…

Cryptography and Security · Computer Science 2021-02-01 Osman Ramadan , James Withers , Douglas Orr

Concern about how to aggregate sensitive user data without compromising individual privacy is a major barrier to greater availability of data. The model of differential privacy has emerged as an accepted model to release sensitive…

Databases · Computer Science 2017-10-03 Graham Cormode , Tejas Kulkarni , Divesh Srivastava

This article focuses on drawing computationally-efficient predictive inference from Gaussian process (GP) regressions with a large number of features when the response is conditionally independent of the features given the projection to a…

Methodology · Statistics 2024-09-27 Samuel Gailliot , Rajarshi Guhaniyogi , Roger D. Peng

Sketching techniques have become popular for scaling up machine learning algorithms by reducing the sample size or dimensionality of massive data sets, while still maintaining the statistical power of big data. In this paper, we study…

Machine Learning · Computer Science 2016-10-11 Jialei Wang , Jason D. Lee , Mehrdad Mahdavi , Mladen Kolar , Nathan Srebro

Differential privacy (DP) is a rigorous notion of data privacy, used for private statistics. The canonical algorithm for differentially private mean estimation is to first clip the samples to a bounded range and then add noise to their…

Statistics Theory · Mathematics 2024-10-10 Gautam Kamath , Argyris Mouzakis , Matthew Regehr , Vikrant Singhal , Thomas Steinke , Jonathan Ullman

Recent studies reveal that experienced data practitioners often draw sketches to facilitate communication around privacy design concepts. However, there is limited understanding of how we can help novice students develop such communication…

Human-Computer Interaction · Computer Science 2025-10-13 Jinhe Wen , Yingxi Zhao , Wenqian Xu , Yaxing Yao , Haojian Jin

We prove that $\mathbb{F}_p$ sketch, a well-celebrated streaming algorithm for frequency moments estimation, is differentially private as is when $p\in(0, 1]$. $\mathbb{F}_p$ sketch uses only polylogarithmic space, exponentially better than…

Cryptography and Security · Computer Science 2021-10-04 Lun Wang , Iosif Pinelis , Dawn Song

In federated frequency estimation (FFE), multiple clients work together to estimate the frequencies of their collective data by communicating with a server that respects the privacy constraints of Secure Summation (SecSum), a cryptographic…

Data Structures and Algorithms · Computer Science 2023-12-05 Jingfeng Wu , Wennan Zhu , Peter Kairouz , Vladimir Braverman

The Sparse Vector Technique (SVT) is a fundamental technique for satisfying differential privacy and has the unique quality that one can output some query answers without apparently paying any privacy cost. SVT has been used in both the…

Cryptography and Security · Computer Science 2016-09-20 Min Lyu , Dong Su , Ninghui Li

Federated learning (FL) faces two primary challenges: the risk of privacy leakage due to parameter sharing and communication inefficiencies. To address these challenges, we propose DPSFL, a federated learning method that utilizes…

Machine Learning · Computer Science 2024-10-11 Meifan Zhang , Zhanhong Xie , Lihua Yin

Estimating the quantiles of a large dataset is a fundamental problem in both the streaming algorithms literature and the differential privacy literature. However, all existing private mechanisms for distribution-independent quantile…

Data Structures and Algorithms · Computer Science 2022-01-11 Daniel Alabi , Omri Ben-Eliezer , Anamay Chaturvedi

Gradient perturbation, widely used for differentially private optimization, injects noise at every iterative update to guarantee differential privacy. Previous work first determines the noise level that can satisfy the privacy requirement…

Machine Learning · Computer Science 2020-10-27 Da Yu , Huishuai Zhang , Wei Chen , Tie-Yan Liu , Jian Yin

Algorithmic Gaussianization is a phenomenon that can arise when using randomized sketching or sampling methods to produce smaller representations of large datasets: For certain tasks, these sketched representations have been observed to…

Machine Learning · Computer Science 2023-07-28 Michał Dereziński

The unsupervised learning of community structure, in particular the partitioning vertices into clusters or communities, is a canonical and well-studied problem in exploratory graph analysis. However, like most graph analyses the…

Machine Learning · Computer Science 2020-07-27 Benjamin W. Priest , Alec Dunton , Geoffrey Sanders