English
Related papers

Related papers: The Sparse Vector Technique, Revisited

200 papers

There are now several large scale deployments of differential privacy used to collect statistical information about users. However, these deployments periodically recollect the data and recompute the statistics using algorithms designed for…

Machine Learning · Computer Science 2018-11-21 Matthew Joseph , Aaron Roth , Jonathan Ullman , Bo Waggoner

Confidence intervals for the population mean of normally distributed data are some of the most standard statistical outputs one might want from a database. In this work we give practical differentially private algorithms for this task. We…

Methodology · Statistics 2020-01-09 Wenxin Du , Canyon Foot , Monica Moniot , Andrew Bray , Adam Groce

In this paper, we present a differential privacy version of convex and nonconvex sparse classification approach. Based on alternating direction method of multiplier (ADMM) algorithm, we transform the solving of sparse problem into the…

Machine Learning · Statistics 2019-08-05 Puyu Wang , Hai Zhang

The tuning of hyperparameters in distributed machine learning can substantially impact model performance. When the hyperparameters are tuned on sensitive data, privacy becomes an important challenge and to this end, differential privacy has…

Machine Learning · Computer Science 2025-10-08 Johannes Liebenow , Thorsten Peinemann , Esfandiar Mohammadi

Differential privacy is a modern approach in privacy-preserving data analysis to control the amount of information that can be inferred about an individual by querying a database. The most common techniques are based on the introduction of…

Cryptography and Security · Computer Science 2012-07-05 Catuscia Palamidessi , Marco Stronati

We study the fundamental problems of identity testing (goodness of fit), and closeness testing (two sample test) of distributions over $k$ elements, under differential privacy. While the problems have a long history in statistics, finite…

Machine Learning · Computer Science 2017-11-01 Jayadev Acharya , Ziteng Sun , Huanyu Zhang

Data scientists often seek to identify the most important features in high-dimensional datasets. This can be done through $L_1$-regularized regression, but this can become inefficient for very high-dimensional datasets. Additionally,…

Machine Learning · Computer Science 2024-08-26 Ryan Swope , Amol Khanna , Philip Doldo , Saptarshi Roy , Edward Raff

User privacy can be compromised by matching user data traces to records of their previous behavior. The matching of the statistical characteristics of traces to prior user behavior has been widely studied. However, an adversary can also…

Cryptography and Security · Computer Science 2021-08-30 Bo Guan , Nazanin Takbiri , Dennis Goeckel , Amir Houmansadr , Hossein Pishro-Nik

Differential privacy enables organizations to collect accurate aggregates over sensitive data with strong, rigorous guarantees on individuals' privacy. Previous work has found that under differential privacy, computing multiple correlated…

Databases · Computer Science 2016-05-18 Ganzhao Yuan , Yin Yang , Zhenjie Zhang , Zhifeng Hao

Differential privacy is a strong mathematical notion of privacy. Still, a prominent challenge when using differential privacy in real data collection is understanding and counteracting the accuracy loss that differential privacy imposes. As…

Cryptography and Security · Computer Science 2021-08-24 Boel Nelson

In this paper, we study the problem of estimating the covariance matrix under differential privacy, where the underlying covariance matrix is assumed to be sparse and of high dimensions. We propose a new method, called DP-Thresholding, to…

Machine Learning · Computer Science 2019-04-17 Di Wang , Jinhui Xu

Hypothesis testing plays a central role in statistical inference, and is used in many settings where privacy concerns are paramount. This work answers a basic question about privately testing simple hypotheses: given two distributions $P$…

Data Structures and Algorithms · Computer Science 2019-04-04 Clément L. Canonne , Gautam Kamath , Audra McMillan , Adam Smith , Jonathan Ullman

In the past decade analysis of big data has proven to be extremely valuable in many contexts. Local Differential Privacy (LDP) is a state-of-the-art approach which allows statistical computations while protecting each individual user's…

Cryptography and Security · Computer Science 2019-07-30 Björn Bebensee

The rise of connected personal devices together with privacy concerns call for machine learning algorithms capable of leveraging the data of a large number of agents to learn personalized models under strong privacy requirements. In this…

Machine Learning · Computer Science 2018-02-20 Aurélien Bellet , Rachid Guerraoui , Mahsa Taziki , Marc Tommasi

We study the sample complexity of learning threshold functions under the constraint of differential privacy. It is assumed that each labeled example in the training data is the information of one individual and we would like to come up with…

Data Structures and Algorithms · Computer Science 2019-11-25 Haim Kaplan , Katrina Ligett , Yishay Mansour , Moni Naor , Uri Stemmer

Recently differential privacy has been used for a number of streaming, data structure, and dynamic graph problems as a means of hiding the internal randomness of the data structure, so that multiple possibly adaptive queries can be made…

Data Structures and Algorithms · Computer Science 2025-06-09 Shiyuan Feng , Ying Feng , George Z. Li , Zhao Song , David P. Woodruff , Lichen Zhang

One goal of statistical privacy research is to construct a data release mechanism that protects individual privacy while preserving information content. An example is a {\em random mechanism} that takes an input database $X$ and outputs a…

Statistics Theory · Mathematics 2012-01-11 Larry Wasserman , Shuheng Zhou

Concern about how to aggregate sensitive user data without compromising individual privacy is a major barrier to greater availability of data. The model of differential privacy has emerged as an accepted model to release sensitive…

Databases · Computer Science 2017-10-03 Graham Cormode , Tejas Kulkarni , Divesh Srivastava

Sparse deep learning aims to address the challenge of huge storage consumption by deep neural networks, and to recover the sparse structure of target functions. Although tremendous empirical successes have been achieved, most sparse deep…

Machine Learning · Statistics 2020-11-17 Jincheng Bai , Qifan Song , Guang Cheng

Differential privacy provides the first theoretical foundation with provable privacy guarantee against adversaries with arbitrary prior knowledge. The main idea to achieve differential privacy is to inject random noise into statistical…

Data Structures and Algorithms · Computer Science 2011-11-01 Yang D. Li , Zhenjie Zhang , Marianne Winslett , Yin Yang