English
Related papers

Related papers: Privately Estimating Monotone Statistics in Polyno…

200 papers

In this article, we discuss the optimal allocation problem in an experiment when a regression model is used for statistical analysis. Monotonic convergence for a general class of multiplicative algorithms for $D$-optimality has been…

Computation · Statistics 2013-10-28 Wei Gao , Ping Shing Chan , Hon Keung Tony Ng , Xiaolei Lu

Acquisition of data is a difficult task in many applications of machine learning, and it is only natural that one hopes and expects the population risk to decrease (better performance) monotonically with increasing data points. It turns…

Machine Learning · Computer Science 2022-01-19 Zakaria Mhammedi

We study the problem of differentially private continual counting in the unbounded setting where the input size $n$ is not known in advance. Current state-of-the-art algorithms based on optimal instantiations of the matrix mechanism cannot…

Cryptography and Security · Computer Science 2025-12-02 Ben Jacobsen , Kassem Fawaz

Differential privacy (DP) is a rigorous notion of data privacy, used for private statistics. The canonical algorithm for differentially private mean estimation is to first clip the samples to a bounded range and then add noise to their…

Statistics Theory · Mathematics 2024-10-10 Gautam Kamath , Argyris Mouzakis , Matthew Regehr , Vikrant Singhal , Thomas Steinke , Jonathan Ullman

Many differentially private algorithms for answering database queries involve a step that reconstructs a discrete data distribution from noisy measurements. This provides consistent query answers and reduces error, but often requires space…

Machine Learning · Computer Science 2021-10-27 Ryan McKenna , Siddhant Pradhan , Daniel Sheldon , Gerome Miklau

We propose a strategy for computing the isotonic least-squares estimate of a monotone function in a general regression setting where the data are distributed across different servers and the observations across servers, though independent,…

Statistics Theory · Mathematics 2018-06-25 Moulinath Banerjee , Cecile Durot

The turnstile continual release model of differential privacy captures scenarios where a privacy-preserving real-time analysis is sought for a dataset evolving through additions and deletions. In typical applications of real-time data…

Data Structures and Algorithms · Computer Science 2025-05-30 Rachel Cummings , Alessandro Epasto , Jieming Mao , Tamalika Mukherjee , Tingting Ou , Peilin Zhong

We study person-level differentially private (DP) mean estimation in the case where each person holds multiple samples. DP here requires the usual notion of distributional stability when $\textit{all}$ of a person's datapoints can be…

Data Structures and Algorithms · Computer Science 2024-07-22 Sushant Agarwal , Gautam Kamath , Mahbod Majid , Argyris Mouzakis , Rose Silver , Jonathan Ullman

In statistical modeling of computer experiments sometimes prior information is available about the underlying function. For example, the physical system simulated by the computer code may be known to be monotone with respect to some or all…

Methodology · Statistics 2014-06-17 Shirin Golchi , Derek R. Bingham , Hugh Chipman , David A. Campbell

With the development of big data and machine learning, privacy concerns have become increasingly critical, especially when handling heterogeneous datasets containing sensitive personal information. Differential privacy provides a rigorous…

Machine Learning · Statistics 2025-08-08 Ziliang Shen , Caixing Wang , Shaoli Wang , Yibo Yan

We initiate a systematic study of algorithms that are both differentially private and run in sublinear time for several problems in which the goal is to estimate natural graph parameters. Our main result is a differentially-private…

Data Structures and Algorithms · Computer Science 2022-03-15 Jeremiah Blocki , Elena Grigorescu , Tamalika Mukherjee

We introduce a new algorithm for numerical composition of privacy random variables, useful for computing the accurate differential privacy parameters for composition of mechanisms. Our algorithm achieves a running time and memory usage of…

Data Structures and Algorithms · Computer Science 2022-07-12 Badih Ghazi , Pritish Kamath , Ravi Kumar , Pasin Manurangsi

For many tasks of data analysis, we may only have the information of the explanatory variable and the evaluation of the response values are quite expensive. While it is impractical or too costly to obtain the responses of all units, a…

Computation · Statistics 2023-04-07 Wei Zheng , Ting Tian , Xueqin Wang

Privacy-preserving data analysis is a rising challenge in contemporary statistics, as the privacy guarantees of statistical methods are often achieved at the expense of accuracy. In this paper, we investigate the tradeoff between…

Machine Learning · Statistics 2020-11-11 T. Tony Cai , Yichen Wang , Linjun Zhang

We consider the privacy amplification properties of a sampling scheme in which a user's data is used in $k$ steps chosen randomly and uniformly from a sequence (or set) of $t$ steps. This sampling scheme has been recently applied in the…

Machine Learning · Computer Science 2026-02-20 Vitaly Feldman , Moshe Shenfeld

In distributed, or privacy-preserving learning, we are often given a set of probabilistic models estimated from different local repositories, and asked to combine them into a single model that gives efficient statistical estimation. A…

Machine Learning · Statistics 2017-03-01 Jun Han , Qiang Liu

In privacy under continual observation we study how to release differentially private estimates based on a dataset that evolves over time. The problem of releasing private prefix sums of $x_1,x_2,x_3,\dots \in\{0,1\}$ (where the value of…

Machine Learning · Computer Science 2024-01-17 Joel Daniel Andersson , Rasmus Pagh

We provide a differentially private algorithm for producing synthetic data simultaneously useful for multiple tasks: marginal queries and multitask machine learning (ML). A key innovation in our algorithm is the ability to directly handle…

Quantiles are often used for summarizing and understanding data. If that data is sensitive, it may be necessary to compute quantiles in a way that is differentially private, providing theoretical guarantees that the result does not reveal…

Machine Learning · Computer Science 2021-09-21 Jennifer Gillenwater , Matthew Joseph , Alex Kulesza

In social choice theory, (Kemeny) rank aggregation is a well-studied problem where the goal is to combine rankings from multiple voters into a single ranking on the same set of items. Since rankings can reveal preferences of voters (which a…

Data Structures and Algorithms · Computer Science 2021-12-30 Daniel Alabi , Badih Ghazi , Ravi Kumar , Pasin Manurangsi