English
Related papers

Related papers: On Privately Estimating a Single Parameter

200 papers

We study distributed estimation and learning problems in a networked environment where agents exchange information to estimate unknown statistical properties of random variables from their privately observed samples. The agents can…

Machine Learning · Computer Science 2024-04-02 Marios Papachristou , M. Amin Rahimian

The goal of this paper is to develop a practical and general-purpose approach to construct confidence intervals for differentially private parametric estimation. We find that the parametric bootstrap is a simple and effective solution. It…

Machine Learning · Computer Science 2021-10-13 Cecilia Ferrando , Shufan Wang , Daniel Sheldon

For large-scale cyber-physical systems, the collaboration of spatially distributed sensors is often needed to perform the state estimation process. Privacy concerns arise from disclosing sensitive measurements to a cloud estimator. To solve…

Cryptography and Security · Computer Science 2024-09-02 Mohammed M. Dawoud , Changxin Liu , Karl H. Johansson , Amr Alanwar

We propose a new estimator for the high-dimensional linear regression model with observation error in the design where the number of coefficients is potentially larger than the sample size. The main novelty of our procedure is that the…

Methodology · Statistics 2019-09-09 Alexandre Belloni , Abhishek Kaul , Mathieu Rosenbaum

Quantum estimation theory provides optimal observations for various estimation problems for unknown parameters in the state of the system under investigation. However, the theory has been developed under the assumption that every observable…

Quantum Physics · Physics 2009-11-10 M. Hotta , M. Ozawa

We propose a general privacy-preserving optimization-based framework for real-time environments without requiring trusted data curators. In particular, we introduce a noisy stochastic gradient descent algorithm for online statistical…

Methodology · Statistics 2025-06-11 Jinhan Xie , Enze Shi , Bei Jiang , Linglong Kong , Xuming He

Survival analysis is widely used in applications involving sensitive individual-level data, yet differentially private hypothesis testing for right-censored data remains largely undeveloped. We initiate a finite-sample theory of private…

Statistics Theory · Mathematics 2026-05-19 Elly K. H. Hung , Yi Yu

Privacy-preserving machine learning algorithms are crucial for the increasingly common setting in which personal data, such as medical or financial records, are analyzed. We provide general techniques to produce privacy-preserving…

Machine Learning · Computer Science 2011-02-18 Kamalika Chaudhuri , Claire Monteleoni , Anand D. Sarwate

Many privacy mechanisms reveal high-level information about a data distribution through noisy measurements. It is common to use this information to estimate the answers to new queries. In this work, we provide an approach to solve this…

Machine Learning · Computer Science 2019-01-29 Ryan McKenna , Daniel Sheldon , Gerome Miklau

The Shapley value has been proposed as a solution to many applications in machine learning, including for equitable valuation of data. Shapley values are computationally expensive and involve the entire dataset. The query for a point's…

Machine Learning · Computer Science 2022-06-02 Lauren Watson , Rayna Andreeva , Hao-Tsung Yang , Rik Sarkar

This work provides tight upper- and lower-bounds for the problem of mean estimation under $\epsilon$-differential privacy in the local model, when the input is composed of $n$ i.i.d. drawn samples from a normal distribution with variance…

Data Structures and Algorithms · Computer Science 2019-04-12 Marco Gaboardi , Ryan Rogers , Or Sheffet

For large-scale cyber-physical systems, the collaboration of spatially distributed sensors is often needed to perform the state estimation process. Privacy concerns naturally arise from disclosing sensitive measurement signals to a cloud…

Cryptography and Security · Computer Science 2023-05-15 Mohammed M. Dawoud , Changxin Liu , Amr Alanwar , Karl H. Johansson

Principal components analysis (PCA) is a standard tool for identifying good low-dimensional approximations to data in high dimension. Many data sets of interest contain private or sensitive information about individuals. Algorithms which…

Machine Learning · Statistics 2013-08-09 Kamalika Chaudhuri , Anand D. Sarwate , Kaushik Sinha

Predictive geometric models deliver excellent results for many Machine Learning use cases. Despite their undoubted performance, neural predictive algorithms can show unexpected degrees of instability and variance, particularly when applied…

Machine Learning · Computer Science 2018-07-20 Michaela Regneri , Malte Hoffmann , Jurij Kost , Niklas Pietsch , Timo Schulz , Sabine Stamm

Many modern datasets don't fit neatly into $n \times p$ matrices, but most techniques for measuring statistical stability expect rectangular data. We study methods for stability assessment on non-rectangular data, using statistical learning…

Computation · Statistics 2021-02-23 Kris Sankaran

Bayesian optimization is a powerful tool for fine-tuning the hyper-parameters of a wide variety of machine learning models. The success of machine learning has led practitioners in diverse real-world settings to learn classifiers for…

Machine Learning · Statistics 2015-02-24 Matt J. Kusner , Jacob R. Gardner , Roman Garnett , Kilian Q. Weinberger

We consider differentially private approximate singular vector computation. Known worst-case lower bounds show that the error of any differentially private algorithm must scale polynomially with the dimension of the singular vector. We are…

Data Structures and Algorithms · Computer Science 2012-11-06 Moritz Hardt , Aaron Roth

In this paper, we study the problem of precision matrix estimation when the dataset contains sensitive information. In the differential privacy framework, we develop a differentially private ridge estimator by perturbing the sample…

Machine Learning · Statistics 2019-09-09 Wenqing Su , Xiao Guo , Hai Zhang

We study a class of private learning problems in which the data is a join of private and public features. This is often the case in private personalization tasks such as recommendation or ad prediction, in which features related to…

Machine Learning · Computer Science 2023-10-25 Walid Krichene , Nicolas Mayoraz , Steffen Rendle , Shuang Song , Abhradeep Thakurta , Li Zhang

In this work, we propose differentially private methods for hypothesis testing, model averaging, and model selection for normal linear models. We consider Bayesian methods based on mixtures of $g$-priors and non-Bayesian methods based on…

Methodology · Statistics 2023-08-30 Víctor Peña , Andrés F. Barrientos