English
Related papers

Related papers: Universal Private Estimators

200 papers

Robust statistics traditionally focuses on outliers, or perturbations in total variation distance. However, a dataset could be corrupted in many other ways, such as systematic measurement errors and missing covariates. We generalize the…

Statistics Theory · Mathematics 2020-12-15 Banghua Zhu , Jiantao Jiao , Jacob Steinhardt

A key task in managing distributed, sensitive data is to measure the extent to which a distribution changes. Understanding this drift can effectively support a variety of federated learning and analytics tasks. However, in many practical…

Machine Learning · Computer Science 2024-12-02 Mary Scott , Sayan Biswas , Graham Cormode , Carsten Maple

In modern settings of data analysis, we may be running our algorithms on datasets that are sensitive in nature. However, classical machine learning and statistical algorithms were not designed with these risks in mind, and it has been…

Data Structures and Algorithms · Computer Science 2021-08-21 Huanyu Zhang

Recent work in differential privacy has explored the prospect of combining local randomization with a secure intermediary. Specifically, there are a variety of protocols in the secure shuffle model (where an intermediary randomly permutes…

Cryptography and Security · Computer Science 2021-12-28 Albert Cheu , Chao Yan

Information theoretic quantities play an important role in various settings in machine learning, including causality testing, structure inference in graphical models, time-series problems, feature selection as well as in providing privacy…

Information Theory · Computer Science 2018-10-30 Arman Rahimzamani , Himanshu Asnani , Pramod Viswanath , Sreeram Kannan

Differential Privacy (DP) is a mathematical framework for releasing information with formal privacy guarantees. While numerous DP procedures have been developed for statistical analysis and machine learning, valid statistical inference…

Methodology · Statistics 2025-06-27 Ruyu Zhou , Fang Liu

We study admissibility of a subclass of generalized Bayes estimators of a multivariate normal vector when the variance is unknown, under scaled quadratic loss. Minimaxity is also established for certain of these estimators.

Statistics Theory · Mathematics 2020-03-20 Yuzo Maruyama , William E. Strawderman

This paper introduces a novel and scalable framework for uncertainty estimation and separation with applications in data driven modeling in science and engineering tasks where reliable uncertainty quantification is critical. Leveraging an…

Machine Learning · Computer Science 2024-12-19 Navid Ansari , Hans-Peter Seidel , Vahid Babaei

Existing algorithms for subgroup discovery with numerical targets do not optimize the error or target variable dispersion of the groups they find. This often leads to unreliable or inconsistent statements about the data, rendering practical…

Artificial Intelligence · Computer Science 2017-07-06 Mario Boley , Bryan R. Goldsmith , Luca M. Ghiringhelli , Jilles Vreeken

We study the privacy-utility trade-off in the context of metric differential privacy. Ghosh et al. introduced the idea of universal optimality to characterise the best mechanism for a certain query that simultaneously satisfies (a fixed)…

Cryptography and Security · Computer Science 2022-05-04 Natasha Fernandes , Annabelle McIver , Catuscia Palamidessi , Ming Ding

Generalized linear models are flexible tools for the analysis of diverse datasets, but the classical formulation requires that the parametric component is correctly specified and the data contain no atypical observations. To address these…

Methodology · Statistics 2023-04-21 Ioannis Kalogridis , Gerda Claeskens , Stefan Van Aelst

This article introduces trimmed estimators for the mean and covariance function of general functional data. The estimators are based on a new measure of outlyingness or data depth that is well defined on any metric space, although this…

Methodology · Statistics 2012-12-03 Daniel Gervini

Conformal predictors provide set or functional predictions that are valid under the assumption of randomness, i.e., under the assumption of independent and identically distributed data. The question asked in this paper is whether there are…

Machine Learning · Computer Science 2025-06-10 Vladimir Vovk

A scheme that publishes aggregate information about sensitive data must resolve the trade-off between utility to information consumers and privacy of the database participants. Differential privacy is a well-established definition of…

Cryptography and Security · Computer Science 2010-01-18 Mangesh Gupte , Mukund Sundararajan

The increasing prevalence of high-dimensional data across various applications has raised significant privacy concerns in statistical inference. In this paper, we propose a differentially private integrated statistic for testing…

Methodology · Statistics 2025-06-04 Shiwei Sang , Yicheng Zeng , Xuehu Zhu , Shurong Zheng

Given a differentially private unbiased estimate $\tilde{q}=q(D) +\nu$ of a statistic $q(D)$, we wish to obtain unbiased estimates of functions of $q(D)$, such as $1/q(D)$, solely through post-processing of $\tilde{q}$, with no further…

Cryptography and Security · Computer Science 2025-12-17 Flavio Calmon , Elbert Du , Cynthia Dwork , Brian Finley , Grigory Franguridi

We consider the problem of hypothesis testing for discrete distributions. In the standard model, where we have sample access to an underlying distribution $p$, extensive research has established optimal bounds for uniformity testing,…

Machine Learning · Computer Science 2024-12-03 Maryam Aliakbarpour , Piotr Indyk , Ronitt Rubinfeld , Sandeep Silwal

The aim of this paper is to introduce new statistical criterions for estimation, suitable for inference in models with common continuous support. This proposal is in the direct line of a renewed interest for divergence based inference tools…

Statistics Theory · Mathematics 2015-03-19 Michel Broniatowski , Aida Toma , Igor Vajda

Recent research in differential privacy demonstrated that (sub)sampling can amplify the level of protection. For example, for $\epsilon$-differential privacy and simple random sampling with sampling rate $r$, the actual privacy guarantee is…

Applications · Statistics 2022-02-22 Jingchen Hu , Joerg Drechsler , Hang J. Kim

This paper is concerned with estimation and inference for ultrahigh dimensional partially linear single-index models. The presence of high dimensional nuisance parameter and nuisance unknown function makes the estimation and inference…

Methodology · Statistics 2024-04-09 Shijie Cui , Xu Guo , Zhe Zhang