English
Related papers

Related papers: Minimax density estimation in the adversarial fram…

200 papers

We study minimax convergence rates of nonparametric density estimation under a large class of loss functions called "adversarial losses", which, besides classical $\mathcal{L}^p$ losses, includes maximum mean discrepancy (MMD), Wasserstein…

Statistics Theory · Mathematics 2018-10-30 Shashank Singh , Ananya Uppal , Boyue Li , Chun-Liang Li , Manzil Zaheer , Barnabás Póczos

Local differential privacy is a promising privacy-preserving model for statistical aggregation of user data that prevents user privacy leakage from the data aggregator. This paper focuses on the problem of estimating the distribution of…

Cryptography and Security · Computer Science 2021-02-26 Ba Dung Le , Tanveer Zia

Differential Privacy (DP) is the current gold-standard for ensuring privacy for statistical queries. Estimation problems under DP constraints appearing in the literature have largely focused on providing equal privacy to all users. We…

Machine Learning · Computer Science 2025-04-22 Syomantak Chaudhuri , Thomas A. Courtade

We study statistical estimation under local differential privacy (LDP) when users may hold heterogeneous privacy levels and accuracy must be guaranteed with high probability. Departing from the common in-expectation analyses, and for…

Machine Learning · Statistics 2025-10-15 Maryam Aliakbarpour , Alireza Fallah , Swaha Roy , Ria Stevens

We consider density estimation for Besov spaces when each sample is quantized to only a limited number of bits. We provide a noninteractive adaptive estimator that exploits the sparsity of wavelet bases, along with a simulate-and-infer…

Statistics Theory · Mathematics 2021-07-22 Jayadev Acharya , Clément L. Canonne , Aditya Vikram Singh , Himanshu Tyagi

We consider the problem of estimating the probability density function of a circular random variable observed under censoring. To this end, we introduce a projection estimator constructed via a regression approach on linear sieves. We first…

Statistics Theory · Mathematics 2025-12-09 Nicolas Conanec , Claire Lacour , Thanh Mai Pham Ngoc

We study the problem of estimating the spectral density of a centered stationary Gaussian time series under local differential privacy constraints. Specifically, we propose new interactive privacy mechanisms for three tasks: recovering a…

Statistics Theory · Mathematics 2026-03-17 Cristina Butucea , Karolina Klockmann , Tatyana Krivobokova

Preserving privacy of continuous and/or high-dimensional data such as images, videos and audios, can be challenging with syntactic anonymization methods which are designed for discrete attributes. Differential privacy, which provides a more…

Machine Learning · Computer Science 2017-12-04 Jihun Hamm

We formulate the notion of minimax estimation under storage or communication constraints, and prove an extension to Pinsker's theorem for nonparametric estimation over Sobolev ellipsoids. Placing limits on the number of bits used to encode…

Statistics Theory · Mathematics 2017-04-13 Yuancheng Zhu , John Lafferty

The challenge of producing accurate statistics while respecting the privacy of the individuals in a sample is an important area of research. We study minimax lower bounds for classes of differentially private estimators. In particular, we…

Machine Learning · Computer Science 2024-09-19 Clément Lalanne , Aurélien Garivier , Rémi Gribonval

We study the classical problem of community recovery in stochastic block models with a fixed number of communities, with a twist: We seek algorithms that are stable with respect to node-wise changes in the graph structure, formally defined…

Statistics Theory · Mathematics 2026-05-18 Laurentiu Marchis , Ethan D'souza , Tomáš Flídr , Po-Ling Loh

Density-adaptive domain discretization is essential for high-utility privacy-preserving analytics but remains challenging under Local Differential Privacy (LDP) due to the privacy-budget costs associated with iterative refinement. We…

Machine Learning · Computer Science 2026-02-24 Alexey Kroshnin , Alexandra Suvorikova

We examine the relationship between privacy metrics that utilize information density to measure information leakage between a private and a disclosed random variable. Firstly, we prove that bounding the information density from above or…

Information Theory · Computer Science 2024-02-21 Leonhard Grosse , Sara Saeidian , Parastoo Sadeghi , Tobias J. Oechtering , Mikael Skoglund

Deep learning models are widely deployed in safety-critical domains, but remain vulnerable to adversarial attacks. In this paper, we study the adversarial robustness of NTK neural networks in the context of nonparametric regression. We…

Machine Learning · Statistics 2026-04-30 Yuxuan Hou

We study the problem of mean estimation of $\ell_2$-bounded vectors under the constraint of local differential privacy. While the literature has a variety of algorithms that achieve the asymptotically optimal rates for this problem, the…

Machine Learning · Computer Science 2022-05-06 Hilal Asi , Vitaly Feldman , Kunal Talwar

We study the fundamental task of estimating the median of an underlying distribution from a finite number of samples, under pure differential privacy constraints. We focus on distributions satisfying the minimal assumption that they have a…

Statistics Theory · Mathematics 2020-11-13 Christos Tzamos , Emmanouil-Vasileios Vlatakis-Gkaragkounis , Ilias Zadik

This paper develops a novel differentially private framework to solve convex optimization problems with sensitive optimization data and complex physical or operational constraints. Unlike standard noise-additive algorithms, that act…

Cryptography and Security · Computer Science 2020-06-23 Vladimir Dvorkin , Ferdinando Fioretto , Pascal Van Hentenryck , Jalal Kazempour , Pierre Pinson

It is of soaring demand to develop statistical analysis tools that are robust against contamination as well as preserving individual data owners' privacy. In spite of the fact that both topics host a rich body of literature, to the best of…

Statistics Theory · Mathematics 2022-09-01 Mengchu Li , Thomas B. Berrett , Yi Yu

We systematically investigate the preservation of differential privacy in functional data analysis, beginning with functional mean estimation and extending to varying coefficient model estimation. Our work introduces a distributed learning…

Statistics Theory · Mathematics 2026-02-11 Gengyu Xue , Zhenhua Lin , Yi Yu

We identify fundamental tradeoffs between statistical utility and privacy under local models of privacy in which data is kept private even from the statistician, providing instance-specific bounds for private estimation and learning…

Statistics Theory · Mathematics 2020-10-01 John C. Duchi , Feng Ruan