English

Robust density estimation over star-shaped density classes

Statistics Theory 2025-01-20 v1 Machine Learning Statistics Theory

Abstract

We establish a novel criterion for comparing the performance of two densities, g1g_1 and g2g_2, within the context of corrupted data. Utilizing this criterion, we propose an algorithm to construct a density estimator within a star-shaped density class, F\mathcal{F}, under conditions of data corruption. We proceed to derive the minimax upper and lower bounds for density estimation across this star-shaped density class, characterized by densities that are uniformly bounded above and below (in the sup norm), in the presence of adversarially corrupted data. Specifically, we assume that a fraction ϵ13\epsilon \leq \frac{1}{3} of the NN observations are arbitrarily corrupted. We obtain the minimax upper bound max{τJ2,ϵ}d2\max\{ \tau_{\overline{J}}^2, \epsilon \} \wedge d^2. Under certain conditions, we obtain the minimax risk, up to proportionality constants, under the squared L2L_2 loss as max{τ2d2,ϵd2}, \max\left\{ \tau^{*2} \wedge d^2, \epsilon \wedge d^2 \right\}, where τ:=sup{τ:Nτ2logMFloc(τ,c)}\tau^* := \sup\left\{ \tau : N\tau^2 \leq \log \mathcal{M}_{\mathcal{F}}^{\text{loc}}(\tau, c) \right\} for a sufficiently large constant cc. Here, MFloc(τ,c)\mathcal{M}_{\mathcal{F}}^{\text{loc}}(\tau, c) denotes the local entropy of the set F\mathcal{F}, and dd is the L2L_2 diameter of F\mathcal{F}.

Keywords

Cite

@article{arxiv.2501.10025,
  title  = {Robust density estimation over star-shaped density classes},
  author = {Xiaolong Liu and Matey Neykov},
  journal= {arXiv preprint arXiv:2501.10025},
  year   = {2025}
}
R2 v1 2026-06-28T21:09:04.056Z