English

Predictive density estimators with integrated $L_1$ loss

Statistics Theory 2022-10-04 v1 Methodology Other Statistics Statistics Theory

Abstract

This paper addresses the problem of an efficient predictive density estimation for the density q(yθ2)q(\|y-\theta\|^2) of YY based on Xp(xθ2)X \sim p(\|x-\theta\|^2) for y,x,θRdy, x, \theta \in \mathbb{R}^d. The chosen criteria are integrated L1L_1 loss given by L(θ,q^)=Rdq^(y)q(yθ2)dyL(\theta, \hat{q}) \, =\, \int_{\mathbb{R}^d} \big|\hat{q}(y)- q(\|y-\theta\|^2) \big| \, dy, and the associated frequentist risk, for θΘ\theta \in \Theta. For absolutely continuous and strictly decreasing qq, we establish the inevitability of scale expansion improvements q^c(y;X)=1cdq(yX2/c2)\hat{q}_c(y;X)\,=\, \frac{1}{c^d} q\big(\|y-X\|^2/c^2 \big) over the plug-in density q^1\hat{q}_1, for a subset of values c(1,c0)c \in (1,c_0). The finding is universal with respect to p,qp,q, and d2d \geq 2, and extended to loss functions γ(L(θ,q^))\gamma \big(L(\theta, \hat{q} ) \big) with strictly increasing γ\gamma. The finding is also extended to include scale expansion improvements of more general plug-in densities q(yθ^(X)2)q(\|y-\hat{\theta}(X)\|^2 \big), when the parameter space Θ\Theta is a compact subset of Rd\mathbb{R}^d. Numerical analyses illustrative of the dominance findings are presented and commented upon. As a complement, we demonstrate that the unimodal assumption on qq is necessary with a detailed analysis of cases where the distribution of YθY|\theta is uniformly distributed on a ball centered about θ\theta. In such cases, we provide a univariate (d=1d=1) example where the best equivariant estimator is a plug-in estimator, and we obtain cases (for d=1,3d=1,3) where the plug-in density q^1\hat{q}_1 is optimal among all q^c\hat{q}_c.

Keywords

Cite

@article{arxiv.2210.00972,
  title  = {Predictive density estimators with integrated $L_1$ loss},
  author = {Pankaj Bhagwat and Eric Marchand},
  journal= {arXiv preprint arXiv:2210.00972},
  year   = {2022}
}

Comments

20 pages, 3 figures

R2 v1 2026-06-28T02:37:02.198Z