English

Horseshoe Priors and MDP

Statistics Theory 2026-04-03 v1 Computation Statistics Theory

Abstract

Carvalho (2010) established two foundational theorems for the horseshoe prior: tight two-sided logarithmic bounds on the marginal density near the origin (Theorem~1.1), and a super-efficient rate of convergence of the Bayes predictive density to the true sampling density in sparse situations (Theorem~2). The ``Shrink Globally, Act Locally'' paper \citep{polson2010shrink} formalised necessary and sufficient conditions on the prior's behaviour at the origin for sparsity adaptation as pp \to \infty. We show that these results are not merely descriptive properties of the horseshoe -- they are the finite-sample precursors to the asymptotic moderate deviation principle (MDP) of \citet{datta2026newlook}. The log-pole singularity \piH(θ)log\absθ\piH(\theta) \asymp -\log\abs{\theta} is precisely the origin integrability boundary that selects the MDP threshold \tcrit=log(πn/2)\tcrit = \sqrt{\log(\pi n/2)}; super-efficiency below the threshold and tail robustness above it together produce the ABOS Bayes risk p0log(p/p0)/np_0 \log(p/p_0)/n; and the Clarke--Barron information-theoretic asymptotics of Bayes methods provide the unifying framework in which all three results are faces of a single logarithmic budget principle.

Cite

@article{arxiv.2604.01266,
  title  = {Horseshoe Priors and MDP},
  author = {Nick Polson and Vadim Sokolov and Daniel Zantedeschi},
  journal= {arXiv preprint arXiv:2604.01266},
  year   = {2026}
}
R2 v1 2026-07-01T11:49:38.310Z