English

About the non-asymptotic behaviour of Bayes estimators

Statistics Theory 2014-11-03 v2 Statistics Theory

Abstract

This paper investigates the {\em nonasymptotic} properties of Bayes procedures for estimating an unknown distribution from nn i.i.d.\ observations. We assume that the prior is supported by a model (\scrS,h)(\scr{S},h) (where hh denotes the Hellinger distance) with suitable metric properties involving the number of small balls that are needed to cover larger ones. We also require that the prior put enough probability on small balls. We consider two different situations. The simplest case is the one of a parametric model containing the target density for which we show that the posterior concentrates around the true distribution at rate 1/n1/\sqrt{n}. In the general situation, we relax the parametric assumption and take into account a possible mispecification of the model. Provided that the Kullback-Leibler Information between the true distribution and \scrS\scr{S} is finite, we establish risk bounds for the Bayes estimators.

Keywords

Cite

@article{arxiv.1402.3695,
  title  = {About the non-asymptotic behaviour of Bayes estimators},
  author = {Lucien Birgé},
  journal= {arXiv preprint arXiv:1402.3695},
  year   = {2014}
}

Comments

Extended version of a talk given in June 2013 at BNP9 Conference in Amsterdam - 17 pages