English

Sharper lower bounds on the performance of the empirical risk minimization algorithm

Statistics Theory 2011-02-25 v1 Statistics Theory

Abstract

We present an argument based on the multidimensional and the uniform central limit theorems, proving that, under some geometrical assumptions between the target function TT and the learning class FF, the excess risk of the empirical risk minimization algorithm is lower bounded by EsupqQGqnδ,\frac{\mathbb{E}\sup_{q\in Q}G_q}{\sqrt{n}}\delta, where (Gq)qQ(G_q)_{q\in Q} is a canonical Gaussian process associated with QQ (a well chosen subset of FF) and δ\delta is a parameter governing the oscillations of the empirical excess risk function over a small ball in FF.

Keywords

Cite

@article{arxiv.1102.4983,
  title  = {Sharper lower bounds on the performance of the empirical risk minimization algorithm},
  author = {Guillaume Lecué and Shahar Mendelson},
  journal= {arXiv preprint arXiv:1102.4983},
  year   = {2011}
}

Comments

Published in at http://dx.doi.org/10.3150/09-BEJ225 the Bernoulli (http://isi.cbs.nl/bernoulli/) by the International Statistical Institute/Bernoulli Society (http://isi.cbs.nl/BS/bshome.htm)

R2 v1 2026-06-21T17:31:09.162Z