English

A generalized Catoni's ${\rm M}$-estimator under finite {$\alpha$-th moment assumption} with $\alpha \in (1,2)$

Statistics Theory 2020-10-13 v1 Statistics Theory

Abstract

We generalize the { M{\rm M}-estimator} put forward by Catoni in his seminal paper [C12] to the case in which samples can have finite α\alpha-th moment with α(1,2)\alpha \in (1,2) rather than finite variance, our approach is by slightly modifying the influence function φ\varphi therein. The choice of the new influence function is inspired by the Taylor-like expansion developed in [C-N-X]. We obtain a deviation bound of the estimator, as α2\alpha \rightarrow 2, this bound is the same as that in [C12]. Experiment shows that our generalized M{\rm M}-estimator performs better than the empirical mean estimator, the smaller the α\alpha is, the better the performance will be. As an application, we study an 1\ell_{1} regression considered by Zhang et al. [Z-Z] who assumed that samples have finite variance, and relax their assumption to be finite {α\alpha-th} moment with α(1,2)\alpha \in (1,2).

Keywords

Cite

@article{arxiv.2010.05008,
  title  = {A generalized Catoni's ${\rm M}$-estimator under finite {$\alpha$-th moment assumption} with $\alpha \in (1,2)$},
  author = {Peng Chen and Xinghu Jin and Xiang Li and Lihu Xu},
  journal= {arXiv preprint arXiv:2010.05008},
  year   = {2020}
}