中文

Huber (M)-估计量的方差崩溃:$n/p \rightarrow m \in (1,\infty)$

统计理论 2015-03-10 v1 统计理论

摘要

半个世纪前,Huber在标量位置估计中评估了极小极大渐近方差,minψmaxFFϵV(ψ,F)=1I(Fϵ)\min_\psi \max_{F \in {\cal F}_\epsilon} V(\psi, F) = \frac{1}{I(F_\epsilon^*)},其中V(ψ,F)V(\psi,F)表示具有计分函数ψ\psi的位置(M)(M)-估计量的渐近方差,I(Fϵ)I(F_\epsilon^*)ϵ\epsilon-污染正态分布类上的最小Fisher信息minFϵI(F)\min_{{\cal F}_\epsilon} I(F)。我们考虑线性模型Y=Xθ0+WY = X\theta_0 + WWii.i.d.FW_i\sim_{\text{i.i.d.}}F,以及独立同分布的正态预测变量Xi,jX_{i,j},工作于观测数nn与变量数pp均趋于无穷的高维极限渐近下,且n/pm(1,)n/p \rightarrow m \in (1,\infty);因此mm扮演“每个被估计参数的渐近观测数”的角色。令Vm(ψ,F)V_m(\psi,F)表示在n/pmn/p \rightarrow m机制下回归的(M)(M)-估计量的逐坐标渐近方差。则VmVV_m \neq V;但VmVV_m \rightarrow Vmm \rightarrow \infty。本文中我们评估Huber (M)(M)-估计的极小极大渐近方差。统计学家在所有Huber回归(M)(M)-估计调谐族(ψλ)λ>0(\psi_\lambda)_{\lambda > 0}上最小化,而自然在粗差污染FFϵF \in {\cal F}_\epsilon上最大化。假设I(Fϵ)m>1I(F_\epsilon^*) \cdot m > 1。则minλmaxFFϵVm(ψλ,F)=1I(Fϵ)1/m\min_\lambda \max_{F \in {\cal F}_\epsilon} V_m(\psi_\lambda, F) = \frac{1}{I(F_\epsilon^*) - 1/m}。引人注目地,若I(Fϵ)m1I(F_\epsilon^*) \cdot m \leq 1,则极小极大渐近方差为++\infty。崩溃点在于每参数Fisher信息等于1处。

关键词

引用

@article{arxiv.1503.02106,
  title  = {Variance Breakdown of Huber (M)-estimators: $n/p \rightarrow m \in (1,\infty)$},
  author = {David L. Donoho and Andrea Montanari},
  journal= {arXiv preprint arXiv:1503.02106},
  year   = {2015}
}

备注

Based on a lecture delivered at a special colloquium honoring the 50th anniversary of the Seminar f\"ur Statistik (SfS) at ETH Z\"urich, November 25, 2014