English
Related papers

Related papers: M-estimators for Isotonic Regression

200 papers

A popular regularized (shrinkage) covariance estimator is the shrinkage sample covariance matrix (SCM) which shares the same set of eigenvectors as the SCM but shrinks its eigenvalues toward its grand mean. In this paper, a more general…

Methodology · Statistics 2020-02-13 Esa Ollila , Daniel P. Palomar , Frederic Pascal

Nonparametric estimators of a regression function with circular response and Rd-valued predictor are considered in this work. Local polynomial type estimators are proposed and studied. Expressions for their asymptotic biases and variances…

The goal of this paper is to show that a single robust estimator of the mean of a multivariate Gaussian distribution can enjoy five desirable properties. First, it is computationally tractable in the sense that it can be computed in a time…

Statistics Theory · Mathematics 2022-10-28 Arnak S. Dalalyan , Arshak Minasyan

This paper studies M-estimators with gradient-Lipschitz loss function regularized with convex penalty in linear models with Gaussian design matrix and arbitrary noise distribution. A practical example is the robust M-estimator constructed…

Statistics Theory · Mathematics 2025-01-03 Pierre C Bellec , Yiwei Shen

Multivariate elliptically-contoured distributions are widely used for modeling correlated and non-Gaussian data. In this work, we study the kurtosis of the elliptical model, which is an important parameter in many statistical analysis.…

Statistics Theory · Mathematics 2024-08-23 Bowen Zhou , Peirong Xu , Cheng Wang

This paper illustrates the use of selected robust estimators of covariance or correlation in the identification of anomalous laboratory results in inter-laboratory data. It is shown that robust estimators can substantially reduce the impact…

Applications · Statistics 2019-05-29 Stephen L R Ellison

In this article, we propose some new generalizations of M-estimation procedures for single-index regression models in presence of randomly right-censored responses. We derive consistency and asymptotic normality of our estimates. The…

Statistics Theory · Mathematics 2008-12-18 Olivier Lopez

To take sample biases and skewness in the observations into account, practitioners frequently weight their observations according to some marginal distribution. The present paper demonstrates that such weighting can indeed improve the…

Methodology · Statistics 2018-11-05 Tobias Niebuhr , Mathias Trabs

Robustly determining the optimal number of clusters in a data set is an essential factor in a wide range of applications. Cluster enumeration becomes challenging when the true underlying structure in the observed data is corrupted by…

Signal Processing · Electrical Eng. & Systems 2021-05-06 Christian A. Schroth , Michael Muma

Imputing missing potential outcomes using an estimated regression function is a natural idea for estimating causal effects. In the literature, estimators that combine imputation and regression adjustments are believed to be comparable to…

Statistics Theory · Mathematics 2023-01-20 Zhexiao Lin , Fang Han

Method of moment estimators exhibit appealing statistical properties, such as asymptotic unbiasedness, for nonconvex problems. However, they typically require a large number of samples and are extremely sensitive to model misspecification.…

Computation · Statistics 2016-03-30 Dustin Tran , Minjae Kim , Finale Doshi-Velez

Item nonresponse is a common issue in surveys. Because unadjusted estimators may be biased in the presence of nonresponse, it is common practice to impute the missing values with the objective of reducing the nonresponse bias as much as…

Methodology · Statistics 2020-10-06 Sixia Chen , David Haziza , Victoire Michal

We offer a survey of recent results on covariance estimation for heavy-tailed distributions. By unifying ideas scattered in the literature, we propose user-friendly methods that facilitate practical implementation. Specifically, we…

Methodology · Statistics 2019-03-12 Yuan Ke , Stanislav Minsker , Zhao Ren , Qiang Sun , Wen-Xin Zhou

We consider the problem of estimating the error variance in a general linear model when the error distribution is assumed to be spherically symmetric, but not necessary Gaussian. In particular we study the case of a scale mixture of…

Statistics Theory · Mathematics 2013-03-18 Yuzo Maruyama , William E. Strawderman

We propose and study an asymptotically optimal Monte Carlo estimator for steady-state expectations of a d-dimensional reflected Brownian motion. Our estimator is asymptotically optimal in the sense that it requires $\tilde{O}(d)$ (up to…

Probability · Mathematics 2020-01-29 Jose Blanchet , Xinyun Chen , Peter Glynn , Nian Si

This paper addresses the estimation of locally stationary long-range dependent processes, a methodology that allows the statistical analysis of time series data exhibiting both nonstationarity and strong dependency. A time-varying…

Statistics Theory · Mathematics 2010-11-12 Wilfredo Palma , Ricardo Olea

In many problems, a sensible estimator of a possibly multivariate monotone function may itself fail to be monotone. We study the correction of such an estimator obtained via projection onto the space of functions monotone over a finite grid…

Statistics Theory · Mathematics 2019-09-06 Ted Westling , Mark van der Laan , Marco Carone

Multivariate extreme value theory is concerned with modeling the joint tail behavior of several random variables. Existing work mostly focuses on asymptotic dependence, where the probability of observing a large value in one of the…

Statistics Theory · Mathematics 2022-07-11 Michaël Lalancette , Sebastian Engelke , Stanislav Volgushev

In this paper we consider Tyler's robust covariance M-estimator under group symmetry constraints. We assume that the covariance matrix is invariant to the conjugation action of a unitary matrix group, referred to as group symmetry. Examples…

Applications · Statistics 2015-09-30 Ilya Soloveychik , Dmitry Trushin , Ami Wiesel

In this paper we prove the asymptotic efficiency of the model selection procedure proposed by the authors in the first part. To this end we introduce the robust risk as the least upper bound of the quadratical risk over a broad class of…

Statistics Theory · Mathematics 2009-09-18 Victor Konev , Serguei Pergamenchtchikov