English
Related papers

Related papers: On LSE in regression model for long-range dependen…

200 papers

We propose a procedure to handle the problem of Gaussian regression when the variance is unknown. We mix least-squares estimators from various models according to a procedure inspired by that of Leung and Barron (2007). We show that in some…

Statistics Theory · Mathematics 2007-11-05 Christophe Giraud

We consider a multivariate functional measurement error model $AX\approx B$. The errors in $[A,B]$ are uncorrelated, row-wise independent, and have equal (unknown) variances. We study the total least squares estimator of $X$, which, in the…

Probability · Mathematics 2016-07-14 Alexander Kukush , Yaroslav Tsaregorodtsev

In this paper we will consider the estimation of a monotone regression (or density) function in a fixed point by the least squares (Grenander) estimator. We will show that this estimator is fully adaptive, in the sense that the attained…

Statistics Theory · Mathematics 2009-09-11 Eric Cator

We study the problem of parameter estimation for discretely observed stochastic processes driven by additive small L\'{e}vy noises. We do not impose any moment condition on the driving L\'{e}vy process. Under certain regularity conditions…

Statistics Theory · Mathematics 2012-05-23 Hongwei Long , Yasutaka Shimizu , Wei Sun

Variance estimation in the linear model when $p > n$ is a difficult problem. Standard least squares estimation techniques do not apply. Several variance estimators have been proposed in the literature, all with accompanying asymptotic…

Methodology · Statistics 2014-01-30 Stephen Reid , Robert Tibshirani , Jerome Friedman

Convergence properties of empirical risk minimizers can be conveniently expressed in terms of the associated population risk. To derive bounds for the performance of the estimator under covariate shift, however, pointwise convergence rates…

Statistics Theory · Mathematics 2024-01-01 Johannes Schmidt-Hieber , Petr Zamolodtchikov

Additive regression models are actively researched in the statistical field because of their usefulness in the analysis of responses determined by non-linear relationships with multivariate predictors. In this kind of statistical models,…

Methodology · Statistics 2018-04-10 German A. Schnaidt Grez , Brani Vidakovic

We consider a resampling scheme for parameters estimates in nonlinear regression models. We provide an estimation procedure which recycles, via random weighting, the relevant parameters estimates to construct consistent estimates of the…

Methodology · Statistics 2018-12-18 Ben Boukai , Yue Zhang

This article proposes a novel estimator for regression coefficients in clustered data that explicitly accounts for within-cluster dependence. We study the asymptotic properties of the proposed estimator under both finite and infinite…

Methodology · Statistics 2026-02-05 Subhodeep Dey , Gopal K. Basak , Samarjit Das

We investigate the theoretical performances of the Partial Least Square (PLS) algorithm in a high dimensional context. We provide upper bounds on the risk in prediction for the statistical linear model when considering the PLS estimator.…

Statistics Theory · Mathematics 2024-10-15 Luca Castelli , Irène Gannaz , Clément Marteau

The limit distribution of the nonparametric maximum likelihood estimator for interval censored data with more than one observation time per unobservable observation, is still unknown in general. For the so-called separated case, where one…

Statistics Theory · Mathematics 2026-02-12 Piet Groeneboom

In this paper, we give a tutorial on asymptotic properties of the Least Square (LS) and Regularized Least Squares (RLS) estimators for the finite impulse response model with filtered white noise inputs. We provide three perspectives: the…

Statistics Theory · Mathematics 2022-01-03 Yue Ju , Tianshi Chen , Biqiang Mu , Lennart Ljung

This paper develops a general asymptotic theory of series estimators for spatial data collected at irregularly spaced locations within a sampling region $R_n \subset \mathbb{R}^d$. We employ a stochastic sampling design that can flexibly…

Statistics Theory · Mathematics 2025-03-03 Daisuke Kurisu , Yasumasa Matsuda

We study asymptotic properties of some (essentially conditional least squares) parameter estimators for the subcritical Heston model based on discrete time observations derived from conditional least squares estimators of some modified…

Statistics Theory · Mathematics 2016-07-25 Matyas Barczy , Gyula Pap , Tamas T. Szabo

We study the performance of the Least Squares Estimator (LSE) in a general nonparametric regression model, when the errors are independent of the covariates but may only have a $p$-th moment ($p\geq 1$). In such a heavy-tailed regression…

Statistics Theory · Mathematics 2018-07-17 Qiyang Han , Jon A. Wellner

We propose to address the common problem of linear estimation in linear statistical models by using a model selection approach via penalization. Depending then on the framework in which the linear statistical model is considered namely the…

Statistics Theory · Mathematics 2009-09-11 Ikhlef Bechar

We discuss techniques of estimation and inference for nonstationary nonlinear cohort panels with learning from experience, showing, inter alia, the consistency and asymptotic normality of the nonlinear least squares estimator used in…

Econometrics · Economics 2025-01-07 Alexander Mayer , Michael Massmann

We study the problem of parameter estimation for reflected stochastic processes driven by a standard Brownian motion. The estimator is obtained using nonlinear least squares method based on discretely observed processes. Under some certain…

Statistics Theory · Mathematics 2022-05-03 Han Yuecai , Zhang Dingwen

This note develops a simple two-stage least squares (2SLS) procedure to estimate the causal effect of some endogenous regressors on a randomly right censored outcome in the linear model. The proposal replaces the usual ordinary least…

Statistics Theory · Mathematics 2021-10-12 Jad Beyhum

The linear regression models are widely used statistical techniques in numerous practical applications. The standard regression model requires several assumptions about the regres- sors and the error term. The regression parameters are…

Methodology · Statistics 2016-10-23 P. Vellaisamy