English
Related papers

Related papers: Asymptotic behavior of CLS estimator of autoregres…

200 papers

We study the problem of parameter estimation for reflected stochastic processes driven by a standard Brownian motion. The estimator is obtained using nonlinear least squares method based on discretely observed processes. Under some certain…

Statistics Theory · Mathematics 2022-05-03 Han Yuecai , Zhang Dingwen

We consider the problem of estimating the parameters of a linear univariate autoregressive model with sub-Gaussian innovations from a limited sequence of consecutive observations. Assuming that the parameters are compressible, we analyze…

Information Theory · Computer Science 2017-04-05 Abbas Kazemipour , Sina Miran , Piya Pal , Behtash Babadi , Min Wu

The paper deals with the nonparametric estimation problem at a given fixed point for an autoregressive model with unknown distributed noise. Kernel estimate modifications are proposed. Asymptotic minimax and efficiency properties for…

Statistics Theory · Mathematics 2008-06-19 Ouerdia Arkoun , Serguei Pergamenchtchikov

For estimating the unknown parameters in an unstable autoregressive AR(p), the paper proposes sequential least squares estimates with a special stopping time defined by the trace of the observed Fisher information matrix. The limiting…

Statistics Theory · Mathematics 2008-10-07 Leonid Galtchouk , Victor Konev

We study the asymptotic properties of the adaptive Lasso in cointegration regressions in the case where all covariates are weakly exogenous. We assume the number of candidate I(1) variables is sub-linear with respect to the sample size (but…

Methodology · Statistics 2011-10-11 Eduardo F. Mendes

We investigate the asymptotic behavior of the least squares estimator of the unknown parameters of random coefficient bifurcating autoregressive processes. Under suitable assumptions on inherited and environmental effects, we establish the…

Probability · Mathematics 2012-10-23 Bernard Bercu , Vassili Blandin

For an affine two factor model, we study the asymptotic properties of the maximum likelihood and least squares estimators of some appearing parameters in the so-called subcritical (ergodic) case based on continuous time observations. We…

Statistics Theory · Mathematics 2014-06-17 Matyas Barczy , Leif Doering , Zenghu Li , Gyula Pap

The paper deals with asymptotic properties of the adaptive procedure proposed in the author paper (2007) for estimation of unknown nonparametric regression. We prove that this procedure is asymptotically efficient for a quadratic risk. It…

Statistics Theory · Mathematics 2008-12-18 Leonid Galtchouk , Serguey Pergamenshchikov

In this paper, we present the asymptotic properties of the moment estimator for autoregressive (AR for short) models subject to Markovian changes in regime under the assumption that the errors are uncorrelated but not necessarily…

Statistics Theory · Mathematics 2025-03-06 Yacouba Boubacar Mainassara , Landy Rabehasaina , Armel Bra

We study asymptotic properties of conditional least squares estimators for the drift parameters of two-factor affine diffusions based on continuous time observations. We distinguish three cases: subcritical, critical and supercritical. For…

Probability · Mathematics 2017-07-27 Beáta Bolyog , Gyula Pap

Within the context of recursive least squares (RLS) parameter estimation, the goal of the present paper is to study the effect of regularization-induced bias on the transient and asymptotic accuracy of the parameter estimates. We consider…

Systems and Control · Electrical Eng. & Systems 2021-09-01 Brian Lai , Syed Aseem Ul Islam , Dennis S. Bernstein

We investigate the theoretical performances of the Partial Least Square (PLS) algorithm in a high dimensional context. We provide upper bounds on the risk in prediction for the statistical linear model when considering the PLS estimator.…

Statistics Theory · Mathematics 2024-10-15 Luca Castelli , Irène Gannaz , Clément Marteau

This paper establishes non-asymptotic oracle inequalities for the prediction error and estimation accuracy of the LASSO in stationary vector autoregressive models. These inequalities are used to establish consistency of the LASSO even when…

Statistics Theory · Mathematics 2014-05-16 Anders Bredahl Kock , Laurent A. F. Callot

We study the asymptotic properties of the GLS estimator in multivariate regression with heteroskedastic and autocorrelated errors. We derive Wald statistics for linear restrictions and assess their performance. The statistics remains robust…

Econometrics · Economics 2025-03-19 Koichiro Moriya , Akihiko Noda

In this paper we derive the asymptotic properties of the least squares estimator (LSE) of fractionally integrated autoregressive moving-average (FARIMA) models under the assumption that the errors are uncorrelated but not necessarily…

Applications · Statistics 2021-03-19 Yacouba Boubacar Maïnassara , Youssef Esstafa , Bruno Saussereau

We consider maximum likelihood estimation for both causal and noncausal autoregressive time series processes with non-Gaussian $\alpha$-stable noise. A nondegenerate limiting distribution is given for maximum likelihood estimators of the…

Statistics Theory · Mathematics 2009-08-14 Beth Andrews , Matthew Calder , Richard A. Davis

This note develops a simple two-stage least squares (2SLS) procedure to estimate the causal effect of some endogenous regressors on a randomly right censored outcome in the linear model. The proposal replaces the usual ordinary least…

Statistics Theory · Mathematics 2021-10-12 Jad Beyhum

In this note a new high performance least squares parameter estimator is proposed. The main features of the estimator are: (i) global exponential convergence is guaranteed for all identifiable linear regression equations; (ii) it…

Dynamical Systems · Mathematics 2022-05-03 Romeo Ortega , Jose Guadalupe Romero , Stanislav Aranovskiy

In this paper, we study finite-sample properties of the least squares estimator in first order autoregressive processes. By leveraging a result from decoupling theory, we derive upper bounds on the probability that the estimate deviates by…

Statistics Theory · Mathematics 2020-05-26 Rodrigo A. González , Cristian R. Rojas

We study asymptotic behavior of one-step weighted $M$-estimators based on samples from arrays of not necessarily identically distributed random variables and representing explicit approximations to the corresponding consistent weighted…

Statistics Theory · Mathematics 2015-07-07 Yu. Yu. Linke