English
Related papers

Related papers: Asymptotic distribution of least square estimators…

200 papers

De Haan and Pereira (2006) provided models for spatial extremes in the case of stationarity, which depend on just one parameter {\beta} > 0 measuring tail dependence, and they proposed different estimators for this parameter. This framework…

Statistics Theory · Mathematics 2012-02-24 Stefan Aulbach , Michael Falk

The main Theorem of Jain et al.[Jain, K., Singh, S., and Sharma, S. (2011), Re- stricted estimation in multivariate measurement error regression model; JMVA, 102, 2, 264-280] is established in its full generality. Namely, we derive the…

Statistics Theory · Mathematics 2017-06-22 Sévérien Nkurunziza , Youzhi Yu

In this work, we focus on the high-dimensional trace regression model with a low-rank coefficient matrix. We establish a nearly optimal in-sample prediction risk bound for the rank-constrained least-squares estimator under no assumptions on…

Statistics Theory · Mathematics 2022-04-19 Michael Law , Ya'acov Ritov , Ruixiang Zhang , Ziwei Zhu

Statisticians generally use ordinary least squares to minimize the random error in a subject response with respect to independent explanatory variable. However, Wooten shows illustrates how ordinary least squares can be used to minimize the…

Methodology · Statistics 2016-03-28 Rebecca D. Wooten

Preliminary test estimation, which is a natural procedure when it is suspected a priori that the parameter to be estimated might take value in a submodel of the model at hand, is a classical topic in estimation theory. In the present paper,…

Statistics Theory · Mathematics 2019-06-27 Davy Paindaveine , Joséa Rasoafaraniaina , Thomas Verdebout

We propose improved standard errors and an asymptotic distribution theory for two-way clustered panels. Our proposed estimator and theory allow for arbitrary serial dependence in the common time effects, which is excluded by existing…

Econometrics · Economics 2023-12-15 Harold D Chiang , Bruce E Hansen , Yuya Sasaki

Linear regressions with endogeneity are widely used to estimate causal effects. This paper studies a framework that involves two common practical issues: endogeneity of the regressors and heteroskedasticity that depends on endogenous…

Econometrics · Economics 2025-12-10 Javier Alejo , Antonio F. Galvao , Julian Martinez-Iriarte , Gabriel Montes-Rojas

In this paper, we introduce a joint central limit theorem (CLT) for specific bilinear forms, encompassing the resolvent of the sample covariance matrix under an elliptical distribution. Through an exhaustive exploration of our theoretical…

Statistics Theory · Mathematics 2023-12-29 Yanqing Yin , Wang Zhou

This paper analyzes the performance of Tyler's M-estimator of the scatter matrix in elliptical populations. We focus on the non-asymptotic setting and derive the estimation error bounds depending on the number of samples n and the dimension…

Statistics Theory · Mathematics 2015-06-18 Ilya Soloveychik , Ami Wiesel

After performing a randomized experiment, researchers often use ordinary-least squares (OLS) regression to adjust for baseline covariates when estimating the average treatment effect. It is widely known that the resulting confidence…

Statistics Theory · Mathematics 2020-04-27 Kevin Guo , Guillaume Basse

Ever since the proof of asymptotic normality of maximum likelihood estimator by Cramer (1946), it has been understood that a basic technique of the Taylor series expansion suffices for asymptotics of $M$-estimators with…

Statistics Theory · Mathematics 2018-09-17 Arun Kumar Kuchibhotla

We obtain robust and computationally efficient estimators for learning several linear models that achieve statistically optimal convergence rate under minimal distributional assumptions. Concretely, we assume our data is drawn from a…

Machine Learning · Statistics 2020-12-07 Ainesh Bakshi , Adarsh Prasad

Data-driven methods for modeling dynamic systems have received considerable attention as they provide a mechanism for control synthesis directly from the observed time-series data. In the absence of prior assumptions on how the time-series…

Optimization and Control · Mathematics 2018-09-24 Atiye Alaeddini , Siavash Alemzadeh , Afshin Mesbahi , Mehran Mesbahi

This paper discusses minimum distance estimation method in the linear regression model with dependent errors which are strongly mixing. The regression parameters are estimated through the minimum distance estimation method, and asymptotic…

Statistics Theory · Mathematics 2017-01-06 Jiwoong Kim

We consider the problem of fitting the parameters of a high-dimensional linear regression model. In the regime where the number of parameters $p$ is comparable to or exceeds the sample size $n$, a successful approach uses an…

Statistics Theory · Mathematics 2013-11-04 Adel Javanmard , Andrea Montanari

We address high dimensional covariance estimation for elliptical distributed samples, which are also known as spherically invariant random vectors (SIRV) or compound-Gaussian processes. Specifically we consider shrinkage methods that are…

Methodology · Statistics 2015-05-20 Yilun Chen , Ami Wiesel , Alfred O. Hero

In this paper we derive the asymptotic properties of the least squares estimator (LSE) of fractionally integrated autoregressive moving-average (FARIMA) models under the assumption that the errors are uncorrelated but not necessarily…

Applications · Statistics 2021-03-19 Yacouba Boubacar Maïnassara , Youssef Esstafa , Bruno Saussereau

In the classic measurement error framework, covariates are contaminated by independent additive noise. This paper considers parameter estimation in such a linear errors-in-variables model where the unknown measurement error distribution is…

Methodology · Statistics 2023-10-24 Linh H. Nghiem , Cornelis J. Potgieter

Least squares linear regression is one of the oldest and widely used data analysis tools. Although the theoretical analysis of the ordinary least squares (OLS) estimator is as old, several fundamental questions are yet to be answered.…

Statistics Theory · Mathematics 2019-10-16 Arun K. Kuchibhotla , Lawrence D. Brown , Andreas Buja , Junhui Cai

The statistical analysis of Randomized Numerical Linear Algebra (RandNLA) algorithms within the past few years has mostly focused on their performance as point estimators. However, this is insufficient for conducting statistical inference,…

Statistics Theory · Mathematics 2020-02-26 Ping Ma , Xinlian Zhang , Xin Xing , Jingyi Ma , Michael W. Mahoney