English
Related papers

Related papers: Estimation in a simple linear regression model wit…

200 papers

Measurement uncertainty is a non trivial aspect of the laboratory component of most undergraduate physics courses. Confusion about the application of statistical tools calls for the elaboration of guidelines and the elimination of…

Physics Education · Physics 2012-11-20 W. Jacquet , E. Ir. Nyssen , J. Sijbers

We consider the related problems of estimating the $l_2$-norm and the squared $l_2$-norm in sparse linear regression with unknown variance, as well as the problem of testing the hypothesis that the regression parameter is null under sparse…

Statistics Theory · Mathematics 2020-10-27 Alexandra Carpentier , Olivier Collier , Laetitia Comminges , Alexandre B. Tsybakov , Yuhao Wang

The problem of reducing the bias of maximum likelihood estimator in a general multivariate elliptical regression model is considered. The model is very flexible and allows the mean vector and the dispersion matrix to have parameters in…

Statistics Theory · Mathematics 2016-02-01 Tatiane F. N. Melo , Silvia L. P. Ferrari , Alexandre G. Patriota

This paper provides some extended results on estimating parameter matrix of several regression models when the covariate or response possesses weaker moment condition. We study the $M$-estimator of Fan et al. (Ann Stat 49(3):1239--1266,…

Statistics Theory · Mathematics 2022-09-08 Kangqiang Li , Songqiao Tang , Lixin Zhang

When the regressors of a econometric linear model are nonorthogonal, it is well known that their estimation by ordinary least squares can present various problems that discourage the use of this model. The ridge regression is the most…

This study proposes a point estimator of the break location for a one-time structural break in linear regression models. If the break magnitude is small, the least-squares estimator of the break date has two modes at the ends of the finite…

Econometrics · Economics 2020-06-04 Yaein Baek

Functional data analysis tools, such as function-on-function regression models, have received considerable attention in various scientific fields because of their observed high-dimensional and complex data structures. Several statistical…

Methodology · Statistics 2020-09-22 Ufuk Beyaztas , Han Lin Shang

Parameter estimation in linear errors-in-variables models typically requires that the measurement error distribution be known (or estimable from replicate data). A generalized method of moments approach can be used to estimate model…

Methodology · Statistics 2018-12-04 Linh Nghiem , Michael Byrd , Cornelis Potgieter

Fitting a simplifying model with several parameters to real data of complex objects is a highly nontrivial task, but enables the possibility to get insights into the objects physics. Here, we present a method to infer the parameters of the…

Data Analysis, Statistics and Probability · Physics 2018-12-21 Johannes Oberpriller , T. A. Enßlin

Two new methods are proposed for linear regression analysis for data with measurement errors. Both methods are designed to accommodate intrinsic scatter in addition to measurement errors. The first (BCES) is a direct extension of the…

Astrophysics · Physics 2009-10-28 Michael G. Akritas , Matthew A. Bershady

Researchers may perform regressions using a sketch of data of size $m$ instead of the full sample of size $n$ for a variety of reasons. This paper considers the case when the regression errors do not have constant variance and…

Machine Learning · Statistics 2022-06-23 Sokbae Lee , Serena Ng

Subsampling algorithms for various parametric regression models with massive data have been extensively investigated in recent years. However, all existing studies on subsampling heavily rely on clean massive data. In practical…

Statistics Theory · Mathematics 2025-06-11 Jiangshan Ju , Mingqiu Wang , Shengli Zhao

A difficulty in MSE estimation occurs because we do not specify a full distribution for the survey weights. This obfuscates the use of fully parametric bootstrap procedures. To overcome this challenge, we develop a novel MSE estimator. We…

Methodology · Statistics 2022-10-25 Yanghyeon Cho , Emily Berg

This paper studies a tensor-structured linear regression model with a scalar response variable and tensor-structured predictors, such that the regression parameters form a tensor of order $d$ (i.e., a $d$-fold multiway array) in…

Machine Learning · Computer Science 2020-11-26 Talal Ahmed , Haroon Raja , Waheed U. Bajwa

This paper analyzes the estimation of econometric models by penalizing the sum of squares of the residuals with a factor that makes the model estimates approximate those that would be obtained when considering the possible simple…

Statistics Theory · Mathematics 2024-05-10 Román Salmerón Gómez , Catalina B. García García

We study the estimation error of constrained M-estimators, and derive explicit upper bounds on the expected estimation error determined by the Gaussian width of the constraint set. Both of the cases where the true parameter is on the…

Statistics Theory · Mathematics 2015-06-29 Yen-Huan Li , Ya-Ping Hsieh , Nissim Zerbib , Volkan Cevher

Tuning parameters in supervised learning problems are often estimated by cross-validation. The minimum value of the cross-validation error can be biased downward as an estimate of the test error at that same value of the tuning parameter.…

Applications · Statistics 2009-08-21 Ryan J. Tibshirani , Robert Tibshirani

Reduced-rank approach has been used for decades in robust linear estimation of both deterministic and random vector of parameters in linear model y=Hx+\sqrt{epsilon}n. In practical settings, estimation is frequently performed under…

Optimization and Control · Mathematics 2024-08-05 Tomasz Piotrowski , Isao Yamada

It is well-known that trimmed sample means are robust against heavy tails and data contamination. This paper analyzes the performance of trimmed means and related methods in two novel contexts. The first one consists of estimating…

Statistics Theory · Mathematics 2025-12-03 Roberto I. Oliveira , Lucas Resende

This paper analyzes the classical linear regression model with measurement errors in all the variables. First, we provide necessary and sufficient conditions for identification of the coefficients. We show that the coefficients are not…

Methodology · Statistics 2023-06-22 Dan Ben-Moshe