English
Related papers

Related papers: On the shrinkage behavior of partial least squares…

200 papers

The least squares method provides the best-fit curve by minimizing the total squares error. In this work, we provide the modified least squares method based on the fractional orthogonal polynomials that belong to the space $M_{n}^{\lambda}…

Numerical Analysis · Mathematics 2024-05-02 Abhishek Kumar Singh , Mani Mehra , Anatoly A. Alikhanov

In this article, we study large-dimensional matrix factor models and estimate the factor loading matrices and factor score matrix by minimizing square loss function. Interestingly, the resultant estimators coincide with the Projected…

Methodology · Statistics 2022-11-22 Yong He , Xinbing Kong , Long Yu , Xinsheng Zhang , Changwei Zhao

Partial coherence is an important quantity derived from spectral or precision matrices and is used in seismology, meteorology, oceanography, neuroscience and elsewhere. If the number of complex degrees of freedom only slightly exceeds the…

Statistics Theory · Mathematics 2016-11-03 D. Schneider-Luftman , A. T. Walden

Additive regression models are actively researched in the statistical field because of their usefulness in the analysis of responses determined by non-linear relationships with multivariate predictors. In this kind of statistical models,…

Methodology · Statistics 2018-04-10 German A. Schnaidt Grez , Brani Vidakovic

The function-on-function linear regression model in which the response and predictors consist of random curves has become a general framework to investigate the relationship between the functional response and functional predictors.…

Methodology · Statistics 2021-11-03 Ufuk Beyaztas , Han Lin Shang

We study the asymptotic behavior of piecewise constant least squares regression estimates, when the number of partitions of the estimate is penalized. We show that the estimator is consistent in the relevant metric if the signal is in…

Statistics Theory · Mathematics 2009-09-29 Leif Boysen , Volkmar Liebscher , Axel Munk , Olaf Wittich

In this paper, we consider a statistical problem of learning a linear model from noisy samples. Existing work has focused on approximating the least squares solution by using leverage-based scores as an importance sampling distribution.…

Machine Learning · Statistics 2016-02-11 Siheng Chen , Rohan Varma , Aarti Singh , Jelena Kovačević

When the experimental data set is contaminated, we usually employ robust alternatives to common location and scale estimators such as the sample median and Hodges-Lehmann estimators for location and the sample median absolute deviation and…

Methodology · Statistics 2020-08-11 Chanseok Park , Haewon Kim , Min Wang

In Small Area Estimation data linkage can be used to combine values of the variableof interest from a national survey with values of auxiliary variables obtained from another source like a population register. Linkage errors can induce bias…

Methodology · Statistics 2019-04-02 Ray Chambers , Enrico Fabrizi , Nicola Salvati

In this paper we propose a semi-parametric Bayesian Generalized Least Squares estimator. In a generic setting where each error is a vector, the parametric Generalized Least Square estimator maintains the assumption that each error vector…

Econometrics · Economics 2023-02-01 Ruochen Wu , Melvyn Weeks

We address the inference problem concerning regression coefficients in a classical linear regression model using least squares estimates. The analysis is conducted under circumstances where network dependency exists across units in the…

Methodology · Statistics 2024-04-03 Jing Lei , Kehui Chen , Haeun Moon

It is well known that individual parameters of strongly correlated predictor variables in a linear model cannot be accurately estimated by the least squares regression due to multicollinearity generated by such variables. Surprisingly, an…

Statistics Theory · Mathematics 2022-10-04 Min Tsao

There has been substantial recent work on methods for estimating the slope function in linear regression for functional data analysis. However, as in the case of more conventional finite-dimensional regression, much of the practical…

Statistics Theory · Mathematics 2007-06-13 T. Tony Cai , Peter Hall

The multivariate errors-in-variables regression model is applicable when both dependent and independent variables in a multivariate regression are subject to measurement errors. In such a scenario it is long established that the traditional…

Statistics Theory · Mathematics 2015-10-14 Johannes Lutzeyer , Edward A. K. Cohen

In recent years, there has been a significant growth in research focusing on minimum $\ell_2$ norm (ridgeless) interpolation least squares estimators. However, the majority of these analyses have been limited to an unrealistic regression…

Statistics Theory · Mathematics 2024-06-14 Sungyoon Lee , Sokbae Lee

Motivated by the increasing use of and rapid changes in array technologies, we consider the prediction problem of fitting a linear regression relating a continuous outcome $Y$ to a large number of covariates $\mathbf {X}$, for example,…

Applications · Statistics 2014-01-13 Philip S. Boonstra , Bhramar Mukherjee , Jeremy M. G. Taylor

Stacking regressions is an ensemble technique that forms linear combinations of different regression estimators to enhance predictive accuracy. The conventional approach uses cross-validation data to generate predictions from the…

Machine Learning · Statistics 2024-10-10 Xin Chen , Jason M. Klusowski , Yan Shuo Tan

In this article we derive an unbiased expression for the expected mean-squared error associated with continuously differentiable estimators of the noncentrality parameter of a chi-square random variable. We then consider the task of…

Applications · Statistics 2012-10-15 Florian Luisier , Thierry Blu , Patrick J. Wolfe

Squared error loss remains the most commonly used loss function for constructing a Bayes estimator of the parameter of interest. However, it can lead to sub-optimal solutions when a parameter is defined in a restricted space. It can also be…

Statistics Theory · Mathematics 2019-02-25 Pavel Mozgunov , Thomas Jaki , Mauro Gasparini

A new class of minimax Stein-type shrinkage estimators of a multivariate normal mean is studied where the shrinkage factor is based on an l_p norm. The proposed estimators allow some but not all coordinates to be estimated by 0 thereby…

Statistics Theory · Mathematics 2015-05-29 Yuzo Maruyama
‹ Prev 1 4 5 6 7 8 10 Next ›