English
Related papers

Related papers: Dealing with idiosyncratic cross-correlation when …

200 papers

Despite the advances of deep learning in specific tasks using images, the principled assessment of image fidelity and similarity is still a critical ability to develop. As it has been shown that Mean Squared Error (MSE) is insufficient for…

Image and Video Processing · Electrical Eng. & Systems 2019-08-27 Benyamin Ghojogh , Fakhri Karray , Mark Crowley

Matrix factor models have been growing popular dimension reduction tools for large-dimensional matrix time series. However, the heteroscedasticity of the idiosyncratic components has barely received any attention. Starting from the pseudo…

Statistics Theory · Mathematics 2024-12-03 Yong He , Yujie Hou , Haixia Liu , Yalin Wang

Empirical Bayes estimators are based on minimizing the average risk with the hyper-parameters in the weighting function being estimated from observed data. The performance of an empirical Bayes estimator is typically evaluated by its mean…

Statistics Theory · Mathematics 2025-03-18 Yue Ju , Bo Wahlberg , Håkan Hjalmarsson

In the era of big data, reducing data dimensionality is critical in many areas of science. Widely used Principal Component Analysis (PCA) addresses this problem by computing a low dimensional data embedding that maximally explain variance…

Machine Learning · Statistics 2017-02-24 Soheil Feizi , David Tse

The moment conditions or estimating equations for instrumental variables quantile regression involve the discontinuous indicator function. We instead use smoothed estimating equations (SEE), with bandwidth $h$. We show that the mean squared…

Methodology · Statistics 2018-02-28 David M. Kaplan , Yixiao Sun

An alternative to extrinsic information transfer (EXIT) charts called mean squared error (MSE) charts that use a measure related to the MSE instead of mutual information is proposed. Using the relationship between mutual information and…

Information Theory · Computer Science 2007-07-13 Kapil Bhattad , Krishna Narayanan

In this paper, the estimation of parameters in the harmonic regression with cyclically dependent errors is addressed. Asymptotic properties of the least-squares estimates are analyzed by simulation experiments. By numerical simulation, we…

Principal component analysis (PCA) is arguably the most widely used approach for large-dimensional factor analysis. While it is effective when the factors are sufficiently strong, it can be inconsistent when the factors are weak and/or the…

Methodology · Statistics 2025-08-22 Zhongyuan Lyu , Ming Yuan

The statistical properties of estimator using covariance matrix for the account of point-to-point correlations due to systematic errors are analyzed. It is shown that the covariance matrix estimator (CME) is consistent for the realistic…

High Energy Physics - Experiment · Physics 2007-05-23 Alekhin Sergey

Minimizing the Mean Squared Error (MSE) is a key objective in machine learning and is commonly used for imputing missing values. While this approach provides accurate point estimates, it introduces systematic biases in downstream analyses.…

Machine Learning · Statistics 2026-05-06 Stef van Buuren

Traditional covariate selection methods for causal inference focus on achieving unbiasedness and asymptotic efficiency. In many practical scenarios, researchers must estimate causal effects from observational data with limited sample sizes…

Statistics Theory · Mathematics 2025-06-17 Nadja Rutsch , Sara Magliacane , Stéphanie van der Pas

Principal component analysis (PCA) is recognised as a quintessential data analysis technique when it comes to describing linear relationships between the features of a dataset. However, the well-known sensitivity of PCA to non-Gaussian…

Machine Learning · Statistics 2019-10-28 Jean P. Chereau , Bruno Scalzo Dees , Danilo P. Mandic

In this paper we derive the asymptotic properties of the least squares estimator (LSE) of fractionally integrated autoregressive moving-average (FARIMA) models under the assumption that the errors are uncorrelated but not necessarily…

Applications · Statistics 2021-03-19 Yacouba Boubacar Maïnassara , Youssef Esstafa , Bruno Saussereau

Principal components analysis (PCA) is a classical method for the reduction of dimensionality of data in the form of n observations (or cases) of a vector with p variables. For a simple model of factor analysis type, it is proved that…

Statistics Theory · Mathematics 2009-01-29 Iain M Johnstone , Arthur Yu Lu

The article is devoted to the nonparametric estimation of the quadratic covariation of non-synchronously observed It\^o processes in an additive microstructure noise model. In a high-frequency setting, we aim at establishing an asymptotic…

Statistics Theory · Mathematics 2011-06-22 Markus Bibinger

Sparse Principal Component Analysis (sparse PCA) is a fundamental dimension-reduction tool that enhances interpretability in various high-dimensional settings. An important variant of sparse PCA studies the scenario when samples are…

Optimization and Control · Mathematics 2024-11-11 Yuqing He , Guanyi Wang , Yu Yang

Auxiliary information is frequently utilized in survey sampling to improve the efficiency of estimators of the finite population mean. However, the simultaneous use of multiple auxiliary variables often induces multicollinearity, which…

Methodology · Statistics 2026-04-30 Rajesh Singh , Shobh Nath Tiwari

Sparse Principal Component Analysis (PCA) methods are efficient tools to reduce the dimension (or the number of variables) of complex data. Sparse principal components (PCs) are easier to interpret than conventional PCs, because most…

Statistics Theory · Mathematics 2011-04-22 Dan Shen , Haipeng Shen , J. S. Marron

In a recent review, Liu, Pek, & Maydeu-Olivares (2025b) classified reliability coefficients into two types: classical test theory (CTT) reliability and proportional reduction in mean squared error (PRMSE). This article focuses on…

Methodology · Statistics 2026-04-14 Youjin Sung , Yang Liu

Multi-component chirp signal models with equal chirp rates appear in various radar applications, e.g., synthetic aperture radar, echo signal of a rapid mobile target, etc. Many sub-optimal estimators have been developed for such models,…

Methodology · Statistics 2023-02-15 Abhinek Shukla , Debasis Kundu , Amit Mitra , Rhythm Grover