English
Related papers

Related papers: Dealing with idiosyncratic cross-correlation when …

200 papers

This work studies estimation of sparse principal components in high dimensions. Specifically, we consider a class of estimators based on kernel PCA, generalizing the covariance thresholding algorithm proposed by Krauthgamer et al. (2015).…

Statistics Theory · Mathematics 2025-04-10 Michael J. Feldman , Theodor Misiakiewicz , Elad Romanov

This paper presents a new approach to solve linear and nonlinear model predictive control (MPC) problems that requires small memory footprint and throughput and is particularly suitable when the model and/or controller parameters change at…

Optimization and Control · Mathematics 2021-03-25 Nilay Saraf , Alberto Bemporad

The classic integrated conditional moment test is a promising method for testing regression model misspecification. However, it severely suffers from the curse of dimensionality. To extend it to handle the testing problem for parametric…

Statistics Theory · Mathematics 2020-05-26 Falong Tan , Lixing Zhu

Consistency checks of cosmological data sets are an important tool because they may suggest systematic errors or the type of modifications to $\Lambda$CDM necessary to resolve current tensions. In this work, we derive an analytic method for…

Cosmology and Nongalactic Astrophysics · Physics 2021-01-22 Joshua A. Kable , Graeme E. Addison , Charles L. Bennett

Surrogate-modelling techniques including Polynomial Chaos Expansion (PCE) is commonly used for statistical estimation (aka. Uncertainty Quantification) of quantities of interests obtained from expensive computational models. PCE is a…

Computational Engineering, Finance, and Science · Computer Science 2019-09-05 Alexander Tarakanov , Ahmed H. Elsheikh

Sparse Principal Components Analysis (PCA) has been proposed as a way to improve both interpretability and reliability of PCA. However, use of sparse PCA in practice is hindered by the difficulty of tuning the multiple hyperparameters that…

Methodology · Statistics 2026-02-24 Joonsuk Kang , Matthew Stephens

The Nummellin's split chain construction allows to decompose a Markov chain Monte Carlo (MCMC) trajectory into i.i.d. "excursions". RegenerativeMCMC algorithms based on this technique use a random number of samples. They have been proposed…

Computation · Statistics 2015-03-18 Krzysztof Latuszynski , Blazej Miasojedow , Wojciech Niemiro

This paper considers fixed effects (FE) estimation for linear panel data models under possible model misspecification when both the number of individuals, $n$, and the number of time periods, $T$, are large. We first clarify the probability…

Statistics Theory · Mathematics 2014-03-12 Antonio F. Galvao , Kengo Kato

In this article, we propose a new method for calculating the mixed correlation coefficient (Pearson, polyserial and polychoric) matrix and its covariance matrix based on the GMM framework. We build moment equations for each coefficient and…

Computation · Statistics 2024-04-11 Ben Liu , Peng Zhang , Yi Feng , Xiaowei Lou

Compressed sensing is a signal processing technique in which data is acquired directly in a compressed form. There are two modeling approaches that can be considered: the worst-case (Hamming) approach and a statistical mechanism, in which…

Information Theory · Computer Science 2016-01-20 Wasim Huleihel , Neri Merhav

We consider a certain class of large random matrices, composed of independent column vectors with zero mean and different covariance matrices, and derive asymptotically tight deterministic approximations of their moments. This random matrix…

Information Theory · Computer Science 2016-11-15 Jakob Hoydis , Merouane Debbah , Mari Kobayashi

In the course of the last century, Principal Component Analysis (PCA) have become one of the pillars of modern scientific methods. Although PCA is normally addressed as a statistical tool aiming at finding orthogonal directions on which the…

Statistics Theory · Mathematics 2019-07-30 Yariv Aizenbud , Barak Sober

Coprime arrays enable Direction-of-Arrival (DoA) estimation of an increased number of sources. To that end, the receiver estimates the autocorrelation matrix of a larger virtual uniform linear array (coarray), by applying selection or…

Signal Processing · Electrical Eng. & Systems 2020-10-22 Dimitris G. Chachlakis , Tongdi Zhou , Fauzia Ahmad , Panos P. Markopoulos

Principal component regression (PCR) is a simple, but powerful and ubiquitously utilized method. Its effectiveness is well established when the covariates exhibit low-rank structure. However, its ability to handle settings with noisy,…

Machine Learning · Computer Science 2021-05-20 Anish Agarwal , Devavrat Shah , Dennis Shen , Dogyoon Song

In this paper, we propose a covariate-adjusted nonlinear regression model. In this model, both the response and predictors can only be observed after being distorted by some multiplicative factors. Because of nonlinearity, existing methods…

Statistics Theory · Mathematics 2009-08-14 Xia Cui , Wensheng Guo , Lu Lin , Lixing Zhu

The eigenvalue decomposition (EVD) parameters of the second order statistics are ubiquitous in statistical analysis and signal processing. Notably, the EVD of robust scatter $M$-estimators is a popular choice to perform robust probabilistic…

Applications · Statistics 2019-10-02 Gordana Draskovic , Arnaud Breloy , Frederic Pascal

Principal Component Analysis (PCA) is an important tool of dimension reduction especially when the dimension (or the number of variables) is very high. Asymptotic studies where the sample size is fixed, and the dimension grows [i.e., High…

Statistics Theory · Mathematics 2009-11-20 Sungkyu Jung , J. S. Marron

We address the inference problem concerning regression coefficients in a classical linear regression model using least squares estimates. The analysis is conducted under circumstances where network dependency exists across units in the…

Methodology · Statistics 2024-04-03 Jing Lei , Kehui Chen , Haeun Moon

In this article we have suggested an improved estimator for estimating the population mean in simple random sampling using auxiliary information under the presence of measurement errors. The mean square error (MSE) of the proposed estimator…

Applications · Statistics 2013-12-05 Sachin Malik , Jayant Singh , Rajesh Singh

We introduce a new small area predictor when the Fay-Herriot normal error model is fitted to a logarithmically transformed response variable, and the covariate is measured with error. This framework has been previously studied by Mosaferi…

Methodology · Statistics 2023-08-23 Sepideh Mosaferi , Malay Ghosh , Shonosuke Sugasawa