English
Related papers

Related papers: Fitting covariance matrix models to simulations

200 papers

Model checking plays an important role in linear regression as model misspecification seriously affects the validity and efficiency of regression analysis. In practice, model checking is often performed by subjectively evaluating the plot…

Statistics Theory · Mathematics 2019-11-19 Rok Blagus , Jakob Peterlin , Janez Stare

Precision matrix, which is the inverse of covariance matrix, plays an important role in statistics, as it captures the partial correlation between variables. Testing the equality of two precision matrices in high dimensional setting is a…

Methodology · Statistics 2018-10-23 Mingjuan Zhang , Yong He , Cheng Zhou , Xinsheng Zhang

Multivariate spatial field data are increasingly common and whose modeling typically relies on building cross-covariance functions to describe cross-process relationships. An alternative viewpoint is to model the matrix of spectral…

Statistics Theory · Mathematics 2015-05-07 William Kleiber

Statistical modeling of spatiotemporal phenomena often requires selecting a covariance matrix from a covariance class. Yet standard parametric covariance families can be insufficiently flexible for practical applications, while…

Computation · Statistics 2020-12-24 Antoni Musolas , Steven T. Smith , Youssef Marzouk

How can we discern whether the covariance operator of a stochastic process is of reduced rank, and if so, what its precise rank is? And how can we do so at a given level of confidence? This question is central to a great deal of methods for…

Methodology · Statistics 2020-08-11 Anirvan Chakraborty , Victor M. Panaretos

Missing data occur frequently in a wide range of applications. In this paper, we consider estimation of high-dimensional covariance matrices in the presence of missing observations under a general missing completely at random model in the…

Methodology · Statistics 2016-05-17 T. Tony Cai , Anru Zhang

During the last few decades, online controlled experiments (also known as A/B tests) have been adopted as a golden standard for measuring business improvements in industry. In our company, there are more than a billion users participating…

Applications · Statistics 2021-08-06 Tao Xiong , Yihan Bao , Penglei Zhao , Yong Wang

We use available measurements to estimate the unknown parameters (variance, smoothness parameter, and covariance length) of a covariance function by maximizing the joint Gaussian log-likelihood function. To overcome cubic complexity in the…

Computation · Statistics 2018-09-13 Alexander Litvinenko , Ying Sun , Marc G. Genton , David Keyes

Statistical modeling plays a fundamental role in understanding the underlying mechanism of massive data (statistical inference) and predicting the future (statistical prediction). Although all models are wrong, researchers try their best to…

Methodology · Statistics 2020-06-17 Hangjin Jiang

Cosmological weak lensing by the large scale structure of the Universe, cosmic shear, is coming of age as a powerful probe of the parameters describing the cosmological model and matter power spectrum. It complements CMB studies, by…

Astrophysics · Physics 2009-11-10 Patrick Simon , Lindsay J. King , Peter Schneider

Accurately modeling the correlation structure of errors is critical for reliable uncertainty quantification in probabilistic time series forecasting. While recent deep learning models for multivariate time series have developed efficient…

Machine Learning · Statistics 2024-11-11 Vincent Zhihao Zheng , Lijun Sun

In dealing with high-dimensional data sets, factor models are often useful for dimension reduction. The estimation of factor models has been actively studied in various fields. In the first part of this paper, we present a new approach to…

Statistical Finance · Quantitative Finance 2017-11-27 Joongyeub Yeo , George Papanicolaou

Risk assessment of hurricane-driven storm surge relies on deterministic computer models that produce outputs over a large spatial domain. The surge models can often be run at a range of fidelity levels, with greater precision yielding more…

Methodology · Statistics 2026-03-31 Cyrus S. McCrimmon , Pulong Ma

We present simulations of a cosmic shear survey and show how the survey geometry influences the accuracy of determination of cosmological parameters. We numerically calculate the full covariance matrices Cov of two-point statistics of…

Astrophysics · Physics 2009-11-10 Martin Kilbinger , Peter Schneider

We propose a two-sample test for covariance matrices in the high-dimensional regime, where the dimension diverges proportionally to the sample size. Our hybrid test combines a Frobenius-norm-based statistic as considered in Li and Chen…

Statistics Theory · Mathematics 2025-06-10 Thomas Lam , Nina Dörnemann , Holger Dette

Higher-order clustering statistics, like the galaxy bispectrum, can add complementary cosmological information to what is accessible with two-point statistics, like the power spectrum. While the standard way of measuring the bispectrum…

Cosmology and Nongalactic Astrophysics · Physics 2021-04-14 Joyce Byun , Andrea Oddo , Cristiano Porciani , Emiliano Sefusatti

We seek to improve estimates of the power spectrum covariance matrix from a limited number of simulations by employing a novel statistical technique known as shrinkage estimation. The shrinkage technique optimally combines an empirical…

Astrophysics · Physics 2009-11-13 Adrian C. Pope , István Szapudi

The prevalence of spatially referenced multivariate data has impelled researchers to develop a procedure for the joint modeling of multiple spatial processes. This ordinarily involves modeling marginal and cross-process dependence for any…

Methodology · Statistics 2020-07-10 Ghulam A. Qadir , Ying Sun

We study the problem of testing the covariance matrix of a high-dimensional Gaussian in a robust setting, where the input distribution has been corrupted in Huber's contamination model. Specifically, we are given i.i.d. samples from a…

Machine Learning · Computer Science 2021-01-01 Ilias Diakonikolas , Daniel M. Kane

Comparing large covariance matrices has important applications in modern genomics, where scientists are often interested in understanding whether relationships (e.g., dependencies or co-regulations) among a large number of genes vary…

Methodology · Statistics 2017-04-04 Jinyuan Chang , Wen Zhou , Wen-Xin Zhou , Lan Wang