English
Related papers

Related papers: Non-linear shrinkage estimation of large-scale str…

200 papers

This paper introduces a consistent estimator and rate of convergence for the precision matrix of asset returns in large portfolios using a non-linear factor model within the deep learning framework. Our estimator remains valid even in low…

Machine Learning · Statistics 2023-08-30 Mehmet Caner , Maurizio Daniele

The estimation of the mean matrix of the multivariate normal distribution is addressed in the high dimensional setting. Efron-Morris-type linear shrinkage estimators based on ridge estimators for the precision matrix instead of the…

Statistics Theory · Mathematics 2020-07-07 Ryota Yuasa , Tatsuya Kubokawa

Covariance matrices are important tools for obtaining reliable parameter constraints. Advancements in cosmological surveys lead to larger data vectors and, consequently, increasingly complex covariance matrices, whose number of elements…

Cosmology and Nongalactic Astrophysics · Physics 2022-05-31 Tassia Ferreira , Valerio Marra

The properties of the normal distribution under linear transformation, as well the easy way to compute the covariance matrix of marginals and conditionals, offer a unique opportunity to get an insight about several aspects of uncertainties…

Data Analysis, Statistics and Probability · Physics 2018-02-12 Giulio D'Agostini

This paper investigates the cross-correlations across multiple climate model errors. We build a Bayesian hierarchical model that accounts for the spatial dependence of individual models as well as cross-covariances across different climate…

Applications · Statistics 2012-03-02 Huiyan Sang , Mikyoung Jun , Jianhua Z. Huang

This paper considers covariance matrix estimation of tensor data under high dimensionality. A multi-bandable covariance class is established to accommodate the need for complex covariance structures of multi-layer lattices and general…

Methodology · Statistics 2026-01-13 Hao-Xuan Sun , Song Xi Chen , Yumou Qiu

Systematic uncertainties that have been subdominant in past large-scale structure (LSS) surveys are likely to exceed statistical uncertainties of current and future LSS data sets, potentially limiting the extraction of cosmological…

Cosmology and Nongalactic Astrophysics · Physics 2015-10-21 Tim Eifler , Elisabeth Krause , Scott Dodelson , Andrew Zentner , Andrew Hearin , Nickolay Gnedin

One of the main unsolved problems of cosmology is how to maximize the extraction of information from nonlinear data. If the data are nonlinear the usual approach is to employ a sequence of statistics (N-point statistics, counting statistics…

Cosmology and Nongalactic Astrophysics · Physics 2018-03-07 Uros Seljak , Grigor Aslanyan , Yu Feng , Chirag Modi

We consider the classical problem of estimating the covariance matrix of a subgaussian distribution from i.i.d. samples in the novel context of coarse quantization, i.e., instead of having full knowledge of the samples, they are quantized…

Information Theory · Computer Science 2022-04-25 Sjoerd Dirksen , Johannes Maly , Holger Rauhut

Uncertainty estimation in large deep-learning models is a computationally challenging task, where it is difficult to form even a Gaussian approximation to the posterior distribution. In such situations, existing methods usually resort to a…

Machine Learning · Computer Science 2019-01-15 Aaron Mishkin , Frederik Kunstner , Didrik Nielsen , Mark Schmidt , Mohammad Emtiyaz Khan

Increasingly large parameter spaces, used to more accurately model precision observables in physics, can paradoxically lead to large deviations in the inferred parameters of interest -- a bias known as volume projection effects -- when…

Cosmology and Nongalactic Astrophysics · Physics 2025-07-29 Alexander Reeves , Pierre Zhang , Henry Zheng

Cosmological $N$-body simulations provide numerical predictions of the structure of the Universe against which to compare data from ongoing and future surveys, but the growing volume of the Universe mapped by surveys requires…

In this paper we study covariance estimation with missing data. We consider missing data mechanisms that can be independent of the data, or have a time varying dependency. Additionally, observed variables may have arbitrary (non uniform)…

Statistics Theory · Mathematics 2021-06-17 Eduardo Pavez , Antonio Ortega

This paper deals with the problem of parameter estimation based on certain eigenspaces of the empirical covariance matrix of an observed multidimensional time series, in the case where the time series dimension and the observation window…

Probability · Mathematics 2012-08-22 Walid Hachem , Philippe Loubaton , X. Mestre , Jamal Najim , Pascal Vallet

One of the primary sources of uncertainties in modeling the cosmic-shear power spectrum on small scales is the effect of baryonic physics. Accurate cosmology for Stage-IV surveys requires knowledge of the matter power spectrum deep in the…

Cosmology and Nongalactic Astrophysics · Physics 2021-09-15 Maria G. Moreira , Felipe Andrade-Oliveira , Xiao Fang , Hung-Jin Huang , Elisabeth Krause , Vivian Miranda , Rogerio Rosenfeld , Marko Simonović

Parameter inference with an estimated covariance matrix systematically loses information due to the remaining uncertainty of the covariance matrix. Here, we quantify this loss of precision and develop a framework to hypothetically restore…

Cosmology and Nongalactic Astrophysics · Physics 2017-03-16 Elena Sellentin , Alan F. Heavens

We propose a novel iterative algorithm for estimating a deterministic but unknown parameter vector in the presence of model uncertainties. This iterative algorithm is based on a system model where an overall noise term describes both, the…

Statistics Theory · Mathematics 2017-11-27 Oliver Lang , Michael Lunglmayr , Mario Huemer

We consider the problem of estimating covariance and precision matrices, and their associated discriminant coefficients, from normal data when the rank of the covariance matrix is strictly smaller than its dimension and the available sample…

Statistics Theory · Mathematics 2015-09-09 Didier Chételat , Martin T. Wells

This paper addresses the task of estimating a covariance matrix under a patternless sparsity assumption. In contrast to existing approaches based on thresholding or shrinkage penalties, we propose a likelihood-based method that regularizes…

Methodology · Statistics 2021-09-13 Jason Xu , Kenneth Lange

We propose an estimator defined in real space for the reconstruction of the weak lensing potential due to the intervening large scale structure from high resolution maps of the cosmic microwave background. This estimator was motivated as an…

Cosmology and Nongalactic Astrophysics · Physics 2014-11-21 C. S. Carvalho , K. Moodley
‹ Prev 1 8 9 10 Next ›