English
Related papers

Related papers: Large Covariance Matrices: Accurate Models Without…

200 papers

Gradient-based solvers risk convergence to local optima, leading to incorrect researcher inference. Heuristic-based algorithms are able to ``break free" of these local optima to eventually converge to the true global optimum. However, given…

Econometrics · Economics 2024-01-17 Zachary Porreca

We study the properties of galaxy cluster 2-point correlation function covariance matrices estimated using the linear-construction (LC) method, which is computationally up to 20 times faster than the standard sample-covariance method. Our…

Cosmology and Nongalactic Astrophysics · Physics 2026-03-12 V. Lindholm , E. Sihvola , J. Valiviita , A. Fumagalli , B. Altieri , S. Andreon , N. Auricchio , C. Baccigalupi , M. Baldi , S. Bardelli , P. Battaglia , A. Biviano , E. Branchini , M. Brescia , S. Camera , V. Capobianco , C. Carbone , V. F. Cardone , J. Carretero , S. Casas , M. Castellano , G. Castignani , S. Cavuoti , K. C. Chambers , A. Cimatti , C. Colodro-Conde , G. Congedo , L. Conversi , Y. Copin , F. Courbin , H. M. Courtois , A. Da Silva , H. Degaudenzi , G. De Lucia , H. Dole , F. Dubath , X. Dupac , S. Dusini , S. Escoffier , M. Farina , R. Farinelli , S. Ferriol , F. Finelli , P. Fosalba , S. Fotopoulou , M. Frailis , E. Franceschi , M. Fumana , S. Galeotta , K. George , B. Gillis , C. Giocoli , J. Gracia-Carpio , A. Grazian , F. Grupp , S. V. H. Haugan , W. Holmes , F. Hormuth , A. Hornstrup , K. Jahnke , M. Jhabvala , S. Kermiche , A. Kiessling , B. Kubik , M. Kunz , H. Kurki-Suonio , A. M. C. Le Brun , S. Ligori , P. B. Lilje , I. Lloro , G. Mainetti , E. Maiorano , O. Mansutti , S. Marcin , O. Marggraf , M. Martinelli , N. Martinet , F. Marulli , R. J. Massey , E. Medinaceli , S. Mei , M. Melchior , M. Meneghetti , E. Merlin , G. Meylan , A. Mora , M. Moresco , L. Moscardini , R. Nakajima , C. Neissner , S. -M. Niemi , C. Padilla , S. Paltani , F. Pasian , K. Pedersen , V. Pettorino , S. Pires , G. Polenta , M. Poncet , L. A. Popa , F. Raison , A. Renzi , J. Rhodes , G. Riccio , E. Romelli , M. Roncarelli , C. Rosset , R. Saglia , Z. Sakr , A. G. Sánchez , D. Sapone , P. Schneider , T. Schrabback , A. Secroun , G. Seidel , P. Simon , C. Sirignano , G. Sirri , L. Stanco , P. Tallada-Crespí , A. N. Taylor , I. Tereno , S. Toft , R. Toledo-Moreo , F. Torradeflot , I. Tutusaus , T. Vassallo , G. Verdoes Kleijn , Y. Wang , J. Weller , G. Zamorani , E. Zucca , T. Castro , J. Martín-Fleitas , P. Monaco , A. Pezzotta , V. Scottez , M. Sereno , M. Viel , D. Sciotti

The ability to obtain reliable point estimates of model parameters is of crucial importance in many fields of physics. This is often a difficult task given that the observed data can have a very high number of dimensions. In order to…

Cosmology and Nongalactic Astrophysics · Physics 2021-12-15 Janis Fluri , Aurelien Lucchi , Tomasz Kacprzak , Alexandre Refregier , Thomas Hofmann

This work addresses the issue of large covariance matrix estimation in high-dimensional statistical analysis. Recently, improved iterative algorithms with positive-definite guarantee have been developed. However, these algorithms cannot be…

Information Theory · Computer Science 2016-07-29 Fei Wen , Yuan Yang , Peilin Liu , Robert C. Qiu

Conformal prediction provides a distribution-free framework for uncertainty quantification. This study explores the application of conformal prediction in scenarios where covariates are missing, which introduces significant challenges for…

Methodology · Statistics 2025-09-09 Jingsen Kong , YIming Liu , Guangren Yang

Many machine learning algorithms require precise estimates of covariance matrices. The sample covariance matrix performs poorly in high-dimensional settings, which has stimulated the development of alternative methods, the majority based on…

Machine Learning · Statistics 2016-11-04 Daniel Bartz

Statistical models that possess symmetry arise in diverse settings such as random fields associated to geophysical phenomena, exchangeable processes in Bayesian statistics, and cyclostationary processes in engineering. We formalize the…

Statistics Theory · Mathematics 2011-12-01 Parikshit Shah , Venkat Chandrasekaran

We consider the problem of predicting several response variables using the same set of explanatory variables. This setting naturally induces a group structure over the coefficient matrix, in which every explanatory variable corresponds to a…

Methodology · Statistics 2019-10-03 Aviv Navon , Saharon Rosset

The covariance matrix plays a fundamental role in many modern exploratory and inferential statistical procedures, including dimensionality reduction, hypothesis testing, and regression. In low-dimensional regimes, where the number of…

Methodology · Statistics 2024-11-12 Philippe Boileau , Nima S. Hejazi , Mark J. van der Laan , Sandrine Dudoit

This paper studies the problem of estimating the covariance of a collection of vectors using only highly compressed measurements of each vector. An estimator based on back-projections of these compressive samples is proposed and analyzed. A…

Machine Learning · Statistics 2019-01-16 Martin Azizyan , Akshay Krishnamurthy , Aarti Singh

This paper studies the covariance matrix estimation for high-dimensional time series within a new framework that combines low-rank factor and latent variable-specific cluster structures. The popular methods based on assuming the sparse…

Methodology · Statistics 2025-02-25 Dong Li , Xinghao Qiao , Cheng Yu

We introduce a multi-fidelity estimator of covariance matrices that employs the log-Euclidean geometry of the symmetric positive-definite manifold. The estimator fuses samples from a hierarchy of data sources of differing fidelities and…

Computation · Statistics 2023-05-30 Aimee Maurais , Terrence Alsup , Benjamin Peherstorfer , Youssef Marzouk

With rapid adoption of deep learning in critical applications, the question of when and how much to trust these models often arises, which drives the need to quantify the inherent uncertainties. While identifying all sources that account…

Machine Learning · Statistics 2019-11-22 Jayaraman J. Thiagarajan , Bindya Venkatesh , Prasanna Sattigeri , Peer-Timo Bremer

Estimating covariance matrices is a problem of fundamental importance in multivariate statistics. In practice it is increasingly frequent to work with data matrices $X$ of dimension $n\times p$, where $p$ and $n$ are both large. Results…

Statistics Theory · Mathematics 2009-01-22 Noureddine El Karoui

As a classical problem, covariance estimation has drawn much attention from the statistical community for decades. Much work has been done under the frequentist and the Bayesian frameworks. Aiming to quantify the uncertainty of the…

Methodology · Statistics 2017-08-17 W. Jenny Shi , Jan Hannig , Randy C. S. Lai , Thomas C. M. Lee

Recent literature provides many computational and modeling approaches for covariance matrices estimation in a penalized Gaussian graphical models but relatively little study has been carried out on the choice of the tuning parameter. This…

Methodology · Statistics 2009-09-08 Heng Lian

Weak gravitational lensing is a powerful probe of cosmology, with second-order shear statistics commonly used to constrain parameters such as the matter density $\Omega_\mathrm{m}$ and the clustering amplitude $S_8$. However, parameter…

Cosmology and Nongalactic Astrophysics · Physics 2025-09-26 Niek Wielders , Laila Linke , Pierre A. Burger , Sven Heydenreich , Lucas Porth , Peter Schneider

The classic likelihood ratio test for testing the equality of two covariance matrices breakdowns due to the singularity of the sample covariance matrices when the data dimension $p$ is larger than the sample size $n$. In this paper, we…

Methodology · Statistics 2015-11-06 Tung-Lung Wu , Ping Li

Finite Gaussian mixture models are widely used for model-based clustering of continuous data. Nevertheless, since the number of model parameters scales quadratically with the number of variables, these models can be easily…

Methodology · Statistics 2018-09-25 Michael Fop , Thomas Brendan Murphy , Luca Scrucca