English
Related papers

Related papers: A Bayesian method for combining theoretical and si…

200 papers

Creating accurate and low-noise covariance matrices represents a formidable challenge in modern-day cosmology. We present a formalism to compress arbitrary observables into a small number of bins by projection into a model-specific subspace…

Cosmology and Nongalactic Astrophysics · Physics 2021-02-10 Oliver H. E. Philcox , Mikhail M. Ivanov , Matias Zaldarriaga , Marko Simonovic , Marcel Schmittfull

When inferring parameters from a Gaussian-distributed data set by computing a likelihood, a covariance matrix is needed that describes the data errors and their correlations. If the covariance matrix is not known a priori, it may be…

Cosmology and Nongalactic Astrophysics · Physics 2016-01-27 Elena Sellentin , Alan F. Heavens

Modeling correlation (and covariance) matrices can be challenging due to the positive-definiteness constraint and potential high-dimensionality. Our approach is to decompose the covariance matrix into the correlation and variance matrices…

We study how well the Gaussian approximation is valid for computing the covariance matrices of the convergence power and bispectrum in weak gravitational lensing analyses. We focus on its impact on the cosmological parameter estimations by…

Cosmology and Nongalactic Astrophysics · Physics 2015-06-12 Masanori Sato , Takahiro Nishimichi

It has been proposed that complex populations, such as those that arise in genomics studies, may exhibit dependencies among observations as well as among variables. This gives rise to the challenging problem of analyzing unreplicated…

Machine Learning · Statistics 2018-06-08 Michael Hornstein , Roger Fan , Kerby Shedden , Shuheng Zhou

In high-dimensional Bayesian statistics, various methods have been developed, including prior distributions that induce parameter sparsity to handle many parameters. Yet, these approaches often overlook the rich spectral structure of the…

Statistics Theory · Mathematics 2025-05-06 Tomoya Wakayama , Masaaki Imaizumi

In minimum trace (MinT) forecast reconciliation, the covariance matrix of the base forecasts errors plays a crucial role. Typically, this matrix is estimated and then treated as known. This can lead to underestimation of the variance of the…

Methodology · Statistics 2026-05-11 Chiara Carrara , Dario Azzimonti , Giorgio Corani , Lorenzo Zambon

This paper tackles the problem of robust covariance matrix estimation when the data is incomplete. Classical statistical estimation methodologies are usually built upon the Gaussian assumption, whereas existing robust estimation ones assume…

A Bayesian approach is used to estimate the covariance matrix of Gaussian data. Ideas from Gaussian graphical models and model selection are used to construct a prior for the covariance matrix that is a mixture over all decomposable graphs.…

Methodology · Statistics 2007-06-12 Helen Armstrong , Christopher K. Carter , Kevin F. Wong , Robert Kohn

Gaussian graphical models are used for determining conditional relationships between variables. This is accomplished by identifying off-diagonal elements in the inverse-covariance matrix that are non-zero. When the ratio of variables (p) to…

Applications · Statistics 2018-08-07 Donald R. Williams , Juho Piironen , Aki Vehtari , Philippe Rast

In recent years cosmic shear, the weak gravitational lensing effect by the large-scale structure of the Universe, has proven to be one of the observational pillars on which the cosmological concordance model is founded. Several cosmic shear…

Astrophysics · Physics 2008-03-12 B. Joachimi , P. Schneider , T. Eifler

In many practical situations we would like to estimate the covariance matrix of a set of variables from an insufficient amount of data. More specifically, if we have a set of $N$ independent, identically distributed measurements of an $M$…

Probability · Mathematics 2010-10-05 Thomas L. Marzetta , Gabriel H. Tucci , Steven H. Simon

Making inferences about physical properties of the Universe requires knowledge of the data likelihood. A Gaussian distribution is commonly assumed for the uncertainties with a covariance matrix estimated from a set of simulations. The noise…

Cosmology and Nongalactic Astrophysics · Physics 2025-07-09 Jed Homer , Oliver Friedrich , Daniel Gruen

Covariance matrices of random vectors contain information that is crucial for modelling. Specific structures and patterns of the covariances (or correlations) may be used to justify parametric models, e.g., autoregressive models. Until now,…

Methodology · Statistics 2025-02-11 Paavo Sattler , Dennis Dobler

Cosmological probes pose an inverse problem where the measurement result is obtained through observations, and the objective is to infer values of model parameters which characterize the underlying physical system -- our Universe. Modern…

Instrumentation and Methods for Astrophysics · Physics 2019-05-21 Timur Takhtaganov , Zarija Lukic , Juliane Mueller , Dmitriy Morozov

We consider the problem of predicting several response variables using the same set of explanatory variables. This setting naturally induces a group structure over the coefficient matrix, in which every explanatory variable corresponds to a…

Methodology · Statistics 2019-10-03 Aviv Navon , Saharon Rosset

Bayesian estimation is increasingly popular for performing model based inference to support policymaking. These data are often collected from surveys under informative sampling designs where subject inclusion probabilities are designed to…

Methodology · Statistics 2018-07-13 Luis G. Leon-Novelo , Terrance D. Savitsky

We introduce a new method for estimating the covariance matrix for the galaxy correlation function in surveys of large-scale structure. Our method combines simple theoretical results with a realistic characterization of the survey to…

Cosmology and Nongalactic Astrophysics · Physics 2016-08-31 Ross O'Connell , Daniel Eisenstein , Mariana Vargas , Shirley Ho , Nikhil Padmanabhan

Neural networks make accurate predictions but often fail to provide reliable uncertainty estimates, especially under covariate distribution shifts between training and testing. To address this problem, we propose a Bayesian framework for…

Machine Learning · Statistics 2025-12-22 Yuli Slavutsky , David M. Blei

We combine Bayesian prediction and weighted inference as a unified approach to survey inference. The general principles of Bayesian analysis imply that models for survey outcomes should be conditional on all variables that affect the…

Methodology · Statistics 2020-06-24 Yajuan Si , Rob Trangucci , Jonah Sol Gabry , Andrew Gelman