English
Related papers

Related papers: Euclid: Fast two-point correlation function covari…

200 papers

Nine of the most important estimators known for the two-point correlation function are compared using a predetermined, rigorous criterion. The indicators were extracted from over 500 subsamples of the Virgo Hubble Volume simulation cluster…

Astrophysics · Physics 2009-08-21 Martin Kerscher , Istvan Szapudi , Alex Szalay

The classic likelihood ratio test for testing the equality of two covariance matrices breakdowns due to the singularity of the sample covariance matrices when the data dimension $p$ is larger than the sample size $n$. In this paper, we…

Methodology · Statistics 2015-11-06 Tung-Lung Wu , Ping Li

The covariance matrices of power-spectrum (P(k)) measurements from galaxy surveys are difficult to compute theoretically. The current best practice is to estimate covariance matrices by computing a sample covariance of a large number of…

Cosmology and Nongalactic Astrophysics · Physics 2016-02-03 David W. Pearson , Lado Samushia

This paper proposes methods for likelihood-based inference in multivariate linear regressions when the correlation matrix of the responses is separable; that is, it has a Kronecker product structure, but the variances are unrestricted. The…

Computation · Statistics 2026-04-16 Karl Oskar Ekvall

Canonical Correlation Analysis (CCA) is a widespread technique for discovering linear relationships between two sets of variables $X \in \mathbb{R}^{n \times p}$ and $Y \in \mathbb{R}^{n \times q}$. In high dimensions however, standard…

Methodology · Statistics 2024-05-31 Claire Donnat , Elena Tuzhilina

High dimensional data and systems with many degrees of freedom are often characterized by covariance matrices. In this paper, we consider the problem of simultaneously estimating the dimension of the principal (dominant) subspace of these…

Numerical Analysis · Computer Science 2018-10-10 Shashanka Ubaru , Abd-Krim Seghouane , Yousef Saad

Estimation of large sparse covariance matrices is of great importance for statistical analysis, especially in the high-dimensional settings. The traditional approach such as the sample covariance matrix performs poorly due to the high…

Statistics Theory · Mathematics 2023-08-21 Xiaoning Kang , Xinwei Deng

Accurate and precise covariance matrices will be important in enabling planned cosmological surveys to detect new physics. Standard methods imply either the need for many N-body simulations in order to obtain an accurate estimate, or a…

Cosmology and Nongalactic Astrophysics · Physics 2018-12-13 Alex Hall , Andy Taylor

Latent Gaussian copula models provide a powerful means to perform multi-view data integration since these models can seamlessly express dependencies between mixed variable types (binary, continuous, zero-inflated) via latent Gaussian…

Computation · Statistics 2022-04-22 Grace Yoon , Christian L. Müller , Irina Gaynanova

Context: Statistical properties of the cosmic density fields are to a large extent encoded in the shape of the one-point density probability distribution functions (PDF). In order to successfully exploit such observables, a detailed…

Cosmology and Nongalactic Astrophysics · Physics 2022-07-20 Francis Bernardeau

In this work we define a spatial concordance coefficient for second-order stationary processes. This problem has been widely addressed in a non-spatial context, but here we consider a coefficient that for a fixed spatial lag allows one to…

Methodology · Statistics 2019-05-14 Ronny Vallejos , Javier Pérez , Aaron M. Ellison , Andrew D. Richardson

We investigate the utility of the 3-dimensional Two-Point Correlation Function (3D 2PCF) in quantifying substructure in the stellar halo of the Milky Way, particularly as a means of constraining the accretion history of our Galaxy. We use…

Astrophysics of Galaxies · Physics 2019-01-23 Lachlan Lancaster , Vasily Belokurov , N. Wyn Evans

Shrinkage can effectively improve the condition number and accuracy of covariance matrix estimation, especially for low-sample-support applications with the number of training samples smaller than the dimensionality. This paper investigates…

Information Theory · Computer Science 2018-10-22 Jun Tong , Rui Hu , Jiangtao Xi , Zhitao Xiao , Qinghua Guo , Yanguang Yu

In climate studies, detecting spatial patterns that largely deviate from the sample mean still remains a statistical challenge. Although a Principal Component Analysis (PCA), or equivalently a Empirical Orthogonal Functions (EOF)…

Statistics Theory · Mathematics 2020-01-29 Alberto Bernacchia , Philippe Naveau

In covariance matrix estimation, one of the challenges lies in finding a suitable model and an efficient estimation method. Two commonly used modelling approaches in the literature involve imposing linear restrictions on the covariance…

Statistics Theory · Mathematics 2024-05-09 Piotr Zwiernik

We describe a novel approach to accelerating Monte Carlo Markov Chains. Our focus is cosmological parameter estimation, but the algorithm is applicable to any problem for which the likelihood surface is a smooth function of the free…

Cosmology and Nongalactic Astrophysics · Physics 2015-05-20 Adam Bouland , Richard Easther , Katherine Rosenfeld

Accurately modeling the correlation structure of errors is critical for reliable uncertainty quantification in probabilistic time series forecasting. While recent deep learning models for multivariate time series have developed efficient…

Machine Learning · Statistics 2024-11-11 Vincent Zhihao Zheng , Lijun Sun

In this paper, we consider the Group Lasso estimator of the covariance matrix of a stochastic process corrupted by an additive noise. We propose to estimate the covariance matrix in a high-dimensional setting under the assumption that the…

Statistics Theory · Mathematics 2011-10-26 Jérémie Bigot , Rolando Biscay , Jean-Michel Loubes , Lilian Muniz Alvarez

In this study, we aim to develop a new methodology to estimate the cross-correlation function and uncertainties and apply it to the analysis of magnification bias in galaxy surveys. We adopt a new methodological framework that uses a…

Cosmology and Nongalactic Astrophysics · Physics 2026-05-06 J. González-Nuevo , L. Bonavera , M. M. Cueli , D. Crespo , J. M. Casas

Incorporating covariates into functional principal component analysis (PCA) can substantially improve the representation efficiency of the principal components and predictive performance. However, many existing functional PCA methods do not…

Methodology · Statistics 2023-08-22 Fei Ding , Shiyuan He , David E. Jones , Jianhua Z. Huang