English
Related papers

Related papers: Denoising clustering covariance matrices with Rota…

200 papers

Estimating a covariance matrix is an important task in applications where the number of variables is larger than the number of observations. Shrinkage approaches for estimating a high-dimensional covariance matrix are often employed to…

Methodology · Statistics 2015-06-18 Anestis Touloumis

Stage-IV galaxy surveys will measure correlations at small cosmological scales with high signal-to-noise ratio. One of the main challenges of extracting information from small scales is devising accurate models, as well as characterizing…

Cosmology and Nongalactic Astrophysics · Physics 2025-05-20 Abdias Aires , Nickolas Kokron , Rogerio Rosenfeld , Felipe Andrade-Oliveira , Vivian Miranda

Graphical models are a framework for representing and exploiting prior conditional independence structures within distributions using graphs. In the Gaussian case, these models are directly related to the sparsity of the inverse covariance…

Statistics Theory · Mathematics 2015-10-28 Ami Wiesel , Yonina C. Eldar , Alfred O. Hero

To better understand the spatial structure of large panels of economic and financial time series and provide a guideline for constructing semiparametric models, this paper first considers estimating a large spatial covariance matrix of the…

Machine Learning · Statistics 2015-03-19 Song Song

The paper proposes a method for constructing a sparse estimator for the inverse covariance (concentration) matrix in high-dimensional settings. The estimator uses a penalized normal likelihood approach and forces sparsity by using a…

Statistics Theory · Mathematics 2008-06-26 Adam J. Rothman , Peter J. Bickel , Elizaveta Levina , Ji Zhu

Covariance matrix estimates are an essential part of many signal processing algorithms, and are often used to determine a low-dimensional principal subspace via their spectral decomposition. However, exact eigenanalysis is computationally…

Applications · Statistics 2011-12-01 Nicholas Arcolano , Patrick J. Wolfe

A class of improved estimators is proposed for N-point correlation functions of galaxy clustering, and for discrete spatial random processes in general. In the limit of weak clustering, the variance of the unbiased estimator converges to…

Astrophysics · Physics 2007-05-23 István Szapudi , Alexander S. Szalay

Generalized estimating equations (GEE) are of great importance in analyzing clustered data without full specification of multivariate distributions. A recent approach jointly models the mean, variance, and correlation coefficients of…

Methodology · Statistics 2025-01-13 Zhenyu Xu , Jason P. Fine , Wenling Song , Jun Yan

To make use of clustering statistics from large cosmological surveys, accurate and precise covariance matrices are needed. We present a new code to estimate large scale galaxy two-point correlation function (2PCF) covariances in arbitrary…

Cosmology and Nongalactic Astrophysics · Physics 2020-01-08 Oliver H. E. Philcox , Daniel J. Eisenstein , Ross O'Connell , Alexander Wiegand

We explore a variety of statistics of clusters selected with cosmic shear measurement by utilizing both analytic models and large numerical simulations. We first develop a halo model to predict the abundance and the clustering of weak…

Cosmology and Nongalactic Astrophysics · Physics 2015-09-16 Masato Shirasaki , Takashi Hamana , Naoki Yoshida

Performance of neural networks can be significantly improved by encoding known invariance for particular tasks. Many image classification tasks, such as those related to cellular imaging, exhibit invariance to rotation. We present a novel…

Machine Learning · Statistics 2018-06-01 Benjamin Chidester , Minh N. Do , Jian Ma

The present paper concerns large covariance matrix estimation via composite minimization under the assumption of low rank plus sparse structure. In this approach, the low rank plus sparse decomposition of the covariance matrix is recovered…

Methodology · Statistics 2019-12-16 Matteo Farnè , Angela Montanari

We introduce a new rotationally invariant viewing angle classification method for identifying, among a large number of Cryo-EM projection images, similar views without prior knowledge of the molecule. Our rotationally invariant features are…

Biomolecules · Quantitative Biology 2014-03-19 Zhizhen Zhao , Amit Singer

In this study, we investigate the impact of covariance within uncertainties on the inference of cosmological and astrophysical parameters, specifically focusing on galaxy stellar mass functions derived from the CAMELS simulation suite.…

Cosmology and Nongalactic Astrophysics · Physics 2024-10-30 Yongseok Jo , Shy Genel , Joel Leja , Benjamin Wandelt

This paper considers the regularized estimation of covariance matrices (CM) of high-dimensional (compound) Gaussian data for minimum variance distortionless response (MVDR) beamforming. Linear shrinkage is applied to improve the accuracy…

Signal Processing · Electrical Eng. & Systems 2021-04-06 Lei Xie , Zishu He , Jun Tong , Jun Li , Jiangtao Xi

The abundance of clusters and the clustering of galaxies are two of the important cosmological probes for current and future large scale surveys of galaxies, such as the Dark Energy Survey. In order to combine them one has to account for…

Cosmology and Nongalactic Astrophysics · Physics 2016-08-17 Fabien Lacasa , Rogerio Rosenfeld

Large-scale precision matrix estimation is of fundamental importance yet challenging in many contemporary applications for recovering Gaussian graphical models. In this paper, we suggest a new approach of innovated scalable efficient…

Methodology · Statistics 2016-05-12 Yingying Fan , Jinchi Lv

Recent advances in the fields of robotics and automation have spurred significant interest in robust state estimation. To enable robust state estimation, several methodologies have been proposed. One such technique, which has shown…

Signal Processing · Electrical Eng. & Systems 2019-10-15 Ryan M. Watson , Jason N. Gross , Clark N. Taylor , Robert C. Leishman

The density estimation is one of the core problems in statistics. Despite this, existing techniques like maximum likelihood estimation are computationally inefficient due to the intractability of the normalizing constant. For this reason an…

Machine Learning · Computer Science 2021-01-14 Tsimboy Olga , Yermek Kapushev , Evgeny Burnaev , Ivan Oseledets

This work addresses the issue of large covariance matrix estimation in high-dimensional statistical analysis. Recently, improved iterative algorithms with positive-definite guarantee have been developed. However, these algorithms cannot be…

Information Theory · Computer Science 2016-07-29 Fei Wen , Yuan Yang , Peilin Liu , Robert C. Qiu