English
Related papers

Related papers: Denoising clustering covariance matrices with Rota…

200 papers

Most applications of Bayesian Inference for parameter estimation and model selection in astrophysics involve the use of Monte Carlo techniques such as Markov Chain Monte Carlo (MCMC) and nested sampling. However, these techniques are time…

Instrumentation and Methods for Astrophysics · Physics 2022-01-26 Geetakrishnasai Gunapati , Anirudh Jain , P. K. Srijith , Shantanu Desai

We propose a rectangular rotational invariant estimator to recover a real matrix from noisy matrix observations coming from an arbitrary additive rotational invariant perturbation, in the large dimension limit. Using the Bayes-optimality of…

Information Theory · Computer Science 2023-04-25 Farzad Pourkamali , Nicolas Macris

Cluster-randomized experiments are increasingly used to evaluate interventions in routine practice conditions, and researchers often adopt model-based methods with covariate adjustment in the statistical analyses. However, the validity of…

Methodology · Statistics 2023-12-08 Bingkai Wang , Chan Park , Dylan S. Small , Fan Li

X-ray observations of galaxy clusters reveal a large range of morphologies with various degrees of disturbance, showing that the assumptions of hydrostatic equilibrium and spherical shape which are used to determine the cluster mass from…

Cosmology and Nongalactic Astrophysics · Physics 2012-12-11 A. Weißmann , H. Böhringer , R. Suhada , S. Ameglio

This work introduces a refinement of the Parsimonious Model for fitting a Gaussian Mixture. The improvement is based on the consideration of clusters of the involved covariance matrices according to a criterion, such as sharing Principal…

Methodology · Statistics 2024-04-10 David Rodríguez-Vítores , Carlos Matrán

We develop a method for estimating well-conditioned and sparse covariance and inverse covariance matrices from a sample of vectors drawn from a sub-gaussian distribution in high dimensional setting. The proposed estimators are obtained by…

Statistics Theory · Mathematics 2016-11-21 Ashwini Maurya

An approach for the analysis of atomically resolved scanning transmission electron microscopy data with multiple ferroic variants in the presence of imaging non-idealities and chemical variabilities based on a rotationally invariant…

In this paper, we exploit the spiked covariance structure of the clutter plus noise covariance matrix for radar signal processing. Using state-of-the-art techniques high dimensional statistics, we propose a nonlinear shrinkage-based…

Signal Processing · Electrical Eng. & Systems 2023-02-07 Shashwat Jain , Vikram Krishnamurthy , Muralidhar Rangaswamy , Bosung Kang , Sandeep Gogineni

A central challenge in precision cosmology with galaxy surveys is to extract non-Gaussian information from large-scale structure while controlling systematic uncertainties such as tracer bias. Conventional clustering statistics, such as the…

Cosmology and Nongalactic Astrophysics · Physics 2026-05-27 Zhujun Jiang , Xu Xiao , Fenfen Yin , Xiao-Dong Li , Le Zhang

Reliable extraction of cosmological information from clustering measurements of galaxy surveys requires estimation of the error covariance matrices of observables. The accuracy of covariance matrices is limited by our ability to generate…

Cosmology and Nongalactic Astrophysics · Physics 2017-08-29 Mohammadjavad Vakili , Francisco-Shu Kitaura , Yu Feng , Gustavo Yepes , Cheng Zhao , Chia-Hsun Chuang , ChangHoon Hahn

A new class of disturbance covariance matrix estimators for radar signal processing applications is introduced following a geometric paradigm. Each estimator is associated with a given unitary invariant norm and performs the sample…

Applications · Statistics 2018-02-14 Augusto Aubry , Antonio De Maio , Luca Pallotta

Accurate covariance matrices for two-point functions are critical for inferring cosmological parameters in likelihood analyses of large-scale structure surveys. Among various approaches to obtaining the covariance, analytic computation is…

Cosmology and Nongalactic Astrophysics · Physics 2021-02-23 Xiao Fang , Tim Eifler , Elisabeth Krause

Instance segmentation has witnessed promising advancements through deep neural network-based algorithms. However, these models often exhibit incorrect predictions with unwarranted confidence levels. Consequently, evaluating prediction…

Computer Vision and Pattern Recognition · Computer Science 2023-09-20 Qasim M. K. Siddiqui , Sebastian Starke , Peter Steinbach

One of the major challenges in multivariate analysis is the estimation of population covariance matrix from sample covariance matrix (SCM). Most recent covariance matrix estimators use either shrinkage transformations or asymptotic results…

Methodology · Statistics 2019-12-10 Samruddhi Deshmukh , Amartansh Dubey

Estimation of covariance matrices or their inverses plays a central role in many statistical methods. For these methods to work reliably, estimated matrices must not only be invertible but also well-conditioned. In this paper we present an…

Methodology · Statistics 2014-08-06 Eric C. Chi , Kenneth Lange

The use of sparse precision (inverse covariance) matrices has become popular because they allow for efficient algorithms for joint inference in high-dimensional models. Many applications require the computation of certain elements of the…

Computation · Statistics 2017-12-06 Per Sidén , Finn Lindgren , David Bolin , Mattias Villani

Estimating covariance matrix from massive high-dimensional and distributed data is significant for various real-world applications. In this paper, we propose a data-aware weighted sampling based covariance matrix estimator, namely DACE,…

Machine Learning · Computer Science 2020-10-13 Xixian Chen , Haiqin Yang , Shenglin Zhao , Michael R. Lyu , Irwin King

Making cosmological inferences from the observed galaxy clustering requires accurate predictions for the mean clustering statistics and their covariances. Those are affected by cosmic variance -- the statistical noise due to the finite…

Cosmology and Nongalactic Astrophysics · Physics 2020-04-08 Anatoly Klypin , Francisco Prada , Joyce Byun

This paper is the first in a set that analyses the covariance matrices of clustering statistics obtained from several approximate methods for gravitational structure formation. We focus here on the covariance matrices of anisotropic…

We consider high-dimensional measurement errors with high-frequency data. Our objective is on recovering the high-dimensional cross-sectional covariance matrix of the random errors with optimality. In this problem, not all components of the…

Statistics Theory · Mathematics 2024-04-03 Jinyuan Chang , Qiao Hu , Cheng Liu , Cheng Yong Tang