English
Related papers

Related papers: Robust estimation of precision matrices under cell…

200 papers

Gaussian graphical models are widely used to represent correlations among entities but remain vulnerable to data corruption. In this work, we introduce a modified trimmed-inner-product algorithm to robustly estimate the covariance in an…

Machine Learning · Computer Science 2023-09-19 Tong Yao , Shreyas Sundaram

In data analysis, contamination caused by outliers is inevitable, and robust statistical methods are strongly demanded. In this paper, our concern is to develop a new approach for robust data analysis based on scoring rules. The scoring…

Statistics Theory · Mathematics 2013-11-22 Takafumi Kanamori , Hironori Fujisawa

Sparse covariance matrices play crucial roles by encoding the interdependencies between variables in numerous fields such as genetics and neuroscience. Despite substantial studies on sparse covariance matrices, existing methods face several…

Methodology · Statistics 2026-03-03 Rakheon Kim , Irina Gaynanova

The usual Minimum Covariance Determinant (MCD) estimator of a covariance matrix is robust against casewise outliers. These are cases (that is, rows of the data matrix) that behave differently from the majority of cases, raising suspicion…

Methodology · Statistics 2024-07-08 Jakob Raymaekers , Peter J. Rousseeuw

We propose a data-analytic method for detecting cellwise outliers. Given a robust covariance matrix, outlying cells (entries) in a row are found by the cellHandler technique which combines lasso regression with a stepwise application of…

Methodology · Statistics 2024-07-08 Jakob Raymaekers , Peter J. Rousseeuw

Covariance matrix estimation is one of the most important problems in statistics. To accommodate the complexity of modern datasets, it is desired to have estimation procedures that not only can incorporate the structural assumptions of…

Statistics Theory · Mathematics 2017-06-13 Mengjie Chen , Chao Gao , Zhao Ren

Modern technologies are producing datasets with complex intrinsic structures, and they can be naturally represented as matrices instead of vectors. To preserve the latent data structures during processing, modern regression approaches…

Machine Learning · Computer Science 2016-11-16 Hang Zhang , Fengyuan Zhu , Shixin Li

We offer a method to estimate a covariance matrix in the special case that \textit{both} the covariance matrix and the precision matrix are sparse --- a constraint we call double sparsity. The estimation method is maximum likelihood,…

Methodology · Statistics 2021-08-17 Shev Macnamara , Erik Schlögl , Zdravko I. Botev

Estimating large covariance and precision matrices are fundamental in modern multivariate analysis. The problems arise from statistical analysis of large panel economics and finance data. The covariance matrix reveals marginal correlations…

Methodology · Statistics 2015-04-17 Jianqing Fan , Yuan Liao , Han Liu

We propose a penalized likelihood framework for estimating multiple precision matrices from different classes. Most existing methods either incorporate no information on relationships between the precision matrices, or require this…

Machine Learning · Statistics 2020-03-03 Bradley S. Price , Aaron J. Molstad , Ben Sherwood

This work presents a detailed covariance and correlation matrix analysis for experimentally measured cross sections obtained using the activation technique. Both statistical and systematic contributions to the covariance matrix were…

Nuclear Theory · Physics 2026-04-01 Tanmoy Bar

We propose the use of a robust covariance estimator based on multivariate Winsorization in the context of the Tarr-Muller-Weber framework for sparse estimation of the precision matrix of a Gaussian graphical model. Likewise Croux-Ollerer's…

Methodology · Statistics 2022-01-12 Ginette Lafit , Francisco Nogales , Marcelo Ruiz , Ruben Zamar

Relying on recent advances in statistical estimation of covariance distances based on random matrix theory, this article proposes an improved covariance and precision matrix estimation for a wide family of metrics. The method is shown to…

Machine Learning · Statistics 2021-02-03 Malik Tiomoko , Florent Bouchard , Guillaume Ginholac , Romain Couillet

Many data-analysis problems involve large dense matrices that describe the covariance of stationary noise processes; the computational cost of inverting these matrices, or equivalently of solving linear systems that contain them, is often a…

Instrumentation and Methods for Astrophysics · Physics 2015-06-22 Rutger van Haasteren , Michele Vallisneri

We consider the maximum likelihood estimation of sparse inverse covariance matrices. We demonstrate that current heuristic approaches primarily encourage robustness, instead of the desired sparsity. We give a novel approach that solves the…

Machine Learning · Statistics 2021-11-08 Dimitris Bertsimas , Jourdain Lamperski , Jean Pauphilet

Estimation of covariance matrices or their inverses plays a central role in many statistical methods. For these methods to work reliably, estimated matrices must not only be invertible but also well-conditioned. In this paper we present an…

Methodology · Statistics 2014-08-06 Eric C. Chi , Kenneth Lange

It is well-known that real data often contain outliers. The term outlier typically refers to a case, that is, a row of the $n \times d$ data matrix. In recent times a different type has come into focus, the cellwise outliers. These are…

Methodology · Statistics 2024-07-08 Jakob Raymaekers , Peter J. Rousseeuw

This paper considers the problem of matrix completion when some number of the columns are completely and arbitrarily corrupted, potentially by a malicious adversary. It is well-known that standard algorithms for matrix completion can return…

Machine Learning · Statistics 2016-04-26 Yudong Chen , Huan Xu , Constantine Caramanis , Sujay Sanghavi

Adaptive algorithms based on sample matrix inversion belong to an important class of algorithms used in radar target detection to overcome prior uncertainty of interference covariance. Sample matrix inversion problem is generally ill…

Signal Processing · Electrical Eng. & Systems 2020-10-15 Boris N. Oreshkin , Peter A. Bakulev

Covariance matrices are important tools for obtaining reliable parameter constraints. Advancements in cosmological surveys lead to larger data vectors and, consequently, increasingly complex covariance matrices, whose number of elements…

Cosmology and Nongalactic Astrophysics · Physics 2022-05-31 Tassia Ferreira , Valerio Marra