English
Related papers

Related papers: Absolute Eigenvalues-Based Covariance Matrix Estim…

200 papers

We obtain general, exact formulas for the overlaps between the eigenvectors of large correlated random matrices, with additive or multiplicative noise. These results have potential applications in many different contexts, from quantum…

Statistical Mechanics · Physics 2018-12-05 Joël Bun , Jean-Philippe Bouchaud , Marc Potters

Many modern algorithms for inverse problems and data assimilation rely on ensemble Kalman updates to blend prior predictions with observed data. Ensemble Kalman methods often perform well with a small ensemble size, which is essential in…

Machine Learning · Statistics 2024-01-05 Omar Al Ghattas , Daniel Sanz-Alonso

Compressive covariance estimation has arisen as a class of techniques whose aim is to obtain second-order statistics of stochastic processes from compressive measurements. Recently, these methods have been used in various image processing…

Image and Video Processing · Electrical Eng. & Systems 2022-07-27 Jonathan Monsalve , Juan Ramirez , Iñaki Esnaola , Henry Arguello

We propose a fast bivariate smoothing approach for symmetric surfaces that has a wide range of applications. We show how it can be applied to estimate the covariance function in longitudinal data as well as multiple additive covariances in…

Computation · Statistics 2016-09-23 Jona Cederbaum , Fabian Scheipl , Sonja Greven

In a series of papers the author and others have studied an asymptotic expansion of the errors of the eigenvalue approximation, using the spectral symbol, in connection with Toeplitz (and Toeplitz-like) matrices, that is, $E_{j,n}$ in…

Numerical Analysis · Mathematics 2024-12-20 Sven-Erik Ekström

We consider the problem of direction-of-arrival (DOA) estimation in unknown partially correlated noise environments where the noise covariance matrix is sparse. A sparse noise covariance matrix is a common model for a sparse array of…

Information Theory · Computer Science 2016-11-15 Mohammadreza Malek-Mohammadi , Magnus Jansson , Arash Owrang , Ali Koochakzadeh , Massoud Babaie-Zadeh

We consider the joint estimation of change point locations and the sparsity pattern of the variance covariance matrix, which is assumed to evolve in a piecewise constant manner. By applying Group Fused LASSO and LASSO penalties to the…

Methodology · Statistics 2026-05-14 Ying Lin , Benjamin Poignard

This paper studies the covariance matrix estimation for high-dimensional time series within a new framework that combines low-rank factor and latent variable-specific cluster structures. The popular methods based on assuming the sparse…

Methodology · Statistics 2025-02-25 Dong Li , Xinghao Qiao , Cheng Yu

Sparse representation of structured signals requires modelling strategies that maintain specific signal properties, in addition to preserving original information content and achieving simpler signal representation. Therefore, the major…

Computer Vision and Pattern Recognition · Computer Science 2018-10-30 Branko Brkljač , Željen Trpovski

We study the problem of estimating the leading eigenvectors of a high-dimensional population covariance matrix based on independent Gaussian observations. We establish lower bounds on the rates of convergence of the estimators of the…

Statistics Theory · Mathematics 2012-02-07 Debashis Paul , Iain M. Johnstone

Sparse additive models have attracted much attention in high-dimensional data analysis due to their flexible representation and strong interpretability. However, most existing models are limited to single-level learning under the…

Machine Learning · Computer Science 2026-04-23 Xuelin Zhang , Xinyue Liu , Lingjuan Wu , Hong Chen

We propose a convex and fast signal reconstruction method for block sparsity under arbitrary linear transform with unknown block structure. The proposed method is a generalization of the similar existing method and can reconstruct signals…

Machine Learning · Computer Science 2024-02-14 Takanobu Furuhashi , Hidekata Hontani , Tatsuya Yokota

High dimensional covariance estimation and graphical models is a contemporary topic in statistics and machine learning having widespread applications. An important line of research in this regard is to shrink the extreme spectrum of the…

Methodology · Statistics 2016-06-28 Sang-Yun Oh , Bala Rajaratnam , Joong-Ho Won

Using random matrix technique we determine an exact relation between the eigenvalue spectrum of the covariance matrix and of its estimator. This relation can be used in practice to compute eigenvalue invariants of the covariance…

Statistical Mechanics · Physics 2010-01-15 Z. Burda , A. Goerlich , A. Jarosz , J. Jurkiewicz

Estimating large covariance matrices has been a longstanding important problem in many applications and has attracted increased attention over several decades. This paper deals with two methods based on pre-existing works to impose sparsity…

Applications · Statistics 2017-12-06 Ahmad W. Bitar , Jean-Philippe Ovarlez , Loong-Fah Cheong

Applying the replica method of statistical mechanics, we evaluate the eigenvalue density of the large random matrix (sample covariance matrix) of the form $J = A^{\rm T} A$, where $A$ is an $M \times N$ real sparse random matrix. The…

Statistical Mechanics · Physics 2015-06-25 Taro Nagao , Toshiyuki Tanaka

This manuscript presents an approach to perform generalized linear regression with multiple high dimensional covariance matrices as the outcome. Model parameters are proposed to be estimated by maximizing a pseudo-likelihood. When the data…

Methodology · Statistics 2020-07-28 Yi Zhao , Brian S. Caffo , Xi Luo

We provide a novel -- and to the best of our knowledge, the first -- algorithm for high dimensional sparse regression with constant fraction of corruptions in explanatory and/or response variables. Our algorithm recovers the true sparse…

Machine Learning · Computer Science 2019-05-31 Liu Liu , Yanyao Shen , Tianyang Li , Constantine Caramanis

This study presents the development of a spatially adaptive weighting strategy for Total Variation regularization, aimed at addressing under-determined linear inverse problems. The method leverages the rapid computation of an accurate…

Numerical Analysis · Mathematics 2025-01-20 Elena Morotti , Davide Evangelista , Andrea Sebastiani , Elena Loli Piccolomini

Many important problems are characterized by the eigenvalues of a large matrix. For example, the difficulty of many optimization problems, such as those arising from the fitting of large models in statistics and machine learning, can be…