English
Related papers

Related papers: Regularized Block Toeplitz Covariance Matrix Estim…

200 papers

We address high dimensional covariance estimation for elliptical distributed samples, which are also known as spherically invariant random vectors (SIRV) or compound-Gaussian processes. Specifically we consider shrinkage methods that are…

Methodology · Statistics 2015-05-20 Yilun Chen , Ami Wiesel , Alfred O. Hero

"Toeplitzification" or "redundancy (spatial) averaging", the well-known routine for deriving the Toeplitz covariance matrix estimate from the standard sample covariance matrix, recently regained new attention due to the important Random…

Signal Processing · Electrical Eng. & Systems 2023-08-21 Yuri Abramovich , Tanit Pongsiri

A new nonparametric estimator for Toeplitz covariance matrices is proposed. This estimator is based on a data transformation that translates the problem of Toeplitz covariance matrix estimation to the problem of mean estimation in an…

Statistics Theory · Mathematics 2024-01-08 Karolina Klockmann , Tatyana Krivobokova

New bounds are derived for the eigenvalues of sums of Kronecker products of square matrices by relating the corresponding matrix expressions to the covariance structure of suitable bi-linear stochastic systems in discrete and continuous…

Probability · Mathematics 2014-04-18 Sergey V Lototsky

This paper studies iteration convergence of Kronecker graphical lasso (KGLasso) algorithms for estimating the covariance of an i.i.d. Gaussian random sample under a sparse Kronecker-product covariance model and MSE convergence rates. The…

Methodology · Statistics 2013-11-04 Theodoros Tsiligkaridis , Alfred O. Hero , Shuheng Zhou

Nonsingular estimation of high dimensional covariance matrices is an important step in many statistical procedures like classification, clustering, variable selection an future extraction. After a review of the essential background…

Statistics Theory · Mathematics 2015-03-19 Deniz Akdemir

We seek to improve estimates of the power spectrum covariance matrix from a limited number of simulations by employing a novel statistical technique known as shrinkage estimation. The shrinkage technique optimally combines an empirical…

Astrophysics · Physics 2009-11-13 Adrian C. Pope , István Szapudi

We study the matrix-variate regression problem $Y_i = \sum_{k} \beta_{1k} X_i \beta_{2k}^{\top} + E_i$ for $i=1,2\dots,n$ in the high dimensional regime wherein the response $Y_i$ are matrices whose dimensions $p_{1}\times p_{2}$ outgrow…

Machine Learning · Statistics 2024-05-01 Yin-Jen Chen , Minh Tang

We study high-dimensional covariance/precision matrix estimation under the assumption that the covariance/precision matrix can be decomposed into a low-rank component L and a diagonal component D. The rank of L can either be chosen to be…

Methodology · Statistics 2018-02-19 Yilei Wu , Yingli Qin , Mu Zhu

We provide a computational framework for approximating a class of structured matrices; here, the term structure is very general, and may refer to a regular sparsity pattern (e.g., block-banded), or be more highly structured (e.g., symmetric…

Numerical Analysis · Mathematics 2021-05-05 Misha E. Kilmer , Arvind K. Saibaba

We consider the problem of jointly learning row-wise and column-wise dependencies of matrix-variate observations, which are modelled separately by two precision matrices. Due to the complicated structure of Kronecker-product precision…

Machine Learning · Computer Science 2024-03-06 Meixia Lin , Yangjing Zhang

Several problems in neuroimaging and beyond require inference on the parameters of multi-task sparse hierarchical regression models. Examples include M/EEG inverse problems, neural encoding models for task-based fMRI analyses, and climate…

When only few data samples are accessible, utilizing structural prior knowledge is essential for estimating covariance matrices and their inverses. One prominent example is knowing the covariance matrix to be Toeplitz structured, which…

Signal Processing · Electrical Eng. & Systems 2023-11-28 Benedikt Böck , Dominik Semmler , Benedikt Fesl , Michael Baur , Wolfgang Utschick

A matrix completion problem is to recover the missing entries in a partially observed matrix. Most of the existing matrix completion methods assume a low rank structure of the underlying complete matrix. In this paper, we introduce an…

Machine Learning · Statistics 2020-11-16 Chencheng Cai , Rong Chen , Han Xiao

In this work, we propose a method to efficiently find the regularization parameter for low-rank MMSE filters based on a Kronecker-product representation. We show that the regularization parameter is surprisingly linked to the problem of…

Machine Learning · Computer Science 2025-12-18 Daniel Gomes de Pinho Zanco , Leszek Szczecinski , Jacob Benesty , Eduardo Vinicius Kuhn

Feed-forward neural networks can be understood as a combination of an intermediate representation and a linear hypothesis. While most previous works aim to diversify the representations, we explore the complementary direction by performing…

Machine Learning · Computer Science 2019-10-24 Han Zhao , Yao-Hung Hubert Tsai , Ruslan Salakhutdinov , Geoffrey J. Gordon

This paper proposes methods for likelihood-based inference in multivariate linear regressions when the correlation matrix of the responses is separable; that is, it has a Kronecker product structure, but the variances are unrestricted. The…

Computation · Statistics 2026-04-16 Karl Oskar Ekvall

This paper presents a stochastic model predictive controller (SMPC) for linear time-invariant systems in the presence of additive disturbances. The distribution of the disturbance is unknown and is assumed to have a bounded support. A…

Systems and Control · Electrical Eng. & Systems 2022-10-03 Hotae Lee , Monimoy Bujarbaruah , Francesco Borrelli

We study the inverse problem of recovering the spatial support of parameter variations in a system of partial differential equations (PDEs) from boundary measurements. A reconstruction method is developed based on the monotonicity…

Optimization and Control · Mathematics 2025-05-29 Houcine Meftahi , Chayma Nssibi

We propose a new model for approximating spatiotemporal noise covariance for use in MEG/EEG source analysis. Our model is an extension of an existing model [1,2] that uses a single Kronecker product of a pair of matrices - temporal and…

Data Analysis, Statistics and Probability · Physics 2007-05-23 S. M. Plis , J. S. George , S. C. Jun , J. Pare-Blagoev , D. M. Ranken , D. M. Schmidt , C. C. Wood