English
Related papers

Related papers: Kronecker Sum Decompositions of Space-Time Data

200 papers

In this paper we propose and study a technique to reduce the number of parameters and computation time in fully-connected layers of neural networks using Kronecker product, at a mild cost of the prediction quality. The technique proceeds by…

Neural and Evolutionary Computing · Computer Science 2015-07-23 Shuchang Zhou , Jia-Nan Wu

We consider the solution of the $\ell_1$ regularized image deblurring problem using isotropic and anisotropic regularization implemented with the split Bregman algorithm. For large scale problems, we replace the system matrix $A$ using a…

Numerical Analysis · Mathematics 2024-10-02 Abdulmajeed Alsubhi , Rosemary Renaut

In this article, we propose an algorithm for approximating the action of $\varphi-$functions of matrices against vectors, which is a key operation in exponential time integrators. In particular, we consider matrices with Kronecker sum…

Numerical Analysis · Mathematics 2022-11-03 Matteo Croci , Judit Muñoz-Matute

Multiway data analysis aims to uncover patterns in data structured as multi-indexed arrays, with multiway covariance playing a crucial role in many applications. However, the high dimensionality of multiway covariance presents significant…

Statistics Theory · Mathematics 2026-03-19 Dogyoon Song , Alfred O. Hero

In this paper, we analyze the impact of compressed sensing with complex random matrices on Fisher information and the Cram\'{e}r-Rao Bound (CRB) for estimating unknown parameters in the mean value function of a complex multivariate normal…

Statistics Theory · Mathematics 2023-07-19 Pooria Pakrooh , Ali Pezeshki , Louis L. Scharf , Douglas Cochran , Stephen D. Howard

Covariance matrix estimation is one of the most important problems in statistics. To accommodate the complexity of modern datasets, it is desired to have estimation procedures that not only can incorporate the structural assumptions of…

Statistics Theory · Mathematics 2017-06-13 Mengjie Chen , Chao Gao , Zhao Ren

We study the Kronecker product regression problem, in which the design matrix is a Kronecker product of two or more matrices. Given $A_i \in \mathbb{R}^{n_i \times d_i}$ for $i=1,2,\dots,q$ where $n_i \gg d_i$ for each $i$, and $b \in…

Data Structures and Algorithms · Computer Science 2019-10-01 Huaian Diao , Rajesh Jayaram , Zhao Song , Wen Sun , David P. Woodruff

We propose a pseudo-structural framework for analyzing contemporaneous co-movements in reduced-rank matrix autoregressive (RRMAR) models. Unlike conventional vector-autoregressive (VAR) models that would discard the matrix structure, our…

Econometrics · Economics 2025-09-25 Alain Hecq , Ivan Ricardo , Ines Wilms

This article focuses on covariance estimation for multi-study data. Popular approaches employ factor-analytic terms with shared and study-specific loadings that decompose the variance into (i) a shared low-rank component, (ii)…

Methodology · Statistics 2026-01-26 Lorenzo Mauri , Niccolò Anceschi , David B. Dunson

The non-parametric estimation of covariance lies at the heart of functional data analysis, whether for curve or surface-valued data. The case of a two-dimensional domain poses both statistical and computational challenges, which are…

Statistics Theory · Mathematics 2022-01-19 Tomas Masak , Soham Sarkar , Victor M. Panaretos

A polarimetric synthetic aperture radar (PolSAR) system, which uses multiple images acquired with different polarizations in both transmission and reception, has the potential to improve the description and interpretation of the observed…

Signal Processing · Electrical Eng. & Systems 2025-07-08 Dehbia Hanis , Luca Pallotta , Augusto Aubry , Aichouche Belhadj-Aissa , Antonio De Maio

signal direction-of-arrival estimation using an array of sensors has been the subject of intensive research and development during the last two decades. Efforts have been directed to both, better solutions for the general data model and to…

Information Theory · Computer Science 2009-11-13 Farzan Haddadi , Mohammad Mahdi Nayebi , Mohammad Reza Aref

Time series analysis of fMRI data is an important area of medical statistics for neuroimaging data. The neuroimaging community has embraced mean-field variational Bayes (VB) approximations, which are implemented in Statistical Parametric…

Computation · Statistics 2018-03-06 Ming Teng , Timothy Johnson , Farouk Nathoo

Many modern datasets exhibit dependencies among observations as well as variables. A decade ago, Kalaitzis et. al. (2013) proposed the Bigraphical Lasso, an estimator for precision matrices of matrix-normals based on the Cartesian product…

Statistics Theory · Mathematics 2025-12-23 Shuheng Zhou , Kristjan Greenewald

We consider extensions of the Shannon relative entropy, referred to as $f$-divergences.Three classical related computational problems are typically associated with these divergences: (a) estimation from moments, (b) computing normalizing…

Information Theory · Computer Science 2023-09-19 Francis Bach

Mixed-resolution architectures, combining high-resolution (analog) data with coarsely quantized (e.g., 1-bit) data, are widely employed in emerging communication and radar systems to reduce hardware costs and power consumption. However, the…

Signal Processing · Electrical Eng. & Systems 2025-08-29 Yaniv Mazor , Tirza Routtenberg

We consider the problem of joint estimation of structured covariance matrices. Assuming the structure is unknown, estimation is achieved using heterogeneous training sets. Namely, given groups of measurements coming from centered…

Statistics Theory · Mathematics 2016-04-20 Ilya Soloveychik , Ami Wiesel

The goal of this paper is to characterize the best achievable performance for the problem of estimating an unknown parameter having a sparse representation. Specifically, we consider the setting in which a sparsely representable…

Statistics Theory · Mathematics 2009-09-29 Zvika Ben-Haim , Yonina C. Eldar

Data-driven reduced-order models often fail to make accurate forecasts of high-dimensional nonlinear dynamical systems that are sensitive along coordinates with low-variance because such coordinates are often truncated, e.g., by proper…

Systems and Control · Electrical Eng. & Systems 2023-04-14 Samuel E. Otto , Alberto Padovan , Clarence W. Rowley

To achieve the joint active and passive beamforming gains in the reconfigurable intelligent surface assisted millimeter wave system, the reflected cascade channel needs to be accurately estimated. Many strategies have been proposed in the…

Information Theory · Computer Science 2021-09-22 Yiming Liu , Erwu Liu , Rui Wang , Zhu Han , Binyu Lu