English
Related papers

Related papers: Universal Solution to Kronecker Product Decomposit…

200 papers

SVD (singular value decomposition) is one of the basic tools of machine learning, allowing to optimize basis for a given matrix. However, sometimes we have a set of matrices $\{A_k\}_k$ instead, and would like to optimize a single common…

Machine Learning · Computer Science 2022-04-19 Jarek Duda

Stabilizing autonomous linear time delay systems, particularly when addressing an unlimited number of pointwise and distributed delays (DDs) under dissipative constraints, poses a significant challenge. Existing solutions are often hindered…

Optimization and Control · Mathematics 2026-04-13 Qian Feng , Wei Xing Zheng , Feng Xiao , Xiaoyu Wang

Canonical polyadic decomposition (CPD) is at the core of fast matrix multiplication, a computational problem with widespread implications across several seemingly unrelated problems in computer science. Much recent progress in this field…

Computational Complexity · Computer Science 2025-11-11 Jason Yang

Our main result is an elementary derivation of the spectral decomposition of hypermatrices generated by arbitrary combinations of Kronecker products and direct sums of cubic side length 2

Spectral Theory · Mathematics 2016-08-09 Yuval Filmus , Edinah K. Gnang

The dynamic mode decomposition (DMD) is a broadly applicable dimensionality reduction algorithm that approximates a matrix containing time-series data by the outer product of a matrix of exponentials, representing Fourier-like time…

Optimization and Control · Mathematics 2017-12-07 Travis Askham , Peng Zheng , Aleksandr Aravkin , J. Nathan Kutz

In this paper we investigate the use of half-precision Kronecker product singular value decomposition (SVD) approximations as preconditioners for large-scale Tikhonov regularized least squares problems. Half precision reduces storage…

Numerical Analysis · Mathematics 2023-11-28 Yizhou Chen , Xiang Ji , James Nagy

Kronecker regression is a highly-structured least squares problem $\min_{\mathbf{x}} \lVert \mathbf{K}\mathbf{x} - \mathbf{b} \rVert_{2}^2$, where the design matrix $\mathbf{K} = \mathbf{A}^{(1)} \otimes \cdots \otimes \mathbf{A}^{(N)}$ is…

Data Structures and Algorithms · Computer Science 2023-05-15 Matthew Fahrbach , Thomas Fu , Mehrdad Ghadiri

Canonical Polyadic Decomposition (CPD) of a higher-order tensor is decomposition in a minimal number of rank-1 tensors. We give an overview of existing results concerning uniqueness. We present new, relaxed, conditions that guarantee…

Spectral Theory · Mathematics 2013-07-05 Ignat Domanov , Lieven De Lathauwer

The Canonical Polyadic decomposition (CPD) is a convenient and intuitive tool for tensor factorization; however, for higher-order tensors, it often exhibits high computational cost and permutation of tensor entries, these undesirable…

Numerical Analysis · Computer Science 2018-09-05 Anh-Huy Phan , Andrzej Cichocki , Ivan Oseledets , Salman Ahmadi Asl , Giuseppe Calvi , Danilo Mandic

The existence of decompositions of the nonlinear integrable systems not only permits us to establish so-called linear superposition solutions but also to derive new nonlinear integrable coupled systems. Restricting our attention to the…

Exactly Solvable and Integrable Systems · Physics 2022-05-18 Xiazhi Hao , S. Y. Lou

Dictionary learning and component analysis models are fundamental for learning compact representations that are relevant to a given task (feature extraction, dimensionality reduction, denoising, etc.). The model complexity is encoded by…

Machine Learning · Statistics 2018-11-13 Mehdi Bahri , Yannis Panagakis , Stefanos Zafeiriou

We propose a new hypermatrix singular value decomposition based upon the spectral decomposition of the symmetric products of transposes.

Spectral Theory · Mathematics 2020-04-23 Edinah K. Gnang , Fan Tian

Canonical Polyadic (or CANDECOMP/PARAFAC, CP) decompositions (CPD) are widely applied to analyze high order tensors. Existing CPD methods use alternating least square (ALS) iterations and hence need to unfold tensors to each of the $N$…

Numerical Analysis · Computer Science 2013-06-27 Guoxu Zhou , Andrzej Cichocki , Shengli Xie

The randomized singular value decomposition (SVD) is a popular and effective algorithm for computing a near-best rank $k$ approximation of a matrix $A$ using matrix-vector products with standard Gaussian vectors. Here, we generalize the…

Numerical Analysis · Mathematics 2022-01-24 Nicolas Boullé , Alex Townsend

Geometric methods have useful application for solving problems in a range of quantum information disciplines, including the synthesis of time-optimal unitaries in quantum control. In particular, the use of Cartan decompositions to solve…

Quantum Physics · Physics 2024-04-04 Elija Perrier , Christopher S. Jackson

The Dynamic-Mode Decomposition (DMD) is a well established data-driven method of finding temporally evolving linear-mode decompositions of nonlinear time series. Traditionally, this method presumes that all relevant dimensions are sampled…

Dynamical Systems · Mathematics 2021-01-13 Christopher W. Curtis , Daniel Jay Alford-Lago

This paper considers the problem of updating the rank-k truncated Singular Value Decomposition (SVD) of matrices subject to the addition of new rows and/or columns over time. Such matrix problems represent an important computational kernel…

In this paper, we describe a low-rank matrix completion method based on matrix decomposition. An incomplete matrix is decomposed into submatrices which are filled with a proposed trimming step and then are recombined to form a low-rank…

Numerical Analysis · Mathematics 2010-06-29 Rick Ma , Samuel Cheng

We investigate a novel approach to approximate tensor-network contraction via the exact, matrix-free decomposition of full tensor-networks. We study this method as a means to eliminate the propagation of error in the approximation of…

Chemical Physics · Physics 2025-06-23 Karl Pierce

We consider an $\ell_1$-regularized inverse problem where both the forward and regularization operators have a Kronecker product structure. By leveraging this structure, a joint decomposition can be obtained using generalized singular value…

Numerical Analysis · Mathematics 2024-09-04 Brian Sweeney , Malena I. Español , Rosemary Renaut