English
Related papers

Related papers: Fast structured matrix computations: tensor rank a…

200 papers

This paper develops fast and efficient algorithms for computing Tucker decomposition with a given multilinear rank. By combining random projection and the power scheme, we propose two efficient randomized versions for the truncated…

Numerical Analysis · Mathematics 2023-03-22 Maolin Che , Yimin Wei , Hong Yan

Simulating and developing large rectangularly shaped arrays with equidistant interspacing is challenging as the computational complexity grows quickly with array size. However, the geometrical shape of the array, appropriately meshed, leads…

Numerical Analysis · Mathematics 2025-06-26 Harald Hultin , Lucas Åkerstedt , B. L. G. Jonsson

Fast matrix multiplication is one of the most fundamental problems in algorithm research. The exponent of the optimal time complexity of matrix multiplication is usually denoted by $\omega$. This paper discusses new ideas for improving the…

Data Structures and Algorithms · Computer Science 2023-11-29 Ran Duan , Hongxun Wu , Renfei Zhou

Since its introduction by Gauss, Matrix Algebra has facilitated understanding of scientific problems, hiding distracting details and finding more elegant and efficient ways of computational solving. Today's largest problems, which often…

Numerical Analysis · Computer Science 2010-02-01 Oleksii Morozov , Patrick Hunziker

Matrix multiplication is a cornerstone operation in a wide array of scientific fields, including machine learning and computer graphics. The standard algorithm for matrix multiplication has a complexity of $\mathcal{O}(n^3)$ for $n\times n$…

Hardware Architecture · Computer Science 2024-06-05 Afzal Ahmad , Linfeng Du , Wei Zhang

We develop numerical algorithms for the efficient evaluation of quantities associated with generalized matrix functions [J. B. Hawkins and A. Ben-Israel, Linear and Multilinear Algebra 1(2), 1973, pp. 163-171]. Our algorithms are based on…

Numerical Analysis · Mathematics 2015-12-10 Francesca Arrigo , Michele Benzi , Caterina Fenu

In order to find the outcome probabilities of quantum mechanical systems like the optical networks underlying Boson sampling, it is necessary to be able to compute the permanents of unitary matrices, a computationally hard task. Here we…

Quantum Physics · Physics 2022-02-10 P. H. Lundow , K. Markström

We develop lower bounds on communication in the memory hierarchy or between processors for nested bilinear algorithms, such as Strassen's algorithm for matrix multiplication. We build on a previous framework that establishes communication…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-09-29 Caleb Ju , Yifan Zhang , Edgar Solomonik

Tensor Kronecker products, the natural generalization of the matrix Kronecker product, are independently emerging in multiple research communities. Like their matrix counterpart, the tensor generalization gives structure for implicit…

Social and Information Networks · Computer Science 2022-06-14 Charles Colley , Huda Nassar , David Gleich

We propose an inner product free iterative method called GP-CMRH for solving block two-by-two nonsymmetric linear systems. GP-CMRH relies on a new simultaneous Hessenberg process that reduces two rectangular matrices to upper Hessenberg…

Numerical Analysis · Mathematics 2025-09-16 Kui Du , Jia-Jun Fan

This paper deals with simultaneously fast and in-place algorithms for formulae where the result has to be linearly accumulated: some output variables are also input variables, linked by a linear dependency. Fundamental examples include the…

Symbolic Computation · Computer Science 2025-11-07 Jean-Guillaume Dumas , Bruno Grenet

We present a new algorithm for fast matrix multiplication using tensor decompositions which have special features. Thanks to these features we obtain exponents lower than what the rank of the tensor decomposition suggests. In particular for…

Symbolic Computation · Computer Science 2026-05-22 Manuel Kauers , Jakob Moosbauer , Isaac Wood

Matrix multiplication is a fundamental kernel in high performance computing. Many algorithms for fast matrix multiplication can only be applied to enormous matrices ($n>10^{100}$) and thus cannot be used in practice. Of all algorithms…

Data Structures and Algorithms · Computer Science 2025-08-05 Oded Schwartz , Eyal Zwecher

Tensor-based methods have been widely studied to attack inverse problems in hyperspectral imaging since a hyperspectral image (HSI) cube can be naturally represented as a third-order tensor, which can perfectly retain the spatial…

Computer Vision and Pattern Recognition · Computer Science 2022-01-05 Lianru Gao , Zhicheng Wang , Lina Zhuang , Haoyang Yu , Bing Zhang , Jocelyn Chanussot

Efficiently processing basic linear algebra subroutines is of great importance for a wide range of computational problems. In this paper, we consider techniques to implement matrix functions on a quantum computer, which are composed of…

Quantum Physics · Physics 2019-02-28 Liming Zhao , Zhikuan Zhao , Patrick Rebentrost , Joseph Fitzsimons

Algebraic matrix multiplication algorithms are designed by bounding the rank of matrix multiplication tensors, and then using a recursive method. However, designing algorithms in this way quickly leads to large constant factors: if one…

Computational Complexity · Computer Science 2024-10-29 Josh Alman , Hantao Yu

We propose a general method for optimally approximating an arbitrary matrix $\mathbf{M}$ by a structured matrix $\mathbf{T}$ (circulant, Toeplitz/Hankel, etc.) and examine its use for estimating the spectra of genomic linkage disequilibrium…

Applications · Statistics 2024-09-10 Chris Salahub , Jeffrey Uhlmann

We describe a fast solver for linear systems with reconstructable Cauchy-like structure, which requires O(rn^2) floating point operations and O(rn) memory locations, where n is the size of the matrix and r its displacement rank. The solver…

Numerical Analysis · Mathematics 2021-09-21 Antonio Arico' , Giuseppe Rodriguez

Matrix-valued optimization tasks, including those involving symmetric positive definite (SPD) matrices, arise in a wide range of applications in machine learning, data science and statistics. Classically, such problems are solved via…

Optimization and Control · Mathematics 2024-10-15 Andrew Cheng , Melanie Weber

We consider the problem of joint estimation of structured covariance matrices. Assuming the structure is unknown, estimation is achieved using heterogeneous training sets. Namely, given groups of measurements coming from centered…

Statistics Theory · Mathematics 2016-04-20 Ilya Soloveychik , Ami Wiesel