English
Related papers

Related papers: Faster Algorithms for Structured Matrix Multiplica…

200 papers

Flip graphs were recently introduced in order to discover new matrix multiplication methods for matrix sizes. The technique applies to other tensors as well. In this paper, we explore how it performs for polynomial multiplication.

Symbolic Computation · Computer Science 2025-02-11 Shaoshi Chen , Manuel Kauers

Obeying constraints imposed by classical physics, we give optimal fine-grained algorithms for matrix multiplication and problems involving graphs and mazes, where all calculations are done in 3-dimensional space. We assume that whatever the…

Data Structures and Algorithms · Computer Science 2024-12-20 Quentin F. Stout

Matrix multiplication is a fundamental kernel in high performance computing. Many algorithms for fast matrix multiplication can only be applied to enormous matrices ($n>10^{100}$) and thus cannot be used in practice. Of all algorithms…

Data Structures and Algorithms · Computer Science 2025-08-05 Oded Schwartz , Eyal Zwecher

We provide a computational framework for approximating a class of structured matrices; here, the term structure is very general, and may refer to a regular sparsity pattern (e.g., block-banded), or be more highly structured (e.g., symmetric…

Numerical Analysis · Mathematics 2021-05-05 Misha E. Kilmer , Arvind K. Saibaba

We present a new paradigm for speeding up randomized computations of several frequently used functions in machine learning. In particular, our paradigm can be applied for improving computations of kernels based on random embeddings. Above…

Machine Learning · Statistics 2016-04-26 Krzysztof Choromanski , Francois Fagan

Moosbauer and Poole have recently shown that the multiplication of two $5\times 5$ matrices requires no more than 93 multiplications in the (possibly non-commutative) coefficient ring, and that the multiplication of two $6\times 6$ matrices…

Symbolic Computation · Computer Science 2025-05-12 Manuel Kauers , Isaac Wood

We develop an automated framework for proving lower bounds on the bilinear complexity of matrix multiplication over finite fields. Our approach systematically combines orbit classification of the restricted first matrix and dynamic…

Computational Complexity · Computer Science 2026-05-19 Chengu Wang

We present a new algorithm for fast matrix multiplication using tensor decompositions which have special features. Thanks to these features we obtain exponents lower than what the rank of the tensor decomposition suggests. In particular for…

Symbolic Computation · Computer Science 2026-05-22 Manuel Kauers , Jakob Moosbauer , Isaac Wood

In this paper, we propose a general framework to accelerate significantly the algorithms for nonnegative matrix factorization (NMF). This framework is inspired from the extrapolation scheme used to accelerate gradient methods in convex…

Numerical Analysis · Computer Science 2020-01-14 Andersen Man Shun Ang , Nicolas Gillis

Let {\alpha} be the maximal value such that the product of an n x n^{\alpha} matrix by an n^{\alpha} x n matrix can be computed with n^{2+o(1)} arithmetic operations. In this paper we show that \alpha>0.30298, which improves the previous…

Data Structures and Algorithms · Computer Science 2021-10-05 François Le Gall

We propose a non-commutative algorithm for multiplying 2x2 matrices using 7 coefficient products. This algorithm reaches simultaneously a better accuracy in practice compared to previously known such fast algorithms, and a time complexity…

Numerical Analysis · Mathematics 2024-07-01 Jean-Guillaume Dumas , Clément Pernet , Alexandre Sedoglavic

We propose a more accurate variant of an algorithm for multiplying 4x4 matrices using 48 multiplications over any ring containing an inverse of 2. This algorithm has an error bound exponent of only log 4 $\gamma$$\infty$,2 $\approx$ 2.386.…

Data Structures and Algorithms · Computer Science 2026-03-20 Jean-Guillaume Dumas , Clément Pernet , Alexandre Sedoglavic

This paper gives simple distributed algorithms for the fundamental problem of computing graph distances in the Congested Clique model. One of the main components of our algorithms is fast matrix multiplication, for which we show an…

Distributed, Parallel, and Cluster Computing · Computer Science 2015-03-24 Keren Censor-Hillel , Ami Paz

Symmetric nonnegative matrix factorization (NMF), a special but important class of the general NMF, is demonstrated to be useful for data analysis and in particular for various clustering tasks. Unfortunately, designing fast algorithms for…

Machine Learning · Computer Science 2018-11-15 Zhihui Zhu , Xiao Li , Kai Liu , Qiuwei Li

For smooth finite fields $F_q$ (i.e., when $q-1$ factors into small primes) the Fast Fourier Transform (FFT) leads to the fastest known algebraic algorithms for many basic polynomial operations, such as multiplication, division,…

Data Structures and Algorithms · Computer Science 2021-10-13 Eli Ben-Sasson , Dan Carmon , Swastik Kopparty , David Levit

We present new quantum algorithms for Triangle Finding improving its best previously known quantum query complexities for both dense and spare instances.For dense graphs on $n$ vertices, we get a query complexity of $O(n^{5/4})$ without any…

Quantum Physics · Physics 2016-10-13 Titouan Carette , Mathieu Laurière , Frédéric Magniez

Symmetric Nonnegative Matrix Factorization (SNMF) models arise naturally as simple reformulations of many standard clustering algorithms including the popular spectral clustering method. Recent work has demonstrated that an elementary…

Computer Vision and Pattern Recognition · Computer Science 2016-09-20 Reza Borhani , Jeremy Watt , Aggelos Katsaggelos

This work focuses on accelerating the multiplication of a dense random matrix with a (fixed) sparse matrix, which is frequently used in sketching algorithms. We develop a novel scheme that takes advantage of blocking and recomputation…

Computational Engineering, Finance, and Science · Computer Science 2024-05-14 Tianyu Liang , Riley Murray , Aydın Buluç , James Demmel

Let $\K$ be an algebraic number field of degree $d$ and discriminant $\Delta$ over $\Q$. Let $\A$ be an associative algebra over $\K$ given by structure constants such that $\A\cong M_n(\K)$ holds for some positive integer $n$. Suppose that…

Rings and Algebras · Mathematics 2014-07-11 Gábor Ivanyos , Ádám D. Lelkes , Lajos Rónyai

This is the second in a series of papers on rank decompositions of the matrix multiplication tensor. We present new rank $23$ decompositions for the $3\times 3$ matrix multiplication tensor $M_{\langle 3\rangle}$. All our decompositions…

Computational Complexity · Computer Science 2018-01-04 Grey Ballard , Christian Ikenmeyer , J. M. Landsberg , Nick Ryder