English
Related papers

Related papers: Faster Algorithms for Structured Matrix Multiplica…

200 papers

We present a novel recursive algorithm for reducing a symmetric matrix to a triangular factorization which reveals the rank profile matrix. That is, the algorithm computes a factorization $\mathbf{P}^T\mathbf{A}\mathbf{P} =…

Numerical Analysis · Computer Science 2018-03-01 Jean-Guillaume Dumas , Clement Pernet

Lifting is an efficient technique to scale up graphical models generalized to relational domains by exploiting the underlying symmetries. Concurrently, neural models are continuously expanding from grid-like tensor data into structured…

Machine Learning · Computer Science 2021-01-19 Gustav Sourek , Filip Zelezny , Ondrej Kuzelka

We propose a method to simultaneously compute scalar basis functions with an associated functional map for a given pair of triangle meshes. Unlike previous techniques that put emphasis on smoothness with respect to the Laplace--Beltrami…

Graphics · Computer Science 2019-10-01 Omri Azencot , Rongjie Lai

We use lookup tables to design faster algorithms for important algebraic problems over finite fields. These faster algorithms, which only use arithmetic operations and lookup table operations, may help to explain the difficulty of…

Data Structures and Algorithms · Computer Science 2022-11-10 Josh Alman

Lifted probabilistic inference exploits symmetries in a probabilistic model to allow for tractable probabilistic inference with respect to domain sizes of logical variables. We found that the current state-of-the-art algorithm to construct…

Artificial Intelligence · Computer Science 2024-11-21 Malte Luttermann , Ralf Möller , Marcel Gehrke

Group equivariant neural networks are growing in importance owing to their ability to generalise well in applications where the data has known underlying symmetries. Recent characterisations of a class of these networks that use high-order…

Machine Learning · Computer Science 2024-12-17 Edward Pearce-Crump , William J. Knottenbelt

While algebrisation constitutes a powerful technique in the design and analysis of centralised algorithms, to date there have been hardly any applications of algebraic techniques in the context of distributed graph algorithms. This work is…

Distributed, Parallel, and Cluster Computing · Computer Science 2015-03-19 Petteri Kaski , Janne H. Korhonen , Christoph Lenzen , Jukka Suomela

We present a rank-$23$ algorithm for general $3\times3$ matrix multiplication that uses $56$ additions/subtractions and $23$ multiplications, for a total of $79$ scalar operations in the standard bilinear straight-line model. This improves…

Data Structures and Algorithms · Computer Science 2026-05-01 Yinqi Sun

The all pairs shortest path problem (APSP) is one of the foundational problems in computer science. For weighted dense graphs on $n$ vertices, no truly sub-cubic algorithms exist to compute APSP exactly even for undirected graphs. This is…

Data Structures and Algorithms · Computer Science 2023-09-26 Barna Saha , Christopher Ye

Recovering low-rank and sparse matrices from incomplete or corrupted observations is an important problem in machine learning, statistics, bioinformatics, computer vision, as well as signal and image processing. In theory, this problem can…

Machine Learning · Computer Science 2014-09-04 Fanhua Shang , Yuanyuan Liu , Hanghang Tong , James Cheng , Hong Cheng

Tensor decomposition is an effective tool for learning multi-way structures and heterogeneous features from high-dimensional data, such as the multi-view images and multichannel electroencephalography (EEG) signals, are often represented by…

Machine Learning · Computer Science 2022-06-29 Wanguang Yin , Youzhi Qu , Zhengming Ma , Quanying Liu

Fast approximations to matrix multiplication have the potential to dramatically reduce the cost of neural network inference. Recent work on approximate matrix multiplication proposed to replace costly multiplications with table-lookups by…

Machine Learning · Computer Science 2022-07-14 Calvin McCarter , Nicholas Dronen

We present an algorithm to reduce the computational effort for the multiplication of a given matrix with an unknown column vector. The algorithm decomposes the given matrix into a product of matrices whose entries are either zero or integer…

Information Theory · Computer Science 2020-02-28 Ralf R. Müller , Bernhard Gäde , Ali Bereyhi

Decimal multiplication is the task of multiplying two numbers in base $10^N.$ Specifically, we focus on the number-theoretic transform (NTT) family of algorithms. Using only portable techniques, we achieve a 3x-5x speedup over the mpdecimal…

Data Structures and Algorithms · Computer Science 2020-12-11 Viktor Krapivensky

Laderman discovered a scheme for computing the product of two 3x3 matrices using only 23 multiplications in 1976. Since then, some more such schemes were proposed, but it remains open how many there are and whether there exist schemes with…

Logic in Computer Science · Computer Science 2019-08-20 Marijn J. H. Heule , Manuel Kauers , Martina Seidl

Our work addresses the well-known open problem of distributed computing of bilinear functions of two correlated sources ${\bf A}$ and ${\bf B}$. In a setting with two nodes, with the first node having access to ${\bf A}$ and the second to…

Information Theory · Computer Science 2026-05-12 Derya Malak

Previous work identifying depth-optimal $n$-channel sorting networks for $9\leq n \leq 16$ is based on exploiting symmetries of the first two layers. However, the naive generate-and-test approach typically applied does not scale. This paper…

Data Structures and Algorithms · Computer Science 2016-11-30 Michael Codish , Luis Cruz-Filipe , Peter Schneider-Kamp

Gradient descent optimizations and backpropagation are the most common methods for training neural networks, but they are computationally expensive for real time applications, need high memory resources, and are difficult to converge for…

Machine Learning · Computer Science 2022-07-05 Seyyed Mostafa Mousavi Janbeh Sarayi , Mansour Nikkhah Bahrami

Symmetric Nonnegative Matrix Factorization (SymNMF) is a technique in data analysis and machine learning that approximates a symmetric matrix with a product of a nonnegative, low-rank matrix and its transpose. To design faster and more…

Machine Learning · Computer Science 2024-12-02 Koby Hayashi , Sinan G. Aksoy , Grey Ballard , Haesun Park

Given a symmetric nonnegative matrix $A$, symmetric nonnegative matrix factorization (symNMF) is the problem of finding a nonnegative matrix $H$, usually with much fewer columns than $A$, such that $A \approx HH^T$. SymNMF can be used for…

Numerical Analysis · Computer Science 2016-10-07 Arnaud Vandaele , Nicolas Gillis , Qi Lei , Kai Zhong , Inderjit Dhillon