English
Related papers

Related papers: Output-Sparse Matrix Multiplication Using Compress…

200 papers

We exhibit a randomized algorithm which given a matrix $A\in \mathbb{C}^{n\times n}$ with $\|A\|\le 1$ and $\delta>0$, computes with high probability an invertible $V$ and diagonal $D$ such that $\|A-VDV^{-1}\|\le \delta$ using…

Numerical Analysis · Mathematics 2022-07-21 Jess Banks , Jorge Garza-Vargas , Archit Kulkarni , Nikhil Srivastava

Cost-efficient compressive sensing is challenging when facing large-scale data, {\em i.e.}, data with large sizes. Conventional compressive sensing methods for large-scale data will suffer from low computational efficiency and massive…

Data Structures and Algorithms · Computer Science 2016-03-18 Sung-Hsien Hsieh , Chun-Shien Lu , Soo-Chang Pei

In this paper we present a new algorithm for compressive sensing that makes use of binary measurement matrices and achieves exact recovery of ultra sparse vectors, in a single pass and without any iterations. Due to its noniterative nature,…

Information Theory · Computer Science 2018-05-22 Mahsa Lotfi , Mathukumalli Vidyasagar

Randomized sampling has recently been demonstrated to be an efficient technique for computing approximate low-rank factorizations of matrices for which fast methods for computing matrix vector products are available. This paper describes an…

Numerical Analysis · Mathematics 2008-06-17 Per-Gunnar Martinsson

Many real-world data sets are sparse or almost sparse. One method to measure this for a matrix $A\in \mathbb{R}^{n\times n}$ is the \emph{numerical sparsity}, denoted $\mathsf{ns}(A)$, defined as the minimum $k\geq 1$ such that…

Data Structures and Algorithms · Computer Science 2021-07-06 Vladimir Braverman , Robert Krauthgamer , Aditya Krishnan , Shay Sapir

We consider the problem of selecting non-zero entries of a matrix $A$ in order to produce a sparse sketch of it, $B$, that minimizes $\|A-B\|_2$. For large $m \times n$ matrices, such that $n \gg m$ (for example, representing $n$…

Machine Learning · Computer Science 2013-11-20 Dimitris Achlioptas , Zohar Karnin , Edo Liberty

Accelerators for sparse matrix multiplication are important components in emerging systems. In this paper, we study the main challenges of accelerating Sparse Matrix Multiplication (SpMM). For the situations that data is not stored in the…

Hardware Architecture · Computer Science 2019-06-04 Pareesa Ameneh Golnari , Sharad Malik

In this paper, the sparse sensor placement problem for least-squares estimation is considered, and the previous novel approach of the sparse sensor selection algorithm is extended. The maximization of the determinant of the matrix which…

Signal Processing · Electrical Eng. & Systems 2021-05-18 Yuji Saito , Taku Nonomura , Keigo Yamada , Kumi Nakai , Takayuki Nagata , Keisuke Asai , Yasuo Sasaki , Daisuke Tsubakino

Karppa & Kaski (2019) proposed a novel ``broken" or ``opportunistic" matrix multiplication algorithm, based on a variant of Strassen's algorithm, and used this to develop new algorithms for Boolean matrix multiplication, among other tasks.…

Data Structures and Algorithms · Computer Science 2024-09-05 David G. Harris

Matrix completion is a classical problem that has received recurring interest across a wide range of fields. In this paper, we revisit this problem in an ultra-sparse sampling regime, where each entry of an unknown, $n\times d$ matrix $M$…

Machine Learning · Computer Science 2026-01-21 Hongyang R. Zhang , Zhenshuo Zhang , Huy L. Nguyen , Guanghui Lan

We consider the problem of doing fast and reliable estimation of the number of non-zero entries in a sparse boolean matrix product. This problem has applications in databases and computer algebra. Let n denote the total number of non-zero…

Data Structures and Algorithms · Computer Science 2011-02-23 Rasmus Resen Amossen , Andrea Campagna , Rasmus Pagh

In this study, we propose a simple method for fault-tolerant Strassen-like matrix multiplications. The proposed method is based on using two distinct Strassen-like algorithms instead of replicating a given one. We have realized that using…

Distributed, Parallel, and Cluster Computing · Computer Science 2022-10-11 Osman B. Guney , Suayb S. Arslan

Computing the product of two sparse matrices (SpGEMM) is a fundamental operation in various combinatorial and graph algorithms as well as various bioinformatics and data analytics applications for computing inner-product similarities. For…

Distributed, Parallel, and Cluster Computing · Computer Science 2021-11-22 Srđan Milaković , Oguz Selvitopi , Israt Nisa , Zoran Budimlić , Aydin Buluc

Matrix multiplication is a fundamental classical computing operation whose efficiency becomes a major challenge at scale, especially for machine learning applications. Quantum computing, with its inherent parallelism and exponential storage…

Quantum Physics · Physics 2026-02-10 Jiaqi Yao , Ding Liu

Algebraic matrix multiplication algorithms are designed by bounding the rank of matrix multiplication tensors, and then using a recursive method. However, designing algorithms in this way quickly leads to large constant factors: if one…

Computational Complexity · Computer Science 2024-10-29 Josh Alman , Hantao Yu

We present an optimized single-precision implementation of the Sparse Approximate Matrix Multiply (\SpAMM{}) [M. Challacombe and N. Bock, arXiv {\bf 1011.3534} (2010)], a fast algorithm for matrix-matrix multiplication for matrices with…

Numerical Analysis · Computer Science 2012-09-05 Nicolas Bock , Matt Challacombe

Classic cache-oblivious parallel matrix multiplication algorithms achieve optimality either in time or space, but not both, which promotes lots of research on the best possible balance or tradeoff of such algorithms. We study modern…

Distributed, Parallel, and Cluster Computing · Computer Science 2019-11-14 Yuan Tang

This paper presents a quantum algorithm that computes the product of two $n\times n$ Boolean matrices in $\tilde O(n\sqrt{\ell}+\ell\sqrt{n})$ time, where $\ell$ is the number of non-zero entries in the product. This improves the previous…

Quantum Physics · Physics 2021-10-05 François Le Gall

Motivated by studying the power of randomness, certifying algorithms and barriers for fine-grained reductions, we investigate the question whether the multiplication of two $n\times n$ matrices can be performed in near-optimal…

Data Structures and Algorithms · Computer Science 2018-06-26 Marvin Künnemann

Randomized sampling has recently been proven a highly efficient technique for computing approximate factorizations of matrices that have low numerical rank. This paper describes an extension of such techniques to a wider class of matrices…

Numerical Analysis · Mathematics 2015-03-25 Per-Gunnar Martinsson