English
Related papers

Related papers: The Input/Output Complexity of Sparse Matrix Multi…

200 papers

The Massively Parallel Computation (MPC) model serves as a common abstraction of many modern large-scale parallel computation frameworks and has recently gained a lot of importance, especially in the context of classic graph problems.…

Data Structures and Algorithms · Computer Science 2018-07-20 Sebastian Brandt , Manuela Fischer , Jara Uitto

In this paper, we show a way to exploit sparsity in the problem data in a primal-dual potential reduction method for solving a class of semidefinite programs. When the problem data is sparse, the dual variable is also sparse, but the primal…

Numerical Analysis · Mathematics 2025-10-20 Gun Srijuntongsiri , Stephen A. Vavasis

The matricized-tensor times Khatri-Rao product computation is the typical bottleneck in algorithms for computing a CP decomposition of a tensor. In order to develop high performance sequential and parallel algorithms, we establish…

Distributed, Parallel, and Cluster Computing · Computer Science 2017-10-24 Grey Ballard , Nicholas Knight , Kathryn Rouse

Block projections have been used, in [Eberly et al. 2006], to obtain an efficient algorithm to find solutions for sparse systems of linear equations. A bound of softO(n^(2.5)) machine operations is obtained assuming that the input matrix…

Symbolic Computation · Computer Science 2025-10-20 Wayne Eberly , Mark Giesbrecht , Pascal Giorgi , Arne Storjohann , Gilles Villard

The computational cost of many signal processing and machine learning techniques is often dominated by the cost of applying certain linear operators to high-dimensional vectors. This paper introduces an algorithm aimed at reducing the…

Machine Learning · Computer Science 2016-03-30 Luc Le Magoarou , Rémi Gribonval

We consider the time and space required for quantum computers to solve a wide variety of problems involving matrices, many of which have only been analyzed classically in prior work. Our main results show that for a range of linear algebra…

Computational Complexity · Computer Science 2025-11-03 Paul Beame , Niels Kornerup , Michael Whitmeyer

Recently, Pagh presented a randomized approximation algorithm for the multiplication of real-valued matrices building upon work for detecting the most frequent items in data streams. We continue this line of research and present new {\em…

Data Structures and Algorithms · Computer Science 2012-09-21 Konstantin Kutzkov

Matrix scaling problems with sparse cost matrices arise frequently in various domains, such as optimal transport, image processing, and machine learning. The Sinkhorn-Knopp algorithm is a popular iterative method for solving these problems,…

Optimization and Control · Mathematics 2024-06-26 Jose Rafael Espinosa Mena

This paper addresses spatial programming of sparse matrix computations for productive performance. The challenge is how to express an irregular computation and its optimizations in a regular way. A sparse matrix has (non-zero) values and a…

Mathematical Software · Computer Science 2018-10-18 Hongbo Rong

We consider the problem of preprocessing an $n\times n$ matrix $\mathbf{M}$, and supporting queries that, for any vector $v$, returns the matrix-vector product $\mathbf{M} v$. This problem has been extensively studied in both theory and…

Data Structures and Algorithms · Computer Science 2026-02-10 Emile Anand , Jan van den Brand , Rose McCarty

Can linear systems be solved faster than matrix multiplication? While there has been remarkable progress for the special cases of graph structured linear systems, in the general setting, the bit complexity of solving an $n \times n$ linear…

Data Structures and Algorithms · Computer Science 2021-01-08 Richard Peng , Santosh Vempala

This paper presents a novel approach at the intersection of machine learning and number theory, focusing on the classification of prime and non-prime numbers. At the core of our research is the development of a highly sparse encoding…

Number Theory · Mathematics 2026-04-01 Serin Lee , S. Kim

We consider the problem of selecting non-zero entries of a matrix $A$ in order to produce a sparse sketch of it, $B$, that minimizes $\|A-B\|_2$. For large $m \times n$ matrices, such that $n \gg m$ (for example, representing $n$…

Machine Learning · Computer Science 2013-11-20 Dimitris Achlioptas , Zohar Karnin , Edo Liberty

This article presents a new method to compute matrices from numerical simulations based on the ideas of sparse sampling and compressed sensing. The method is useful for problems where the determination of the entries of a matrix constitutes…

Chemical Physics · Physics 2014-10-21 Jacob N. Sanders , Xavier Andrade , Alán Aspuru-Guzik

We extend the theory of low-rank matrix recovery and completion to the case when Poisson observations for a linear combination or a subset of the entries of a matrix are available, which arises in various applications with count data. We…

Machine Learning · Computer Science 2016-04-20 Yang Cao , Yao Xie

The aim of this paper is to prove the achievability of several coding problems by using sparse matrices (the maximum column weight grows logarithmically in the block length) and maximal-likelihood (ML) coding. These problems are the…

Information Theory · Computer Science 2013-01-28 Jun Muramatsu , Shigeki Miyake

Min-plus product of two $n\times n$ matrices is a fundamental problem in algorithm research. It is known to be equivalent to APSP, and in general it has no truly subcubic algorithms. In this paper, we focus on the min-plus product on a…

Data Structures and Algorithms · Computer Science 2022-02-03 Shucheng Chi , Ran Duan , Tianle Xie

We develop several efficient algorithms for the classical \emph{Matrix Scaling} problem, which is used in many diverse areas, from preconditioning linear systems to approximation of the permanent. On an input $n\times n$ matrix $A$, this…

Data Structures and Algorithms · Computer Science 2017-04-10 Zeyuan Allen-Zhu , Yuanzhi Li , Rafael Oliveira , Avi Wigderson

Quantum annealing is a promising approach for solving combinatorial optimization problems. However, its performance is often limited by the overhead of additional qubits required for embedding logical QUBO models onto quantum annealers.…

Quantum Physics · Physics 2026-01-27 Kohei Suda , Soshun Naito , Yoshihiko Hasegawa

This is the second of two papers to describe a matrix sparsification algorithm that takes a general real or complex matrix as input and produces a sparse output matrix of the same size. The first paper presented the original algorithm, its…

Numerical Analysis · Mathematics 2013-04-29 Chetan Jhurani