English
Related papers

Related papers: Compressed Matrix Multiplication

200 papers

The goal of this paper is to get truly subcubic algorithms for Min-Plus product for less structured inputs than what was previously known, and to apply them to versions of All-Pairs Shortest Paths (APSP) and other problems. The results are…

Data Structures and Algorithms · Computer Science 2019-10-14 Virginia Vassilevska Williams , Yinzhan Xu

In this paper we propose an approach to approximate a truncated singular value decomposition of a large structured matrix. By first decomposing the matrix into a sum of Kronecker products, our approach can be used to approximate a large…

Numerical Analysis · Mathematics 2018-04-03 Clarissa Garvey , Chang Meng , James G. Nagy

Variational formulations of reconstruction in computed tomography have the notable drawback of requiring repeated evaluations of both the forward Radon transform and either its adjoint or an approximate inverse transform which are…

Numerical Analysis · Mathematics 2017-05-23 Richard C. Barnard , Rick Archibald

The theory of low-rank tensor-train approximation is well understood when the approximation error is measured in the Frobenius norm. The entrywise maximum norm is equally important but is significantly weaker for large tensors, making the…

Numerical Analysis · Mathematics 2025-04-09 Stanislav Budzinskiy

We consider the problem of selecting the best subset of exactly $k$ columns from an $m \times n$ matrix $A$. We present and analyze a novel two-stage algorithm that runs in $O(\min\{mn^2,m^2n\})$ time and returns as output an $m \times k$…

Data Structures and Algorithms · Computer Science 2015-03-13 Christos Boutsidis , Michael W. Mahoney , Petros Drineas

We consider the matrix completion problem under a form of row/column weighted entrywise sampling, including the case of uniform entrywise sampling as a special case. We analyze the associated random observation operator, and prove that with…

Information Theory · Computer Science 2011-05-17 Sahand Negahban , Martin J. Wainwright

In this paper, we study the problem of approximately computing the product of two real matrices. In particular, we analyze a dimensionality-reduction-based approximation algorithm due to Sarlos [1], introducing the notion of nuclear rank as…

Statistics Theory · Mathematics 2014-04-01 Anastasios Kyrillidis , Michail Vlachos , Anastasios Zouzias

In recent years dynamical modelling has been provided with a range of breakthrough methods to perform exact Bayesian inference. However it is often computationally unfeasible to apply exact statistical methodologies in the context of large…

Computation · Statistics 2014-12-24 Umberto Picchini , Julie Lyng Forman

Orthogonalization is one of few mathematical methods conforming to mathematical standards for approximation. Finding a consistent PC matrix of a given an inconsistent PC matrix is the main goal of a pairwise comparisons method. We introduce…

Numerical Analysis · Mathematics 2024-04-25 Julio Benitez , Waldemar W. Koczkodaj , Adam Kowalczyk

In this paper, a polynomial-time algorithm is given to compute the generalized Hermite normal form for a matrix F over Z[x], or equivalently, the reduced Groebner basis of the Z[x]-module generated by the column vectors of F. The algorithm…

Symbolic Computation · Computer Science 2016-07-22 Rui-Juan Jing , Chun-Ming Yuan , Xiao-Shan Gao

We show how the massive data compression algorithm MOPED can be used to reduce, by orders of magnitude, the number of simulated datasets that are required to estimate the covariance matrix required for the analysis of gaussian-distributed…

Cosmology and Nongalactic Astrophysics · Physics 2017-10-18 Alan Heavens , Elena Sellentin , Damien de Mijolla , Alvise Vianello

As nowadays Machine Learning (ML) techniques are generating huge data collections, the problem of how to efficiently engineer their storage and operations is becoming of paramount importance. In this article we propose a new lossless…

Data Structures and Algorithms · Computer Science 2022-03-31 Paolo Ferragina , Travis Gagie , Dominik Köppl , Giovanni Manzini , Gonzalo Navarro , Manuel Striani , Francesco Tosoni

We consider the problem of approximating a truncated Gaussian kernel using Fourier (trigonometric) functions. The computation-intensive bilateral filter can be expressed using fast convolutions by applying such an approximation to its range…

Image and Video Processing · Electrical Eng. & Systems 2018-11-07 Sanjay Ghosh , Pravin Nair , Kunal N. Chaudhury

We analyze a weighted Frobenius loss for approximating symmetric positive definite matrices in the context of preconditioning iterative solvers. Unlike the standard Frobenius norm, the weighted loss penalizes error components associated…

Numerical Analysis · Mathematics 2025-09-23 Vladislav Trifonov , Ivan Oseledets , Ekaterina Muravleva

A common data analysis task is the reduced-rank regression problem: $$\min_{\textrm{rank-}k \ X} \|AX-B\|,$$ where $A \in \mathbb{R}^{n \times c}$ and $B \in \mathbb{R}^{n \times d}$ are given large matrices and $\|\cdot\|$ is some norm.…

Data Structures and Algorithms · Computer Science 2021-07-02 Praneeth Kacham , David P. Woodruff

Boolean matrix factorisation aims to decompose a binary data matrix into an approximate Boolean product of two low rank, binary matrices: one containing meaningful patterns, the other quantifying how the observations can be expressed as a…

Machine Learning · Statistics 2017-02-28 Tammo Rukat , Chris C. Holmes , Michalis K. Titsias , Christopher Yau

We consider the problem of secure distributed matrix multiplication in which a user wishes to compute the product of two matrices with the assistance of honest but curious servers. We show how to construct polynomial schemes for the outer…

Information Theory · Computer Science 2024-05-13 Ryann Cartor , Rafael G. L. D'Oliveira , Salim El Rouayheb , Daniel Heinlein , David Karpuk , Alex Sprintson

We describe an algorithm for computing, for all primes $p \leq X$, the mod-$p$ reduction of the trace of Frobenius at $p$ of a fixed hypergeometric motive in time quasilinear in $X$. This combines the Beukers--Cohen--Mellit trace formula…

Number Theory · Mathematics 2020-09-22 Edgar Costa , Kiran S. Kedlaya , David Roe

Nonnegative matrix factorization is the following problem: given a nonnegative input matrix $V$ and a factorization rank $K$, compute two nonnegative matrices, $W$ with $K$ columns and $H$ with $K$ rows, such that $WH$ approximates $V$ as…

Optimization and Control · Mathematics 2025-01-10 Valentin Leplat , Yurii Nesterov , Nicolas Gillis , François Glineur

What learning algorithms can be run directly on compressively-sensed data? In this work, we consider the question of accurately and efficiently computing low-rank matrix or tensor factorizations given data compressed via random projections.…

Machine Learning · Computer Science 2019-05-28 Vatsal Sharan , Kai Sheng Tai , Peter Bailis , Gregory Valiant