English
Related papers

Related papers: How to Fake Multiply by a Gaussian Matrix

200 papers

We exhibit a randomized algorithm which given a matrix $A\in \mathbb{C}^{n\times n}$ with $\|A\|\le 1$ and $\delta>0$, computes with high probability an invertible $V$ and diagonal $D$ such that $\|A-VDV^{-1}\|\le \delta$ using…

Numerical Analysis · Mathematics 2022-07-21 Jess Banks , Jorge Garza-Vargas , Archit Kulkarni , Nikhil Srivastava

Motivated by studying the power of randomness, certifying algorithms and barriers for fine-grained reductions, we investigate the question whether the multiplication of two $n\times n$ matrices can be performed in near-optimal…

Data Structures and Algorithms · Computer Science 2018-06-26 Marvin Künnemann

In this article, we consider the general problem of checking the correctness of matrix multiplication. Given three $n \times n$ matrices $A$, $B$, and $C$, the goal is to verify that $A \times B=C$ without carrying out the computationally…

Data Structures and Algorithms · Computer Science 2017-05-31 Hao Ji , Michael Mascagni , Yaohang Li

Algebraic matrix multiplication algorithms are designed by bounding the rank of matrix multiplication tensors, and then using a recursive method. However, designing algorithms in this way quickly leads to large constant factors: if one…

Computational Complexity · Computer Science 2024-10-29 Josh Alman , Hantao Yu

In the Nonnegative Matrix Factorization (NMF) problem we are given an $n \times m$ nonnegative matrix $M$ and an integer $r > 0$. Our goal is to express $M$ as $A W$ where $A$ and $W$ are nonnegative matrices of size $n \times r$ and $r…

Data Structures and Algorithms · Computer Science 2011-11-04 Sanjeev Arora , Rong Ge , Ravi Kannan , Ankur Moitra

In this paper we present two different variants of method for symmetric matrix inversion, based on modified Gaussian elimination. Both methods avoid computation of square roots and have a reduced machine time's spending. Further, both of…

Mathematical Software · Computer Science 2015-04-28 Anton Kochnev , Nicolai Savelov

We provide faster randomized algorithms for computing an $\epsilon$-optimal policy in a discounted Markov decision process with $A_{\text{tot}}$-state-action pairs, bounded rewards, and discount factor $\gamma$. We provide an…

Machine Learning · Computer Science 2024-05-22 Yujia Jin , Ishani Karmarkar , Aaron Sidford , Jiayi Wang

Randomized sampling has recently been demonstrated to be an efficient technique for computing approximate low-rank factorizations of matrices for which fast methods for computing matrix vector products are available. This paper describes an…

Numerical Analysis · Mathematics 2008-06-17 Per-Gunnar Martinsson

We provide faster algorithms and improved sample complexities for approximating the top eigenvector of a matrix. Offline Setting: Given an $n \times d$ matrix $A$, we show how to compute an $\epsilon$ approximate top eigenvector in time…

Data Structures and Algorithms · Computer Science 2016-05-31 Chi Jin , Sham M. Kakade , Cameron Musco , Praneeth Netrapalli , Aaron Sidford

We present a simple randomized polynomial time algorithm to approximate the mixed discriminant of $n$ positive semidefinite $n \times n$ matrices within a factor $2^{O(n)}$. Consequently, the algorithm allows us to approximate in randomized…

Rings and Algebras · Mathematics 2008-02-03 Alexander Barvinok

Let $K$ be a field. Let $f\in K[[x_{1},...,x_{r}]]$ and $g\in K[[y_{1},...,y_{s}]]$ be nonzero elements. If $X$ (resp. $Y$) is a matrix factorization of $f$ (resp. $g$), Yoshino had constructed a tensor product (of matrix factorizations)…

Category Theory · Mathematics 2022-07-05 Yves Baudelaire Fomatati

Matrix square roots and their inverses arise frequently in machine learning, e.g., when sampling from high-dimensional Gaussians $\mathcal{N}(\mathbf 0, \mathbf K)$ or whitening a vector $\mathbf b$ against covariance matrix $\mathbf K$.…

Machine Learning · Computer Science 2020-12-02 Geoff Pleiss , Martin Jankowiak , David Eriksson , Anil Damle , Jacob R. Gardner

Recent work in machine learning community proposed multiple methods for performing lossy compression (quantization) of large matrices. This quantization is important for accelerating matrix multiplication (main component of large language…

Information Theory · Computer Science 2025-10-16 Or Ordentlich , Yury Polyanskiy

We give a self-contained randomized algorithm based on shifted inverse iteration which provably computes the eigenvalues of an arbitrary matrix $M\in\mathbb{C}^{n\times n}$ up to backward error $\delta\|M\|$ in…

Numerical Analysis · Mathematics 2022-05-16 Jess Banks , Jorge Garza-Vargas , Nikhil Srivastava

We present an algorithm that, with high probability, generates a random spanning tree from an edge-weighted undirected graph in $\tilde{O}(n^{4/3}m^{1/2}+n^{2})$ time (The $\tilde{O}(\cdot)$ notation hides $\operatorname{polylog}(n)$…

Data Structures and Algorithms · Computer Science 2017-06-22 David Durfee , Rasmus Kyng , John Peebles , Anup B. Rao , Sushant Sachdeva

We discuss an approach to compute the first and second moments of the number of eigenvalues $I_N$ that lie in an arbitrary interval of the real line for $N \times N$ Gaussian random matrices. The method combines the standard…

Statistical Mechanics · Physics 2017-11-22 Fernando L. Metz

Gaussian mixture models (GMMs) are fundamental tools in statistical and data sciences. We study the moments of multivariate Gaussians and GMMs. The $d$-th moment of an $n$-dimensional random variable is a symmetric $d$-way tensor of size…

Machine Learning · Statistics 2022-03-23 João M. Pereira , Joe Kileel , Tamara G. Kolda

In addition to recent developments in computing speed and memory, methodological advances have contributed to significant gains in the performance of stochastic simulation. In this paper, we focus on variance reduction for matrix…

Machine Learning · Statistics 2023-03-28 Anant Mathur , Sarat Moka , Zdravko Botev

We present RXTX, a new algorithm for computing the product of matrix by its transpose $XX^{t}$ for $X\in \mathbb{R}^{n\times m}$. RXTX uses $5\%$ fewer multiplications and $5\%$ fewer operations (additions and multiplications) than…

Data Structures and Algorithms · Computer Science 2025-05-19 Dmitry Rybin , Yushun Zhang , Zhi-Quan Luo

In this study, we propose a simple method for fault-tolerant Strassen-like matrix multiplications. The proposed method is based on using two distinct Strassen-like algorithms instead of replicating a given one. We have realized that using…

Distributed, Parallel, and Cluster Computing · Computer Science 2022-10-11 Osman B. Guney , Suayb S. Arslan
‹ Prev 1 2 3 10 Next ›