English
Related papers

Related papers: Sparse matrix factorizations for fast linear solve…

200 papers

Iterative methods based on matrix splittings are useful in solving large sparse linear systems. In this direction, proper splittings and its several extensions are used to deal with singular and rectangular linear systems. In this article,…

Numerical Analysis · Mathematics 2019-07-08 Ashish Kumar Nandi , Jajati Keshari Sahoo , Debasisha Mishra

We present new algorithms to detect and correct errors in the product of two matrices, or the inverse of a matrix, over an arbitrary field. Our algorithms do not require any additional information or encoding other than the original inputs…

Symbolic Computation · Computer Science 2018-02-08 Daniel S. Roche

In this letter, we propose an algorithm for recovery of sparse and low rank components of matrices using an iterative method with adaptive thresholding. In each iteration, the low rank and sparse components are obtained using a thresholding…

Numerical Analysis · Computer Science 2017-04-13 Nematollah Zarmehi , Farokh Marvasti

Recently, a class of algorithms combining classical fixed point iterations with repeated random sparsification of approximate solution vectors has been successfully applied to eigenproblems with matrices as large as $10^{108} \times…

Numerical Analysis · Mathematics 2025-04-28 Jonathan Weare , Robert J. Webber

Matrix factorization exploits the idea that, in complex high-dimensional data, the actual signal typically lies in lower-dimensional structures. These lower dimensional objects provide useful insight, with interpretability favored by sparse…

Methodology · Statistics 2022-12-14 Lorenzo Schiavon , Bernardo Nipoti , Antonio Canale

We present an algorithm to reduce the computational effort for the multiplication of a given matrix with an unknown column vector. The algorithm decomposes the given matrix into a product of matrices whose entries are either zero or integer…

Information Theory · Computer Science 2020-02-28 Ralf R. Müller , Bernhard Gäde , Ali Bereyhi

Recovering low-rank and sparse matrices from incomplete or corrupted observations is an important problem in machine learning, statistics, bioinformatics, computer vision, as well as signal and image processing. In theory, this problem can…

Machine Learning · Computer Science 2014-09-04 Fanhua Shang , Yuanyuan Liu , Hanghang Tong , James Cheng , Hong Cheng

In this work, we develop a fast hierarchical solver for solving large, sparse least squares problems. We build upon the algorithm, spaQR (sparsified QR), that was developed by the authors to solve large sparse linear systems. Our algorithm…

Numerical Analysis · Mathematics 2021-03-05 Abeynaya Gnanasekaran , Eric Darve

Sparse coding--that is, modelling data vectors as sparse linear combinations of basis elements--is widely used in machine learning, neuroscience, signal processing, and statistics. This paper focuses on the large-scale matrix factorization…

Machine Learning · Statistics 2010-02-11 Julien Mairal , Francis Bach , Jean Ponce , Guillermo Sapiro

Nonnegative Matrix Factorization consists in (approximately) factorizing a nonnegative data matrix by the product of two low-rank nonnegative matrices. It has been successfully applied as a data analysis technique in numerous domains, e.g.,…

Optimization and Control · Mathematics 2012-08-13 Nicolas Gillis , François Glineur

In light of recent data science trends, new interest has fallen in alternative matrix factorizations. By this, we mean various ways of factorizing particular data matrices so that the factors have special properties and reveal insights into…

Optimization and Control · Mathematics 2023-02-21 Andries Steenkamp

We investigate the problem of factorizing a matrix into several sparse matrices and propose an algorithm for this under randomness and sparsity assumptions. This problem can be viewed as a simplification of the deep learning problem where…

Machine Learning · Computer Science 2014-05-14 Behnam Neyshabur , Rina Panigrahy

In this work, we study a variant of nonnegative matrix factorization where we wish to find a symmetric factorization of a given input matrix into a sparse, Boolean matrix. Formally speaking, given $\mathbf{M}\in\mathbb{Z}^{m\times m}$, we…

Machine Learning · Computer Science 2022-01-14 Sitan Chen , Zhao Song , Runzhou Tao , Ruizhe Zhang

This paper addresses identification of sparse linear and noise-driven continuous-time state-space systems, i.e., the right-hand sides in the dynamical equations depend only on a subset of the states. The key assumption in this study, is…

Systems and Control · Computer Science 2018-04-18 Zuogong Yue , Johan Thunberg , Lennart Ljung , Jorge Goncalves

We show that Laplacian and symmetric diagonally dominant (SDD) matrices can be well approximated by linear-sized sparse Cholesky factorizations. We show that these matrices have constant-factor approximations of the form $L L^{T}$, where…

Data Structures and Algorithms · Computer Science 2015-08-14 Yin Tat Lee , Richard Peng , Daniel A. Spielman

The Laplacian matrix and its pseudo-inverse for a strongly connected directed graph is fundamental in computing many properties of a directed graph. Examples include random-walk centrality and betweenness measures, average hitting and…

Numerical Analysis · Mathematics 2020-09-16 Daniel Boley

We propose a new algorithm for the fast solution of large, sparse, symmetric positive-definite linear systems, spaND -- sparsified Nested Dissection. It is based on nested dissection, sparsification and low-rank compression. After…

Numerical Analysis · Mathematics 2020-01-28 Léopold Cambier , Chao Chen , Erik G Boman , Sivasankaran Rajamanickam , Raymond S. Tuminaro , Eric Darve

Sparse linear algebra routines are fundamental building blocks of a large variety of scientific applications. Direct solvers, which are methods for solving linear systems via the factorization of matrices into products of triangular…

Distributed, Parallel, and Cluster Computing · Computer Science 2022-02-21 Valentin Le Fèvre , Tetsuzo Usui , Marc Casas

In this paper we show how to recover a spectral approximations to broad classes of structured matrices using only a polylogarithmic number of adaptive linear measurements to either the matrix or its inverse. Leveraging this result we obtain…

Data Structures and Algorithms · Computer Science 2018-12-18 Arun Jambulapati , Kirankumar Shiragur , Aaron Sidford

We present a novel deep learning approach to approximate the solution of large, sparse, symmetric, positive-definite linear systems of equations. These systems arise from many problems in applied science, e.g., in numerical methods for…

Machine Learning · Computer Science 2022-10-04 Ayano Kaneda , Osman Akar , Jingyu Chen , Victoria Kala , David Hyde , Joseph Teran