English
Related papers

Related papers: Sparse Factorization of Large Square Matrices

200 papers

We propose a new inertia-revealing factorization for sparse symmetric matrices. The factorization scheme and the method for extracting the inertia from it were proposed in the 1960s for dense, banded, or tridiagonal matrices, but they have…

Numerical Analysis · Computer Science 2017-10-17 Alex Druinsky , Eyal Carlebach , Sivan Toledo

We consider the problem of approximating an affinely structured matrix, for example a Hankel matrix, by a low-rank matrix with the same structure. This problem occurs in system identification, signal processing and computer algebra, among…

Numerical Analysis · Mathematics 2014-06-25 Mariya Ishteva , Konstantin Usevich , Ivan Markovsky

Non-negative matrix factorization (NMF) is a recently developed technique for finding parts-based, linear representations of non-negative data. Although it has successfully been applied in several applications, it does not always result in…

Machine Learning · Computer Science 2007-05-23 Patrik O. Hoyer

The use of sparse precision (inverse covariance) matrices has become popular because they allow for efficient algorithms for joint inference in high-dimensional models. Many applications require the computation of certain elements of the…

Computation · Statistics 2017-12-06 Per Sidén , Finn Lindgren , David Bolin , Mattias Villani

Motivated by applications such as sparse PCA, in this paper we present provably-accurate one-pass algorithms for the sparse approximation of the top eigenvectors of extremely massive matrices based on a single compact linear sketch. The…

Information Theory · Computer Science 2026-05-06 Edem Boahen , Simone Brugiapaglia , Hung-Hsu Chou , Mark Iwen , Felix Krahmer

Matrix completion is a problem that arises in many data-analysis settings where the input consists of a partially-observed matrix (e.g., recommender systems, traffic matrix analysis etc.). Classical approaches to matrix completion assume…

Machine Learning · Computer Science 2017-05-02 Natali Ruchansky , Mark Crovella , Evimaria Terzi

Nonnegative matrix factorization (NMF) is a powerful tool for data mining. However, the emergence of `big data' has severely challenged our ability to compute this fundamental decomposition using deterministic algorithms. This paper…

Machine Learning · Statistics 2018-05-02 N. Benjamin Erichson , Ariana Mendible , Sophie Wihlborn , J. Nathan Kutz

In this work, we discuss low-parametric approaches for approximating SimRank matrices, which estimate the similarity between pairs of nodes in a graph. Although SimRank matrices and their computation require a significant amount of memory,…

Numerical Analysis · Mathematics 2026-02-25 Egor P. Berezin , Robert T. Zaks , German Z. Alekhin , Stanislav V. Morozov , Sergey A. Matveev

Many problems in data science can be treated as estimating a low-rank matrix from highly incomplete, sometimes even corrupted, observations. One popular approach is to resort to matrix factorization, where the low-rank matrix factors are…

Machine Learning · Computer Science 2021-04-23 Tian Tong , Cong Ma , Yuejie Chi

The computation of a matrix function $f(A)$ is an important task in scientific computing appearing in machine learning, network analysis and the solution of partial differential equations. In this work, we use only matrix-vector products…

Numerical Analysis · Mathematics 2026-03-03 Taejun Park , Yuji Nakatsukasa

Integral equations are commonly encountered when solving complex physical problems. Their discretization leads to a dense kernel matrix that is block or hierarchically low-rank. This paper proposes a new way to build a low-rank…

Numerical Analysis · Mathematics 2020-01-28 Léopold Cambier , Eric Darve

Low-rank matrix approximation (LRMA) is a powerful technique for signal processing and pattern analysis. However, its potential for data compression has not yet been fully investigated in the literature. In this paper, we propose sparse…

Multimedia · Computer Science 2016-02-22 Junhui Hou , Lap-Pui Chau , Nadia Magnenat-Thalmann , Ying He

Matrix reordering in large sparse solvers seeks a permutation that minimizes factorization fill-in to reduce memory and computation. Because the minimum fill-in ordering problem is NP-complete and fill-in is implicit in the sparsity…

Machine Learning · Computer Science 2026-05-19 Ziwei Li , Shuzi Niu , Huiyuan Li , Tao Yuan , Wenjia Wu

We apply a method recently introduced to the statistical literature to directly estimate the precision matrix from an ensemble of samples drawn from a corresponding Gaussian distribution. Motivated by the observation that cosmological…

Instrumentation and Methods for Astrophysics · Physics 2016-05-25 Nikhil Padmanabhan , Martin White , Harrison H. Zhou , Ross O'Connell

Matrix factorization (MF) discovers latent features from observations, which has shown great promises in the fields of collaborative filtering, data compression, feature extraction, word embedding, etc. While many problem-specific…

Distributed, Parallel, and Cluster Computing · Computer Science 2018-08-14 Wei Tan , Shiyu Chang , Liana Fong , Cheng Li , Zijun Wang , Liangliang Cao

We present a new computational approach to approximating a large, noisy data table by a low-rank matrix with sparse singular vectors. The approximation is obtained from thresholded subspace iterations that produce the singular vectors…

Methodology · Statistics 2011-12-13 Dan Yang , Zongming Ma , Andreas Buja

We propose a method that meta-learns a knowledge on matrix factorization from various matrices, and uses the knowledge for factorizing unseen matrices. The proposed method uses a neural network that takes a matrix as input, and generates…

Machine Learning · Statistics 2021-06-30 Tomoharu Iwata

Multiresolution Matrix Factorization (MMF) was recently introduced as a method for finding multiscale structure and defining wavelets on graphs/matrices. In this paper we derive pMMF, a parallel algorithm for computing the MMF…

Numerical Analysis · Computer Science 2015-07-17 Risi Kondor , Nedelina Teneva , Pramod K. Mudrakarta

Many matrices associated with fast transforms posess a certain low-rank property characterized by the existence of several block partitionings of the matrix, where each block is of low rank. Provided that these partitionings are known,…

Numerical Analysis · Mathematics 2023-07-04 Léon Zheng , Gilles Puy , Elisa Riccietti , Patrick Pérez , Rémi Gribonval

What learning algorithms can be run directly on compressively-sensed data? In this work, we consider the question of accurately and efficiently computing low-rank matrix or tensor factorizations given data compressed via random projections.…

Machine Learning · Computer Science 2019-05-28 Vatsal Sharan , Kai Sheng Tai , Peter Bailis , Gregory Valiant