English
Related papers

Related papers: A Note on Element-wise Matrix Sparsification via a…

200 papers

We propose a new inertia-revealing factorization for sparse symmetric matrices. The factorization scheme and the method for extracting the inertia from it were proposed in the 1960s for dense, banded, or tridiagonal matrices, but they have…

Numerical Analysis · Computer Science 2017-10-17 Alex Druinsky , Eyal Carlebach , Sivan Toledo

For any matrix A in R^(m x n) of rank \rho, we present a probability distribution over the entries of A (the element-wise leverage scores of equation (2)) that reveals the most influential entries in the matrix. From a theoretical…

Numerical Analysis · Computer Science 2013-12-17 Abhisek Kundu , Srinivas Nambirajan , Petros Drineas

This manuscript describes a technique for computing partial rank-revealing factorizations, such as, e.g, a partial QR factorization or a partial singular value decomposition. The method takes as input a tolerance $\varepsilon$ and an…

Numerical Analysis · Mathematics 2015-06-19 Per-Gunnar Martinsson , Sergey Voronin

We propose a unified framework to speed up the existing stochastic matrix factorization (SMF) algorithms via variance reduction. Our framework is general and it subsumes several well-known SMF formulations in the literature. We perform a…

Machine Learning · Statistics 2017-05-23 Renbo Zhao , William B. Haskell , Jiashi Feng

We consider the following multi-component sparse PCA problem: given a set of data points, we seek to extract a small number of sparse components with disjoint supports that jointly capture the maximum possible variance. These components can…

We describe a second-order accurate approach to sparsifying the off-diagonal blocks in the hierarchical approximate factorizations of sparse symmetric positive definite matrices. The norm of the error made by the new approach depends…

Numerical Analysis · Mathematics 2020-08-05 Bazyli Klockiewicz , Léopold Cambier , Ryan Humble , Hamdi Tchelepi , Eric Darve

In this work, we present a method to exponentiate non-sparse indefinite low-rank matrices on a quantum computer. Given an operation for accessing the elements of the matrix, our method allows singular values and associated singular vectors…

Quantum Physics · Physics 2018-01-31 Patrick Rebentrost , Adrian Steffens , Seth Lloyd

This note gives a simple analysis of a randomized approximation scheme for matrix multiplication proposed by Sarlos (2006) based on a random rotation followed by uniform column sampling. The result follows from a matrix version of…

Data Structures and Algorithms · Computer Science 2012-11-26 Daniel Hsu , Sham M. Kakade , Tong Zhang

In this paper, we study the nonnegative matrix factorization problem under the separability assumption (that is, there exists a cone spanned by a small subset of the columns of the input nonnegative data matrix containing all columns),…

Machine Learning · Statistics 2014-04-07 Nicolas Gillis , Stephen A. Vavasis

We introduce a new method for sparse principal component analysis, based on the aggregation of eigenvector information from carefully-selected axis-aligned random projections of the sample covariance matrix. Unlike most alternative…

Methodology · Statistics 2019-05-07 Milana Gataric , Tengyao Wang , Richard J. Samworth

The problem of decomposing a given covariance matrix as the sum of a positive semi-definite matrix of given rank and a positive semi-definite diagonal matrix, is considered. We present a projection-type algorithm to address this problem.…

Optimization and Control · Mathematics 2018-06-13 Valentina Ciccone , Augusto Ferrante , Mattia Zorzi

We propose the variational quantum singular value decomposition based on encoding the elements of the considered { $N\times N$} matrix into the state of a quantum system of appropriate dimension. This method doesn't use the expansion of…

Quantum Physics · Physics 2025-08-05 Alexander I. Zenchuk , Wentao Qi , Junde Wu

Consider the problem of estimating the entries of a large matrix, when the observed entries are noisy versions of a small random fraction of the original entries. This problem has received widespread attention in recent times, especially…

Statistics Theory · Mathematics 2014-12-31 Sourav Chatterjee

In this paper, we propose a fast algorithm for element selection, a multiplication-free form of dimension reduction that produces a dimension-reduced vector by simply selecting a subset of elements from the input. Dimension reduction is a…

Machine Learning · Computer Science 2026-02-17 Nobutaka Ono

We propose a novel model for nonlinear dimension reduction motivated by the probabilistic formulation of principal component analysis. Nonlinearity is achieved by specifying different transformation matrices at different locations of the…

Computer Vision and Pattern Recognition · Computer Science 2008-02-12 Heng Lian

In this paper, we propose an online algorithm to compute matrix factorizations. Proposed algorithm updates the dictionary matrix and associated coefficients using a single observation at each time. The algorithm performs low-rank updates to…

Machine Learning · Statistics 2015-06-29 Ömer Deniz Akyıldız

We apply a method recently introduced to the statistical literature to directly estimate the precision matrix from an ensemble of samples drawn from a corresponding Gaussian distribution. Motivated by the observation that cosmological…

Instrumentation and Methods for Astrophysics · Physics 2016-05-25 Nikhil Padmanabhan , Martin White , Harrison H. Zhou , Ross O'Connell

Processes to automate the selection of appropriate algorithms for various matrix computations are described. In particular, processes to check for, and certify, various matrix properties of black box matrices are presented. These include…

Numerical Analysis · Computer Science 2016-11-01 Wayne Eberly

Inversion of sparse matrices with standard direct solve schemes is robust, but computationally expensive. Iterative solvers, on the other hand, demonstrate better scalability; but, need to be used with an appropriate preconditioner (e.g.,…

Numerical Analysis · Mathematics 2017-09-28 Hadi Pouransari , Pieter Coulier , Eric Darve

The Bernstein polynomial basis sees significant use owing to its unique properties, particularly in the field of optimal control. However, the basis is known to have a slow rate of convergence to the function it approximates. With this in…

Optimization and Control · Mathematics 2025-09-15 Maxwell Hammond , Gage MacLin , Laurent Jay , Venanzio Cichella