English
Related papers

Related papers: Approximating Sparse Matrices and their Functions …

200 papers

We consider the problem of estimating the trace of a matrix function $f(A)$. In certain situations, in particular if $f(A)$ cannot be well approximated by a low-rank matrix, combining probing methods based on graph colorings with stochastic…

Numerical Analysis · Mathematics 2023-08-16 Andreas Frommer , Michele Rinelli , Marcel Schweitzer

Computing the product of two sparse matrices (SpGEMM) is a fundamental operation in various combinatorial and graph algorithms as well as various bioinformatics and data analytics applications for computing inner-product similarities. For…

Distributed, Parallel, and Cluster Computing · Computer Science 2021-11-22 Srđan Milaković , Oguz Selvitopi , Israt Nisa , Zoran Budimlić , Aydin Buluc

We consider the estimation of a sparse factor model where the factor loading matrix is assumed sparse. The estimation problem is reformulated as a penalized M-estimation criterion, while the restrictions for identifying the factor loading…

Statistics Theory · Mathematics 2025-01-23 Benjamin Poignard , Yoshikazu Terada

Restoration of images degraded by spatially varying blurs is an issue of increasing importance in the context of photography, satellite or microscopy imaging. One of the main difficulty to solve this problem comes from the huge dimensions…

Optimization and Control · Mathematics 2015-06-15 Paul Escande , Pierre Weiss , Francois Malgouyres

Given a known matrix that is the sum of a low rank matrix and a masked sparse matrix, we wish to recover both the low rank component and the sparse component. The sparse matrix is masked in the sense that a linear transformation has been…

Information Theory · Computer Science 2025-04-29 Xuemei Chen , Rongrong Wang

Many data analysis applications deal with large matrices and involve approximating the matrix using a small number of ``components.'' Typically, these components are linear combinations of the rows and columns of the matrix, and are thus…

Data Structures and Algorithms · Computer Science 2007-08-29 Petros Drineas , Michael W. Mahoney , S. Muthukrishnan

We investigate the problem of factorizing a matrix into several sparse matrices and propose an algorithm for this under randomness and sparsity assumptions. This problem can be viewed as a simplification of the deep learning problem where…

Machine Learning · Computer Science 2014-05-14 Behnam Neyshabur , Rina Panigrahy

Sparse matrices are favorable objects in machine learning and optimization. When such matrices are used, in place of dense ones, the overall complexity requirements in optimization can be significantly reduced in practice, both in terms of…

Information Theory · Computer Science 2016-04-05 Anastasios Kyrillidis , Bubacarr Bah , Rouzbeh Hasheminezhad , Quoc Tran-Dinh , Luca Baldassarre , Volkan Cevher

Adaptive sparse coding methods learn a possibly overcomplete set of basis functions, such that natural image patches can be reconstructed by linearly combining a small subset of these bases. The applicability of these methods to visual…

Computer Vision and Pattern Recognition · Computer Science 2010-10-19 Koray Kavukcuoglu , Marc'Aurelio Ranzato , Yann LeCun

Motivated by applications in unsourced random access, this paper develops a novel scheme for the problem of compressed sensing of binary signals. In this problem, the goal is to design a sensing matrix $A$ and a recovery algorithm, such…

Information Theory · Computer Science 2021-09-21 Elad Romanov , Or Ordentlich

Recent results in compressed sensing show that, under certain conditions, the sparsest solution to an underdetermined set of linear equations can be recovered by solving a linear program. These results either rely on computing sparse…

Optimization and Control · Mathematics 2010-11-02 Alexandre d'Aspremont , Laurent El Ghaoui

We propose a functional view of matrix decomposition problems on graphs such as geometric matrix completion and graph regularized dimensionality reduction. Our unifying framework is based on the key idea that using a reduced basis to…

Machine Learning · Computer Science 2021-02-08 Abhishek Sharma , Maks Ovsjanikov

A fast algorithm for the approximate multiplication of matrices with decay is introduced; the Sparse Approximate Matrix Multiply (SpAMM) reduces complexity in the product space, a different approach from current methods that economize…

Data Structures and Algorithms · Computer Science 2010-11-17 Matt Challacombe , Nicolas Bock

The task of compressed sensing is to recover a sparse vector from a small number of linear and non-adaptive measurements, and the problem of finding a suitable measurement matrix is very important in this field. While most recent works…

Information Theory · Computer Science 2012-12-18 Yi-Zheng Fan , Tao Huang , Ming Zhu

Suppose we are given a large matrix $A=(a_{i,j})$ that cannot be stored in memory but is in a disk or is presented in a data stream. However, we need to compute a matrix decomposition of the entry-wisely transformed matrix,…

Data Structures and Algorithms · Computer Science 2020-02-25 Yingyu Liang , Zhao Song , Mengdi Wang , Lin F. Yang , Xin Yang

We propose a new method for computing the $\varphi$-functions of large sparse matrices with low rank or fast decaying singular values. The key is to reduce the computation of $\varphi_{\ell}$-functions of a large matrix to…

Numerical Analysis · Mathematics 2016-08-02 Gang Wu , Lu Zhang

This paper revisits the problem of decomposing a positive semidefinite matrix as a sum of a matrix with a given rank plus a sparse matrix. An immediate application can be found in portfolio optimization, when the matrix to be decomposed is…

Optimization and Control · Mathematics 2021-06-16 Michel Baes , Calypso Herrera , Ariel Neufeld , Pierre Ruyssen

In this document, we present key findings in structured matrix approximation theory, with applications to the regressive representation of dynamic financial processes. Initially, we explore a comprehensive approach involving generic…

Systems and Control · Electrical Eng. & Systems 2025-10-28 Fredy Vides , Idelfonso B. R. Nogueira , Gabriela Lopez Gutierrez , Lendy Banegas , Evelyn Flores

We apply a method recently introduced to the statistical literature to directly estimate the precision matrix from an ensemble of samples drawn from a corresponding Gaussian distribution. Motivated by the observation that cosmological…

Instrumentation and Methods for Astrophysics · Physics 2016-05-25 Nikhil Padmanabhan , Martin White , Harrison H. Zhou , Ross O'Connell

The rapid developing area of compressed sensing suggests that a sparse vector lying in an arbitrary high dimensional space can be accurately recovered from only a small set of non-adaptive linear measurements. Under appropriate conditions…

Cellular Automata and Lattice Gases · Physics 2009-11-13 Moshe Mishali , Yonina C. Eldar