English
Related papers

Related papers: Analysis of probing techniques for sparse approxim…

200 papers

We propose a new method for computing the $\varphi$-functions of large sparse matrices with low rank or fast decaying singular values. The key is to reduce the computation of $\varphi_{\ell}$-functions of a large matrix to…

Numerical Analysis · Mathematics 2016-08-02 Gang Wu , Lu Zhang

Given a limited amount of memory and a target accuracy, we propose and compare several polynomial Krylov methods for the approximation of f(A)b, the action of a Stieltjes matrix function of a large Hermitian matrix on a vector. Using new…

Numerical Analysis · Mathematics 2020-11-04 Stefan Güttel , Marcel Schweitzer

A Krylov subspace recycling method for the efficient evaluation of a sequence of matrix functions acting on a set of vectors is developed. The method improves over the recycling methods presented in [Burke et al., arXiv:2209.14163, 2022] in…

Numerical Analysis · Mathematics 2023-08-23 Liam Burke , Stefan Güttel

Restoration of images degraded by spatially varying blurs is an issue of increasing importance in the context of photography, satellite or microscopy imaging. One of the main difficulty to solve this problem comes from the huge dimensions…

Optimization and Control · Mathematics 2015-06-15 Paul Escande , Pierre Weiss , Francois Malgouyres

This paper proposes a verification method for sparse linear systems $Ax=b$ with general and nonsingular coefficients. A verification method produces the error bound for a given approximate solution. Conventional methods use one of two…

Numerical Analysis · Mathematics 2024-06-05 Takeshi Terao , Katsuhisa Ozaki

Consider a graph $G = (V, E)$ and, for each vertex $v \in V$, a subset $\Sigma(v)$ of neighbors of $v$. A $\Sigma$-coloring is a coloring of the elements of $V$ so that vertices appearing together in some $\Sigma(v)$ receive pairwise…

Combinatorics · Mathematics 2013-09-26 Zdenek Dvorak , Louis Esperet

We study the problem of approximating a matrix $\mathbf{A}$ with a matrix that has a fixed sparsity pattern (e.g., diagonal, banded, etc.), when $\mathbf{A}$ is accessed only by matrix-vector products. We describe a simple randomized…

Data Structures and Algorithms · Computer Science 2024-03-27 Noah Amsel , Tyler Chen , Feyza Duman Keles , Diana Halikias , Cameron Musco , Christopher Musco

Sparse representation has attracted much attention from researchers in fields of signal processing, image processing, computer vision and pattern recognition. Sparse representation also has a good reputation in both theoretical research and…

Computer Vision and Pattern Recognition · Computer Science 2016-02-24 Zheng Zhang , Yong Xu , Jian Yang , Xuelong Li , David Zhang

We present an algorithm for finding sparse solutions of the system of linear equations $\Phi\mathbf{x}=\mathbf{y}$ with rectangular matrices $\Phi$ of size $n\times N$, where $n<N$, when measurement vector $\mathbf{y}$ is corrupted by a…

Numerical Analysis · Mathematics 2013-04-16 Alexander Petukhov , Inna Kozlov

The numerical computation of matrix functions such as $f(A)V$, where $A$ is an $n\times n$ large and sparse square matrix, $V$ is an $n \times p$ block with $p\ll n$ and $f$ is a nonlinear matrix function, arises in various applications…

Numerical Analysis · Mathematics 2020-04-02 A. H. Bentbib , M. El Ghomari , K. Jbilou

Most current prevalent iterative methods can be classified into the so-called extended Krylov subspace methods, a class of iterative methods which do not fall into this category are also proposed in this paper. Comparing with traditional…

Numerical Analysis · Mathematics 2015-11-26 Wujian Peng , Qun Lin

We introduce a novel algorithm that computes the $k$-sparse principal component of a positive semidefinite matrix $A$. Our algorithm is combinatorial and operates by examining a discrete set of special vectors lying in a low-dimensional…

Machine Learning · Statistics 2014-05-09 Dimitris S. Papailiopoulos , Alexandros G. Dimakis , Stavros Korokythakis

Many applications in computational science require computing the elements of a function of a large matrix. A commonly used approach is based on the the evaluation of the eigenvalue decomposition, a task that, in general, involves a…

Computational Physics · Physics 2014-07-04 Marco Nava , Michele Ceriotti , Chaim Dryzun , Michele Parrinello

Randomized block Krylov subspace methods form a powerful class of algorithms for computing the extreme eigenvalues of a symmetric matrix or the extreme singular values of a general matrix. The purpose of this paper is to develop new…

Numerical Analysis · Mathematics 2021-10-05 Joel A. Tropp

Deflation techniques for Krylov subspace methods have seen a lot of attention in recent years. They provide means to improve the convergence speed of these methods by enriching the Krylov subspace with a deflation subspace. The most common…

Numerical Analysis · Mathematics 2017-04-26 K. Kahl , H. Rittich

The modified Cholesky decomposition is commonly used for precision matrix estimation given a specified order of random variables. However, the order of variables is often not available or cannot be pre-determined. In this work, we propose…

Machine Learning · Statistics 2021-11-23 Xiaoning Kang , Xinwei Deng

Sparse coding and dictionary learning are popular techniques for linear inverse problems such as denoising or inpainting. However in many cases, the measurement process is nonlinear, for example for clipped, quantized or 1-bit measurements.…

Signal Processing · Electrical Eng. & Systems 2020-01-08 Lucas Rencker , Francis Bach , Wenwu Wang , Mark D. Plumbley

A method for improving the performance of sparse-matrix based parity check codes is proposed, based on insight gained from methods of statistical physics. The advantages of the new approach are demonstrated on an existing encoding/decoding…

Disordered Systems and Neural Networks · Physics 2009-10-31 Ido Kanter , David Saad

The CUR decomposition provides an approximation of a matrix $X$ that has low reconstruction error and that is sparse in the sense that the resulting approximation lies in the span of only a few columns of $X$. In this regard, it appears to…

Data Structures and Algorithms · Computer Science 2010-11-02 Jacob Bien , Ya Xu , Michael W. Mahoney

Local-search methods are widely employed in statistical applications, yet interestingly, their theoretical foundations remain rather underexplored, compared to other classes of estimators such as low-degree polynomials and spectral methods.…

Statistics Theory · Mathematics 2025-06-12 Max Lovig , Conor Sheehan , Konstantinos Tsirkas , Ilias Zadik