English
Related papers

Related papers: On the Subspace Projected Approximate Matrix metho…

200 papers

We present a new algorithm for solving an eigenvalue problem for a real symmetric matrix which is a rank-one modification of a diagonal matrix. The algorithm computes each eigenvalue and all components of the corresponding eigenvector with…

Numerical Analysis · Mathematics 2015-09-22 Nevena Jakovcevic Stor , Ivan Slapnicar , Jesse L. Barlow

Approximating the permanent of a complex-valued matrix is a fundamental problem with applications in Boson sampling and probabilistic inference. In this paper, we extend factor-graph-based methods for approximating the permanent of…

Information Theory · Computer Science 2026-01-27 Junda Zhou , Pascal O. Vontobel

The Active Subspace (AS) method is a widely used technique for identifying the most influential directions in high-dimensional input spaces that affect the output of a computational model. The standard AS algorithm requires a sufficient…

Numerical Analysis · Mathematics 2025-10-24 Fabio Nobile , Matteo Raviola , Raul Tempone

The matrix pencil method is an eigenvalue based approach for the parameter identification of sparse exponential sums. We derive a reconstruction algorithm for multivariate exponential sums that is based on simultaneous diagonalization.…

Numerical Analysis · Mathematics 2018-05-17 Martin Ehler , Stefan Kunis , Thomas Peter , Christian Richter

Sparse non-Hermitian random matrices arise in the study of disordered physical systems with asymmetric local interactions, and have applications ranging from neural networks to ecosystem dynamics. The spectral characteristics of these…

Statistical Mechanics · Physics 2024-02-21 Fernando Lucas Metz , Izaak Neri , Tim Rogers

We propose a computational framework named iterative local adaptive majorize-minimization (I-LAMM) to simultaneously control algorithmic complexity and statistical error when fitting high dimensional models. I-LAMM is a two-stage…

Statistics Theory · Mathematics 2017-04-06 Jianqing Fan , Han Liu , Qiang Sun , Tong Zhang

An important challenge in the streaming model is to maintain small-space approximations of entrywise functions performed on a matrix that is generated by the outer product of two vectors given as a stream. In other works, streams typically…

Data Structures and Algorithms · Computer Science 2015-11-04 Vladimir Braverman , Alan Roytman , Gregory Vorsanger

Approximate matrix multiplication with limited space has received ever-increasing attention due to the emergence of large-scale applications. Recently, based on a popular matrix sketching algorithm -- frequent directions, previous work has…

Machine Learning · Computer Science 2024-06-25 Yuanyu Wan , Lijun Zhang

We propose a new method for low-rank approximation of Moore-Penrose pseudoinverses (MPPs) of large-scale matrices using tensor networks. The computed pseudoinverses can be useful for solving or preconditioning of large-scale overdetermined…

Numerical Analysis · Mathematics 2016-07-06 Namgil Lee , Andrzej Cichocki

It is shown in this paper that, almost all current prevalent iterative \mbox{methods} for solving linear system of equations can be classified as what we called extended Krylov subspace methods. In this paper a new type of iterative methods…

Numerical Analysis · Mathematics 2016-03-18 Wujian Peng , Shuhua Zhang

We give the first mathematically rigorous analysis of an emerging approach to finite element analysis (see, e.g., Bauer et al. [Appl. Numer. Math., 2017]), which we hereby refer to as the surrogate matrix methodology. This methodology is…

Numerical Analysis · Mathematics 2020-08-11 Daniel Drzisga , Brendan Keith , Barbara Wohlmuth

In this paper we propose and analyze new efficient sparse approximate inverse (SPAI) smoothers for solving the two-dimensional (2D) and three-dimensional (3D) Laplacian linear system with geometric multigrid methods. Local Fourier analysis…

Numerical Analysis · Mathematics 2022-06-14 Yunhui He , Jun Liu , Xiang-Sheng Wang

In this paper, a method via sparse-sparse iteration for computing a sparse incomplete factorization of the inverse of a symmetric positive definite matrix is proposed. The resulting factorized sparse approximate inverse is used as a…

Numerical Analysis · Mathematics 2008-08-03 Davod Khojasteh Salkuyeh , Faezeh Toutounian

Solving symmetric positive definite linear problems is a fundamental computational task in machine learning. The exact solution, famously, is cubicly expensive in the size of the matrix. To alleviate this problem, several linear-time…

Machine Learning · Computer Science 2017-06-02 Filip de Roos , Philipp Hennig

Let $A$ be a $n\times n$ complex Hermitian matrix and let $\lambda(A)=(\lambda_1,\ldots,\lambda_n)\in \mathbb{R}^n$ denote the eigenvalues of $A$, counting multiplicities and arranged in non-increasing order. Motivated by problems arising…

Functional Analysis · Mathematics 2021-04-15 Pedro Massey , Demetrio Stojanoff , Sebastian Zarate

Sparse coding consists in representing signals as sparse linear combinations of atoms selected from a dictionary. We consider an extension of this framework where the atoms are further assumed to be embedded in a tree. This is achieved…

Machine Learning · Statistics 2011-08-18 Rodolphe Jenatton , Julien Mairal , Guillaume Obozinski , Francis Bach

We address an algorithm for the least squares fitting of a subset of the eigenvalues of an unknown Hermitian matrix lying an an affine subspace, called the Lift and Projection (LP) method, due to Chen and Chu (SIAM Journal on Numerical…

Numerical Analysis · Mathematics 2025-04-11 Alban Bloor Riley , Marcus Webb , Michael L. Baker

This paper proposes a rational filtering domain decomposition technique for the solution of large and sparse symmetric generalized eigenvalue problems. The proposed technique is purely algebraic and decomposes the eigenvalue problem…

Numerical Analysis · Mathematics 2017-11-28 Vassilis Kalantzis , Yuanzhe Xi , Yousef Saad

We propose inexact subspace iteration for solving high-dimensional eigenvalue problems with low-rank structure. Inexactness stems from low-rank compression, enabling efficient representation of high-dimensional vectors in a low-rank tensor…

Numerical Analysis · Mathematics 2025-10-16 Alec Dektor , Peter DelMastro , Erika Ye , Roel Van Beeumen , Chao Yang

This note gives a simple analysis of a randomized approximation scheme for matrix multiplication proposed by Sarlos (2006) based on a random rotation followed by uniform column sampling. The result follows from a matrix version of…

Data Structures and Algorithms · Computer Science 2012-11-26 Daniel Hsu , Sham M. Kakade , Tong Zhang