English
Related papers

Related papers: Faster Eigenvector Computation via Shift-and-Inver…

200 papers

This paper is concerned with the extraction of the smallest eigenvalue and the corresponding eigenvector of a symmetric positive definite matrix pencil. We reveal implicit convexity of the eigenvalue problem in Euclidean space. A provable…

Numerical Analysis · Mathematics 2024-01-23 Nian Shao , Wenbin Chen , Zhaojun Bai

We present a new algorithm for solving an eigenvalue problem for a real symmetric arrowhead matrix. The algorithm computes all eigenvalues and all components of the corresponding eigenvectors with high relative accuracy in $O(n^{2})$…

Numerical Analysis · Mathematics 2014-05-30 Nevena Jakovcevic Stor , Ivan Slapnicar , Jesse L. Barlow

In this paper, two accelerated divide-and-conquer algorithms are proposed for the symmetric tridiagonal eigenvalue problem, which cost $O(N^2r)$ {flops} in the worst case, where $N$ is the dimension of the matrix and $r$ is a modest number…

Numerical Analysis · Computer Science 2015-10-16 Shengguo Li , Xiangke Liao , Jie Liu , Hao Jiang

Preconditioned eigenvalue solvers offer the possibility to incorporate preconditioners for the solution of large-scale eigenvalue problems, as they arise from the discretization of partial differential equations. The convergence analysis of…

Numerical Analysis · Mathematics 2024-12-20 Foivos Alimisis , Daniel Kressner , Nian Shao , Bart Vandereycken

The properties of the first (largest) eigenvalue and its eigenvector (first eigenvector) are investigated for large sparse random symmetric matrices that are characterized by bimodal degree distributions. In principle, one should be able to…

Disordered Systems and Neural Networks · Physics 2012-08-03 Yoshiyuki Kabashima , Hisanao Takahashi

We revisit a classical problem in numerical linear algebra: given an $k$-dimensional subspace $\mathcal{Q}$ that approximates the leading eigenspace of an $n\times n$ positive semi-definite matrix $A$, the goal is to extract high-accuracy…

Numerical Analysis · Mathematics 2026-05-07 Yuji Nakatsukasa , Zheng Tang

Quantum phase estimation algorithm has been successfully adapted as a sub frame of many other algorithms applied to a wide variety of applications in different fields. However, the requirement of a good approximate eigenvector given as an…

Quantum Physics · Physics 2016-12-15 Anmer Daskin

This paper introduces an efficient algorithm for finding the dominant generalized eigenvectors of a pair of symmetric matrices. Combining tools from approximation theory and convex optimization, we develop a simple scalable algorithm with…

Optimization and Control · Mathematics 2019-06-26 Vien V. Mai , Mikael Johansson

We derive an accurate lower tail estimate on the lowest singular value $\sigma_1(X-z)$ of a real Gaussian (Ginibre) random matrix $X$ shifted by a complex parameter $z$. Such shift effectively changes the upper tail behaviour of the…

Numerical Analysis · Mathematics 2022-11-02 Giorgio Cipolloni , László Erdős , Dominik Schröder

We construct fast, structure-preserving iterations for computing the sign decomposition of a unitary matrix $A$ with no eigenvalues equal to $\pm i$. This decomposition factorizes $A$ as the product of an involutory matrix $S =…

Numerical Analysis · Mathematics 2020-11-26 Evan S. Gawlik

We present a new class of preconditioned iterative methods for solving linear systems of the form $Ax = b$. Our methods are based on constructing a low-rank Nystr\"om approximation to $A$ using sparse random matrix sketching. This…

Data Structures and Algorithms · Computer Science 2025-04-14 Michał Dereziński , Christopher Musco , Jiaming Yang

We study the problem of estimating the covariance matrix of a high-dimensional distribution when a small constant fraction of the samples can be arbitrarily corrupted. Recent work gave the first polynomial time algorithms for this problem…

Machine Learning · Computer Science 2019-06-12 Yu Cheng , Ilias Diakonikolas , Rong Ge , David Woodruff

We develop an iterative refinement method that improves the accuracy of a user-chosen subset of $k$ eigenvectors ($k\ll n$) of an $n\times n$ real symmetric matrix. Using an orthogonal matrix represented in compact WY form, the method…

Numerical Analysis · Mathematics 2026-03-02 Takeshi Terao , Katsuhisa Ozaki , Toshiyuki Imamura , Takeshi Ogita

Motivated by applications such as sparse PCA, in this paper we present provably-accurate one-pass algorithms for the sparse approximation of the top eigenvectors of extremely massive matrices based on a single compact linear sketch. The…

Information Theory · Computer Science 2026-05-06 Edem Boahen , Simone Brugiapaglia , Hung-Hsu Chou , Mark Iwen , Felix Krahmer

Given $n$ i.i.d. observations of a random vector $(X,Z)$, where $X$ is a high-dimensional vector and $Z$ is a low-dimensional index variable, we study the problem of estimating the conditional inverse covariance matrix $\Omega(z) =…

Machine Learning · Statistics 2014-12-25 Jialei Wang , Mladen Kolar

Robust covariance estimation is the following, well-studied problem in high dimensional statistics: given $N$ samples from a $d$-dimensional Gaussian $\mathcal{N}(\boldsymbol{0}, \Sigma)$, but where an $\varepsilon$-fraction of the samples…

Data Structures and Algorithms · Computer Science 2020-06-25 Jerry Li , Guanghao Ye

We propose efficient preconditioning algorithms for an eigenvalue problem arising in quantum physics, namely the computation of a few interior eigenvalues and their associated eigenvectors for the largest sparse real and symmetric…

Numerical Analysis · Mathematics 2007-06-13 Olaf Schenk , Matthias Bollhoefer , Rudolf A. Roemer

We give a stochastic optimization algorithm that solves a dense $n\times n$ real-valued linear system $Ax=b$, returning $\tilde x$ such that $\|A\tilde x-b\|\leq \epsilon\|b\|$ in time: $$\tilde O((n^2+nk^{\omega-1})\log1/\epsilon),$$ where…

Data Structures and Algorithms · Computer Science 2024-06-10 Michał Dereziński , Jiaming Yang

We prove improved bounds on how localized an eigenvector of a high girth regular graph can be, and present examples showing that these bounds are close to sharp. This study was initiated by Brooks and Lindenstrauss (2009) who relied on the…

Combinatorics · Mathematics 2021-08-06 Shirshendu Ganguly , Nikhil Srivastava

In this paper, we study the problem of speeding up a type of optimization algorithms called Frank-Wolfe, a conditional gradient method. We develop and employ two novel inner product search data structures, improving the prior fastest…

Data Structures and Algorithms · Computer Science 2022-07-20 Zhao Song , Zhaozhuo Xu , Yuanyuan Yang , Lichen Zhang