English
Related papers

Related papers: Dissecting the FEAST algorithm for generalized eig…

200 papers

The Rayleigh-Ritz (RR) method finds the stationary values, called Ritz values, of the Rayleigh quotient on a given trial subspace as approximations to eigenvalues of a Hermitian operator $A$. If the trial subspace is $A$-invariant, the Ritz…

Numerical Analysis · Mathematics 2010-01-08 Andrew V. Knyazev , Merico E. Argentati

We present a greedy algorithm for computing selected eigenpairs of a large sparse matrix $H$ that can exploit localization features of the eigenvector. When the eigenvector to be computed is localized, meaning only a small number of its…

Computational Physics · Physics 2021-02-09 Taylor M. Hernandez , Roel Van Beeumen , Mark A. Caprio , Chao Yang

We develop an iterative refinement method that improves the accuracy of a user-chosen subset of $k$ eigenvectors ($k\ll n$) of an $n\times n$ real symmetric matrix. Using an orthogonal matrix represented in compact WY form, the method…

Numerical Analysis · Mathematics 2026-03-02 Takeshi Terao , Katsuhisa Ozaki , Toshiyuki Imamura , Takeshi Ogita

The FEAST eigensolver is extended to the computation of the singular triplets of a large matrix $A$ with the singular values in a given interval. The resulting FEAST SVDsolver is subspace iteration applied to an approximate spectral…

Numerical Analysis · Mathematics 2023-09-19 Zhongxiao Jia , Kailiang Zhang

This paper considers the sparse generalized eigenvalue problem (SGEP), which aims to find the leading eigenvector with at most $k$ nonzero entries. SGEP naturally arises in many applications in machine learning, statistics, and scientific…

Machine Learning · Statistics 2020-03-25 Yunfeng Cai , Ping Li

This work deals with approximate solution of generalized eigenvalue problem with coefficient matrix that is an affine function of d-parameters. The coefficient matrix is assumed to be symmetric positive definite and spectrally equivalent to…

Numerical Analysis · Mathematics 2025-03-12 Joanna Bisch , Antti Hannukainen

Generalized eigenvalue problems (GEPs) find applications in various fields of science and engineering. For example, principal component analysis, Fisher's discriminant analysis, and canonical correlation analysis are specific instances of…

Machine Learning · Computer Science 2024-11-05 Zhaoqiang Liu , Wen Li , Junren Chen

Eigensolvers involving complex moments can determine all the eigenvalues in a given region in the complex plane and the corresponding eigenvectors of a regular linear matrix pencil. The complex moment acts as a filter for extracting…

Numerical Analysis · Mathematics 2021-09-22 Keiichi Morikuni

Iterative multiscale methods for electronic structure calculations offer several advantages for large-scale problems. Here we examine a nonlinear full approximation scheme (FAS) multigrid method for solving fixed potential and…

Materials Science · Physics 2007-05-23 Nimal Wijesekera , Guogang Feng , Thomas L. Beck

The generalized eigenvalue problem (GEP) serves as a cornerstone in a wide range of applications in numerical linear algebra and scientific computing. However, traditional approaches that aim to maximize the classical Rayleigh quotient…

Optimization and Control · Mathematics 2025-07-04 Xiaozhi Liu , Yong Xia

Random matrix theory allows one to deduce the eigenvalue spectrum of a large matrix given only statistical information about its elements. Such results provide insight into what factors contribute to the stability of complex dynamical…

Disordered Systems and Neural Networks · Physics 2025-01-30 Joseph W. Baron , Thomas Jun Jewell , Christopher Ryder , Tobias Galla

Preconditioned gradient iterations for very large eigenvalue problems are efficient solvers with growing popularity. However, only for the simplest preconditioned eigensolver, namely the preconditioned gradient iteration (or preconditioned…

Numerical Analysis · Mathematics 2011-08-12 Klaus Neymeyr

This paper presents a method for computing eigenvalues and eigenvectors for some types of nonlinear eigenvalue problems. The main idea is to approximate the functions involved in the eigenvalue problem by rational functions and then apply a…

Numerical Analysis · Mathematics 2020-06-11 Yousef Saad , Mohamed El-Guide , Agnieszka Międlar

For a given subspace, the Rayleigh-Ritz method projects the large quadratic eigenvalue problem (QEP) onto it and produces a small sized dense QEP. Similar to the Rayleigh-Ritz method for the linear eigenvalue problem, the Rayleigh-Ritz…

Numerical Analysis · Mathematics 2015-03-17 Tsung-Ming Huang , Zhongxiao Jia , Wen-Wei Lin

Generalized eigenvalue problems involving a singular pencil may be very challenging to solve, both with respect to accuracy and efficiency. While Part I presented a rank-completing addition to a singular pencil, we now develop two…

Numerical Analysis · Mathematics 2023-10-26 Michiel E. Hochstenbach , Christian Mehl , Bor Plestenjak

The problem of estimating sparse eigenvectors of a symmetric matrix attracts a lot of attention in many applications, especially those with high dimensional data set. While classical eigenvectors can be obtained as the solution of a…

Machine Learning · Statistics 2016-11-03 Konstantinos Benidis , Ying Sun , Prabhu Babu , Daniel P. Palomar

Finding eigenvalue distributions for a number of sparse random matrix ensembles can be reduced to solving nonlinear integral equations of the Hammerstein type. While a systematic mathematical theory of such equations exists, it has not been…

Disordered Systems and Neural Networks · Physics 2025-01-24 Pawat Akara-pipattana , Oleg Evnin

We propose a penalized likelihood framework for estimating multiple precision matrices from different classes. Most existing methods either incorporate no information on relationships between the precision matrices, or require this…

Machine Learning · Statistics 2020-03-03 Bradley S. Price , Aaron J. Molstad , Ben Sherwood

We propose a deep learning based method, the Deep Ritz Method, for numerically solving variational problems, particularly the ones that arise from partial differential equations. The Deep Ritz method is naturally nonlinear, naturally…

Machine Learning · Computer Science 2017-10-03 Weinan E , Bing Yu

Computing more than one eigenvalue for (large sparse) one-parameter polynomial and general nonlinear eigenproblems, as well as for multiparameter linear and nonlinear eigenproblems, is a much harder task than for standard eigenvalue…

Numerical Analysis · Mathematics 2021-10-19 Michiel E. Hochstenbach , Bor Plestenjak