English
Related papers

Related papers: Block Iterative Eigensolvers for Sequences of Corr…

200 papers

Deep autoregressive sequence-to-sequence models have demonstrated impressive performance across a wide variety of tasks in recent years. While common architecture classes such as recurrent, convolutional, and self-attention networks make…

Machine Learning · Computer Science 2018-11-09 Mitchell Stern , Noam Shazeer , Jakob Uszkoreit

Recently, a class of algorithms combining classical fixed point iterations with repeated random sparsification of approximate solution vectors has been successfully applied to eigenproblems with matrices as large as $10^{108} \times…

Numerical Analysis · Mathematics 2025-04-28 Jonathan Weare , Robert J. Webber

Constrained non-convex optimization problems frequently arise in control applications. Solving such problems is inherently challenging, as existing methods often converge to suboptimal local minima or incur prohibitive computational costs.…

Optimization and Control · Mathematics 2026-01-27 Anran Li , John P. Swensen , Mehdi Hosseinzadeh

We describe a number of recently developed techniques for improving the performance of large-scale nuclear configuration interaction calculations on high performance parallel computers. We show the benefit of using a preconditioned block…

Numerical Analysis · Computer Science 2017-12-29 Meiyue Shao , Hasan Metin Aktulga , Chao Yang , Esmond G. Ng , Pieter Maris , James P. Vary

To reliably model real robot characteristics, interval linear systems of equations allow to describe families of problems that consider sets of values. This allows to easily account for typical complexities such as sets of joint states and…

Robotics · Computer Science 2021-04-02 Joshua Pickard , Vincent Padois , Milan Hladík , David Daney

We propose a new type of multilevel method for solving eigenvalue problems based on Newton iteration. With the proposed iteration method, solving eigenvalue problem on the finest finite element space is replaced by solving a small scale…

Numerical Analysis · Mathematics 2015-11-13 Yunhui He , Yu Li , Hehu Xie

A wide range of problems in computational science and engineering require estimation of sparse eigenvectors for high dimensional systems. Here, we propose two variants of the Truncated Orthogonal Iteration to compute multiple leading…

Numerical Analysis · Mathematics 2021-03-26 Hexuan Liu , Aleksandr Aravkin

For large-scale eigenvalue problems requiring many mutually orthogonal eigenvectors, traditional numerical methods suffer substantial computational and communication costs with limited parallel scalability, primarily due to explicit…

Numerical Analysis · Mathematics 2026-01-12 Shengyue Wang , Aihui Zhou

We consider and analyze applying a spectral inverse iteration algorithm and its subspace iteration variant for computing eigenpairs of an elliptic operator with random coefficients. With these iterative algorithms the solution is sought…

Numerical Analysis · Computer Science 2017-06-16 Harri Hakula , Mikael Laaksonen

This paper presents a method for computing eigenvalues and eigenvectors for some types of nonlinear eigenvalue problems. The main idea is to approximate the functions involved in the eigenvalue problem by rational functions and then apply a…

Numerical Analysis · Mathematics 2020-06-11 Yousef Saad , Mohamed El-Guide , Agnieszka Międlar

We consider the problem of parallelizing electronic structure computations in plane-wave Density Functional Theory. Because of the limited scalability of Fourier transforms, parallelism has to be found at the eigensolver level. We show how…

Computational Physics · Physics 2015-06-22 Antoine Levitt , Marc Torrent

A parallel implementation of an eigensolver designed for electronic structure calculations is presented. The method is applicable to computational tasks that solve a sequence of eigenvalue problems where the solution for a particular…

Computational Physics · Physics 2015-03-02 E. L. Briggs , C. T. Kelley , J. Bernholc

This paper presents the results of a preliminary experimental investigation of the performance of a stationary iterative method based on a block staircase splitting for solving singular systems of linear equations arising in Markov chain…

Numerical Analysis · Mathematics 2023-02-16 V. Besozzi , M. Della Bartola , L. Gemignani

We introduce a novel eigenvalue algorithm for near-diagonal matrices inspired by Rayleigh-Schr\"odinger perturbation theory and termed Iterative Perturbative Theory (IPT). Contrary to standard eigenvalue algorithms, which are either…

Numerical Analysis · Mathematics 2022-11-18 Maseim Kenmoe , Ronald Kriemann , Matteo Smerlak , Anton S. Zadorin

We present first-order perturbation analysis of a simple eigenvalue and the corresponding right and left eigenvectors of a general square matrix, not assumed to be Hermitian or normal. The eigenvalue result is well known to a broad…

Numerical Analysis · Mathematics 2019-06-04 Anne Greenbaum , Ren-cang Li , Michael L. Overton

In this paper, we study and implement the structural iterative eigensolvers for the large-scale eigenvalue problem in the Bethe-Salpeter equation (BSE) based on the reduced basis approach via low-rank factorizations in generating matrices,…

Numerical Analysis · Mathematics 2017-03-08 Peter Benner , Sergey Dolgov , Venera Khoromskaia , Boris N. Khoromskij

In this paper, a Parallel Direct Eigensolver for Sequences of Hermitian Eigenvalue Problems with no tridiagonalization is proposed, denoted by \texttt{PDESHEP}, and it combines direct methods with iterative methods. \texttt{PDESHEP} first…

Numerical Analysis · Mathematics 2022-03-22 Shengguo Li , Xinzhe Wu , Jose E. Roman , Ziyang Yuan , Ruibo Wang , Lizhi Cheng

This review discusses progress in efficient solvers which have as their foundation a representation in real space, either through finite-difference or finite-element formulations. The relationship of real-space approaches to linear-scaling…

Materials Science · Physics 2009-10-31 Thomas L. Beck

In this article, we introduce and study accelerated Landweber methods for linear ill-posed problems obtained by an alteration of the coefficients in the three-term recurrence relation of the \nu-methods. The residual polynomials of the…

Numerical Analysis · Mathematics 2012-12-21 Wolfgang Erb

Eigenvalue problems serve as fundamental substrates for applications in large-scale scientific simulations and machine learning, often requiring computation on massively parallel platforms. As these platforms scale to hundreds of thousands…

Numerical Analysis · Mathematics 2025-11-18 Jayanta Mukherjee , Xuejiao Kang , David F. Gleich , Ahmed Sameh , Ananth Grama