English
Related papers

Related papers: Extrapolating the Arnoldi Algorithm To Improve Eig…

200 papers

We describe a strategy for solving nonlinear eigenproblems numerically. Our approach is based on the approximation of a vector-valued function, defined as solution of a non-homogeneous version of the eigenproblem. This approximation step is…

Numerical Analysis · Mathematics 2023-12-06 Davide Pradovera

For the solution of linear discrete ill-posed problems, in this paper we consider the Arnoldi-Tikhonov method coupled with the Generalized Cross Validation for the computation of the regularization parameter at each iteration. We study the…

Numerical Analysis · Mathematics 2013-04-02 Paolo Novati , Maria Rosaria Russo

Primal-dual algorithms are frequently used for iteratively solving large-scale convex optimization problems. The analysis of such algorithms is usually done on a case-by-case basis, and the resulting guaranteed rates of convergence can be…

Optimization and Control · Mathematics 2023-09-21 Bryan Van Scoy , John W. Simpson-Porco , Laurent Lessard

We study the general approach to accelerating the convergence of the most widely used solution method of Markov decision processes with the total expected discounted reward. Inspired by the monotone behavior of the contraction mappings in…

Optimization and Control · Mathematics 2008-03-28 Oleksandr Shlakhter , Chi-Guhn Lee , Dmitry Khmelev , Nasser Jaber

We describe convergence acceleration schemes for multistep optimization algorithms. The extrapolated solution is written as a nonlinear average of the iterates produced by the original optimization method. Our analysis does not need the…

Optimization and Control · Mathematics 2019-10-18 Raghu Bollapragada , Damien Scieur , Alexandre d'Aspremont

In this note, we extend the Vandermonde with Arnoldi method recently advocated by P. D. Brubeck, Y. Nakatsukasa and L. N. Trefethen to dealing with the confluent Vandermonde matrix. To apply the Arnoldi process, it is critical to find a…

Numerical Analysis · Mathematics 2022-07-06 Qiang Niu , Hui Zhang , Youzhou Zhou

Eigenvector continuation is a computational method that finds the extremal eigenvalues and eigenvectors of a Hamiltonian matrix with one or more control parameters. It does this by projection onto a subspace of eigenvectors corresponding to…

Nuclear Theory · Physics 2021-01-22 Avik Sarkar , Dean Lee

In this study, we employ Euler's method and Richardson's extrapolation to solve a triple integral, which is then transformed into a third-order initial value problem. Our objective is to resolve the computational challenges associated with…

Numerical Analysis · Mathematics 2026-02-17 Shubhangini Gupta , Prashant Sharma , Tamal Pramanick

Anderson acceleration (AA) is a technique for accelerating the convergence of fixed-point iterations. In this paper, we apply AA to a sequence of functions and modify the norm in its internal optimization problem to the $\mathcal{H}^{-s}$…

Numerical Analysis · Mathematics 2021-09-14 Yunan Yang , Alex Townsend , Daniel Appelö

Anderson acceleration (AA) is widely used for accelerating the convergence of nonlinear fixed-point methods $x_{k+1}=q(x_{k})$, $x_k \in \mathbb{R}^n$, but little is known about how to quantify the convergence acceleration provided by AA.…

Numerical Analysis · Mathematics 2023-02-27 Hans De Sterck , Yunhui He , Oliver A. Krzysik

Many scientific applications require the evaluation of the action of the matrix function over a vector and the most common methods for this task are those based on the Krylov subspace. Since the orthogonalization cost and memory requirement…

Numerical Analysis · Mathematics 2026-03-24 Nicolas L. Guidotti , Per-Gunnar Martinsson , Juan A. Acebrón , José Monteiro

In this paper, we derive an asymptotic error expansion for the eigenvalue approximations by the lowest order Raviart-Thomas mixed finite element method for the general second order elliptic eigenvalue problems. Extrapolation based on such…

Numerical Analysis · Mathematics 2011-01-11 Hehu Xie

The alternating direction method of multipliers (ADMM) has found widespread use in solving separable convex optimization problems. In this paper, by employing Nesterov extrapolation technique, we propose two families of accelerated…

Optimization and Control · Mathematics 2024-05-13 X. He , N. J. Huang , Y. P. Fang

In this paper, we propose and analyze the extrapolation method and asymptotically exact a posterior error estimate for eigenvalues of the Morley element. We establish an asymptotic expansion of eigenvalues, and prove an optimal result for…

Numerical Analysis · Mathematics 2022-05-10 Limin Ma , Shudan Tian

Extrapolation methods use the last few iterates of an optimization algorithm to produce a better estimate of the optimum. They were shown to achieve optimal convergence rates in a deterministic setting using simple gradient iterates. Here,…

Optimization and Control · Mathematics 2017-08-04 Damien Scieur , Alexandre d'Aspremont , Francis Bach

Numerically solving ordinary differential equations (ODEs) is a naturally serial process and as a result the vast majority of ODE solver software are serial. In this manuscript we developed a set of parallelized ODE solvers using…

Numerical Analysis · Mathematics 2022-09-13 Utkarsh , Chris Elrod , Yingbo Ma , Christopher Rackauckas

We describe an algorithm to compute the extremal eigenvalues and corresponding eigenvectors of a symmetric matrix by solving a sequence of Quadratic Binary Optimization problems. This algorithm is robust across many different classes of…

Emerging Technologies · Computer Science 2022-10-12 Benjamin Krakoff , Susan M. Mniszewski , Christian F. A. Negre

This paper introduces an efficient algorithm for finding the dominant generalized eigenvectors of a pair of symmetric matrices. Combining tools from approximation theory and convex optimization, we develop a simple scalable algorithm with…

Optimization and Control · Mathematics 2019-06-26 Vien V. Mai , Mikael Johansson

In this work, we study decentralized convex constrained optimization problems in networks. We focus on the dual averaging-based algorithmic framework that is well-documented to be superior in handling constraints and complex communication…

Optimization and Control · Mathematics 2022-08-16 Changxin Liu , Yang Shi , Huiping Li , Wenli Du

Circulant matrices play a central role in a recently proposed formulation of three-way data computations. In this setting, a three-way table corresponds to a matrix where each "scalar" is a vector of parameters defining a circulant. This…

Numerical Analysis · Computer Science 2011-01-12 David F. Gleich , Chen Greif , James M. Varah