English
Related papers

Related papers: A Non-Krylov subspace Method for Solving Large and…

200 papers

Randomized block Krylov subspace methods form a powerful class of algorithms for computing the extreme eigenvalues of a symmetric matrix or the extreme singular values of a general matrix. The purpose of this paper is to develop new…

Numerical Analysis · Mathematics 2021-10-05 Joel A. Tropp

Tikhonov regularization is a widely used technique in solving inverse problems that can enforce prior properties on the desired solution. In this paper, we propose a Krylov subspace based iterative method for solving linear inverse problems…

Numerical Analysis · Mathematics 2023-08-15 Haibo Li

Matrix--vector algorithms, particularly Krylov subspace methods, are widely viewed as the most effective algorithms for solving large systems of linear equations. This paper establishes lower bounds on the worst-case number of…

Data Structures and Algorithms · Computer Science 2026-02-19 Michał Dereziński , Ethan N. Epperly , Raphael A. Meyer

The proximal point method (PPM) is a fundamental method in optimization that is often used as a building block for designing optimization algorithms. In this work, we use the PPM method to provide conceptually simple derivations along with…

Optimization and Control · Mathematics 2022-06-03 Kwangjun Ahn , Suvrit Sra

We propose an acceleration scheme for first-order methods (FOMs) for convex quadratic programs (QPs) that is analogous to Anderson acceleration and the Generalized Minimal Residual algorithm for linear systems. We motivate our proposed…

Optimization and Control · Mathematics 2026-04-09 Gabriel Berk Pereira , Paul J. Goulart

This work is on a user-friendly reduced basis method for solving a family of parametric PDEs by preconditioned Krylov subspace methods including the conjugate gradient method, generalized minimum residual method, and bi-conjugate gradient…

Numerical Analysis · Mathematics 2026-02-24 Yuwen Li , Ludmil T. Zikatanov , Cheng Zuo

A wide variety of different (fixed-point) iterative methods for the solution of nonlinear equations exists. In this work we will revisit a unified iteration scheme in Hilbert spaces from our previous work that covers some prominent…

Numerical Analysis · Mathematics 2019-05-17 Pascal Heid , Thomas P. Wihler

For linear problems, domain decomposition methods can be used directly as iterative solvers, but also as preconditioners for Krylov methods. In practice, Krylov acceleration is almost always used, since the Krylov method finds a much better…

Numerical Analysis · Mathematics 2016-05-17 V. Dolean , M. J. Gander , F. Kwok , R. Masson , W. Kheriji

When a solution to an abstract inverse linear problem on Hilbert space is approximable by finite linear combinations of vectors from the cyclic subspace associated with the datum and with the linear operator of the problem, the solution is…

Functional Analysis · Mathematics 2021-03-01 Noe Angelo Caruso , Alessandro Michelangeli

Our work presents a new iterative scheme to approximate the fixed points of nonexpansive mapping. The proposed algorithm is constructed to enhance convergence efficiency while preserving theoretical robustness. Under appropriate assumptions…

Functional Analysis · Mathematics 2026-01-12 Nida Izhar Mallick , Izhar Uddin

Since being analyzed by Rokhlin, Szlam, and Tygert and popularized by Halko, Martinsson, and Tropp, randomized Simultaneous Power Iteration has become the method of choice for approximate singular value decomposition. It is more accurate…

Data Structures and Algorithms · Computer Science 2015-11-02 Cameron Musco , Christopher Musco

Augmentation methods for mixed-integer (linear) programs are a class of primal solution approaches in which a current iterate is augmented to a better solution or proved optimal. It is well known that the performance of these methods, i.e.,…

Optimization and Control · Mathematics 2015-10-20 Pierre Le Bodic , Jeffrey W. Pavelka , Marc E. Pfetsch , Sebastian Pokutta

An efficient Krylov subspace algorithm for computing actions of the $\varphi$ matrix function for large matrices is proposed. This matrix function is widely used in exponential time integration, Markov chains and network analysis and many…

Numerical Analysis · Mathematics 2020-10-20 Mike A. Botchev , Leonid A. Knizhnerman , Eugene E. Tyrtyshnikov

Efficiently solving sparse linear algebraic equations is an important research topic of numerical simulation. Commonly used approaches include direct methods and iterative methods. Compared with the direct methods, the iterative methods…

Numerical Analysis · Mathematics 2023-10-11 Haifeng Zou , Xiaowen Xu , Chen-Song Zhang

In this study, we consider the numerical solution of large systems of linear equations obtained from the stochastic Galerkin formulation of stochastic partial differential equations. We propose an iterative algorithm that exploits the…

Numerical Analysis · Mathematics 2016-05-18 Kookjin Lee , Howard C. Elman

Solving point-wise feature correspondence in visual data is a fundamental problem in computer vision. A powerful model that addresses this challenge is to formulate it as graph matching, which entails solving a Quadratic Assignment Problem…

Computer Vision and Pattern Recognition · Computer Science 2024-10-23 Yongqing Liang , Huijun Han , Xin Li

In this article, we propose an accuracy-assuring technique for finding a solution for unsymmetric linear systems. Such problems are related to different areas such as image processing, computer vision, and computational fluid dynamics.…

Mathematical Software · Computer Science 2024-04-23 Mykhailo Havdiak , Jose I. Aliaga , Roman Iakymchuk

Iterative Closest Point (ICP) is a widely used method for performing scan-matching and registration. Being simple and robust method, it is still computationally expensive and may be challenging to use in real-time applications with limited…

Robotics · Computer Science 2017-09-19 A. L. Pavlov , G. V. Ovchinnikov , D. Yu. Derbyshev , D. Tsetserukou , I. V. Oseledets

The computation of matrix functions $f(A)$, or related quantities like their trace, is an important but challenging task, in particular for large and sparse matrices $A$. In recent years, probing methods have become an often considered tool…

Numerical Analysis · Mathematics 2021-02-09 Andreas Frommer , Claudia Schimmel , Marcel Schweitzer

This work proposes an accelerated primal-dual dynamical system for affine constrained convex optimization and presents a class of primal-dual methods with nonergodic convergence rates. In continuous level, exponential decay of a novel…

Optimization and Control · Mathematics 2022-04-12 Hao Luo