English
Related papers

Related papers: A Framework of Conjugate Direction Methods for Sym…

200 papers

We present a variant of the s-step Preconditioned Conjugate Gradient (PCG) method that combines a Chebyshev-stabilized Krylov basis with a Forward Gauss-Seidel (FGS) iteration for the solution of the reduced Gram systems. In s-step…

Numerical Analysis · Mathematics 2026-03-30 Pasqua D'Ambra , Massimo Bernaschi , Mauro G. Carrozzo , Stephen Thomas

We explore a scaled spectral preconditioner for the efficient solution of sequences of symmetric and positive-definite linear systems. We design the scaled preconditioner not only as an approximation of the inverse of the linear system but…

Numerical Analysis · Mathematics 2024-10-04 Youssef Diouane , Selime Gürol , Oussama Mouhtal , Dominique Orban

In this work, we propose a reduced basis method for efficient solution of parametric linear systems. The coefficient matrix is assumed to be a linear matrix-valued function that is symmetric and positive definite for admissible values of…

Numerical Analysis · Mathematics 2021-09-28 Antti Autio , Antti Hannukainen

Deflation techniques for Krylov subspace methods have seen a lot of attention in recent years. They provide means to improve the convergence speed of these methods by enriching the Krylov subspace with a deflation subspace. The most common…

Numerical Analysis · Mathematics 2017-04-26 K. Kahl , H. Rittich

Large linear systems are ubiquitous in modern computational science and engineering. The main recipe for solving them is the use of Krylov subspace iterative methods with well-designed preconditioners. Recently, GNNs have been shown to be a…

Machine Learning · Computer Science 2025-02-04 Vladislav Trifonov , Alexander Rudikov , Oleg Iliev , Yuri M. Laevsky , Ivan Oseledets , Ekaterina Muravleva

In recent years two Krylov subspace methods have been proposed for solving skew symmetric linear systems, one based on the minimum residual condition, the other on the Galerkin condition. We give new, algorithm-independent proofs that in…

Numerical Analysis · Mathematics 2015-12-02 Stanley C. Eisenstat

A Crank-Nicolson finite volume approximation for three-dimensional conservative space-fractional diffusion equation results in large and dense three-level Toeplitz discrete linear systems. Preconditioned Krylov subspace methods with sine…

Numerical Analysis · Mathematics 2026-03-19 Wei Qu , Siu-Long Lei , Sean Y. Hon , Yuan-Yuan Huang

Since the development of the conjugate gradient (CG) method in 1952 by Hestenes and Stiefel, CG, has become an indispensable tool in computational mathematics for solving positive definite linear systems. On the other hand, the conjugate…

Numerical Analysis · Mathematics 2025-05-06 Alexander Lim , Yang Liu , Fred Roosta

Conjugated gradients on the normal equation (CGNE) is a popular method to regularise linear inverse problems. The idea of the method can be summarised as minimising the residuum over a suitable Krylov subspace. It is shown that using the…

Numerical Analysis · Mathematics 2019-12-30 Volker Grimm

We consider symmetric positive definite systems of linear equations with multiple right-hand sides. The seed conjugate gradient method solves one right-hand side with the conjugate gradient method and simultaneously projects over the Krylov…

Mathematical Physics · Physics 2014-08-27 Abdou M. Abdel-Rehim , Ronald B. Morgan , Walter Wilcox

This work presents a new Krylov-subspace-recycling method for efficiently solving sequences of linear systems of equations characterized by varying right-hand sides and symmetric-positive-definite matrices. As opposed to typical truncation…

Numerical Analysis · Mathematics 2016-01-22 Kevin Carlberg , Virginia Forstall , Ray Tuminaro

We consider iterative methods for solving linear ill-posed problems with compact operator and right-hand side only available via noise-polluted measurements. Conjugate gradients (CG) applied to the normal equations with an appropriate…

Numerical Analysis · Mathematics 2026-02-19 Daniel Gerth , Kirk M. Soodhalter

The article proposes a Caputo fractional conjugate gradient (CFCG) method for unconstrained optimization problems which is applicable to smooth as well as non-smooth problmes. The proposed method uses a non-adaptive version of the Caputo…

Optimization and Control · Mathematics 2025-12-22 Barsha Shawa , Md Abu Talhamainuddin Ansary

We present a preconditioner based on spectral projection that is combined with a deflated Krylov subspace method for solving ill conditioned linear systems of equations. Our results show that the proposed algorithm requires many fewer…

Numerical Analysis · Mathematics 2016-09-23 Man-Chung Yeung , Craig C. Douglas , Long Lee

This paper introduces and analyzes an original class of Krylov subspace methods that provide an efficient alternative to many well-known conjugate-gradient-like (CG-like) Krylov solvers for square nonsymmetric linear systems arising from…

Numerical Analysis · Mathematics 2017-09-13 Silvia Gazzola , Paolo Novati

We develop a simple algorithmic framework to solve large-scale symmetric positive definite linear systems. At its core, the framework relies on two components: (1) a norm-convergent iterative method (i.e. smoother) and (2) a preconditioner.…

Numerical Analysis · Mathematics 2013-02-18 Xiaozhe Hu , Shuhong Wu , Xiao-Hui Wu , Jinchao Xu , Chen-Song Zhang , Shiquan Zhang , Ludmil Zikatanov

We develop randomized (block) coordinate descent (CD) methods for linearly constrained convex optimization. Unlike most CD methods, we do not assume the constraints to be separable, but let them be coupled linearly. To our knowledge, ours…

Optimization and Control · Mathematics 2015-06-11 Sashank Reddi , Ahmed Hefny , Carlton Downey , Avinava Dubey , Suvrit Sra

A structured preconditioned conjugate gradient (PCG) solver is developed for the Newton steps in second-order methods for a class of constrained network optimal control problems. Of specific interest are problems with discrete-time dynamics…

Systems and Control · Electrical Eng. & Systems 2020-10-13 Armaghan Zafar , Michael Cantoni , Farhad Farokhi

In this note we exploit polynomial preconditioners for the Conjugate Gradient method to solve large symmetric positive definite linear systems in a parallel environment. We put in connection a specialized Newton method to solve the matrix…

Numerical Analysis · Mathematics 2020-11-30 Luca Bergamaschi , Angeles Martinez

Enlarged Krylov subspace methods and their s-step versions were introduced [7] in the aim of reducing communication when solving systems of linear equations Ax = b. These enlarged CG methods consist of enlarging the Krylov subspace by a…

Numerical Analysis · Mathematics 2024-09-18 Sophie M. Moufawad