English
Related papers

Related papers: Coarse grid corrections in Krylov subspace evaluat…

200 papers

We design and analyze an iterative two-grid algorithm for the finite element discretizations of strongly nonlinear elliptic boundary value problems in this paper. We propose an iterative two-grid algorithm, in which a nonlinear problem is…

Numerical Analysis · Mathematics 2023-05-04 Jiajun Zhan , Lei Yang , Xiaoqing Xing , Liuqiang Zhong

Many scientific applications require the evaluation of the action of the matrix function over a vector and the most common methods for this task are those based on the Krylov subspace. Since the orthogonalization cost and memory requirement…

Numerical Analysis · Mathematics 2026-03-24 Nicolas L. Guidotti , Per-Gunnar Martinsson , Juan A. Acebrón , José Monteiro

This paper deals with linear algebra operations on Graphics Processing Unit (GPU) with complex number arithmetic using double precision. An analysis of their uses within iterative Krylov methods is presented to solve acoustic problems.…

Numerical Analysis · Mathematics 2021-12-23 Abal-Kassim Cheik Ahamed , Frederic Magoules

We analyze the convergence of the Conjugate Gradient (CG) method in exact arithmetic, when the coefficient matrix $A$ is symmetric positive semidefinite and the system is consistent. To do so, we diagonalize $A$ and decompose the algorithm…

Numerical Analysis · Mathematics 2020-05-12 Ken Hayami

In recent years, the fervent demand for computational power across various domains has prompted hardware manufacturers to introduce specialized computing hardware aimed at enhancing computational capabilities. Particularly, the utilization…

Numerical Analysis · Mathematics 2024-03-12 Hongyaoxing Gu

We propose a robust, adaptive coarse-grid correction scheme for matrix-free geometric multigrid targeting PDEs with strongly varying coefficients. The method combines uniform geometric coarsening of the underlying grid with heterogeneous…

Performance · Computer Science 2025-11-18 Fabian Böhm , Nils Kohl , Harald Köstler , Ulrich Rüde

We derive an augmented Krylov subspace method with subspace recycling for computing a sequence of matrix function applications on a set of vectors. The matrix is either fixed or changes as the sequence progresses. We assume consecutive…

Numerical Analysis · Mathematics 2025-08-21 Liam Burke , Andreas Frommer , Gustavo Ramirez-Hidalgo , Kirk M. Soodhalter

This paper introduces a new method for minimizing matrix-smooth non-convex objectives through the use of novel Compressed Gradient Descent (CGD) algorithms enhanced with a matrix-valued stepsize. The proposed algorithms are theoretically…

Optimization and Control · Mathematics 2024-04-23 Hanmin Li , Avetik Karagulyan , Peter Richtárik

Due to its optimal complexity, the multigrid (MG) method is one of the most popular approaches for solving large-scale linear systems arising from the discretization of partial differential equations. However, the parallel implementation of…

Numerical Analysis · Mathematics 2025-02-27 Hardik Kothari , Maria Giuseppina Chiara Nestola , Marco Favino , Rolf Krause

Coarse Grid Projection (CGP) methodology is used to accelerate the computations of sets of decoupled nonlinear evolutionary and linear static equations. In CGP, the linear equations are solved on a coarsened mesh compared to the nonlinear…

Computational Physics · Physics 2019-04-30 Ali Kashefi

In practical computations, the (preconditioned) conjugate gradient (P)CG method is the iterative method of choice for solving systems of linear algebraic equations $Ax=b$ with a real symmetric positive definite matrix $A$. During the…

Numerical Analysis · Mathematics 2021-01-12 Gérard Meurant , Jan Papež , Petr Tichý

Krylov subspace methods are widely known as efficient algebraic methods for solving large scale linear systems. However, on massively parallel hardware the performance of these methods is typically limited by communication latency rather…

Numerical Analysis · Computer Science 2018-08-22 Siegfried Cools

The present work develops hybrid multigrid methods for high-order discontinuous Galerkin discretizations of elliptic problems. Fast matrix-free operator evaluation on tensor product elements is used to devise a computationally efficient PDE…

Computational Physics · Physics 2020-06-24 Niklas Fehn , Peter Munch , Wolfgang A. Wall , Martin Kronbichler

Scalable Gaussian process (GP) inference is essential for sequential decision-making tasks, yet improving GP scalability remains a challenging problem with many open avenues of research. This paper focuses on iterative GPs, where iterative…

Machine Learning · Computer Science 2025-11-21 Alan Yufei Dong , Jihao Andreas Lin , José Miguel Hernández-Lobato

In this contribution, we present a numerical analysis of the continuous stochastic gradient (CSG) method, including applications from topology optimization and convergence rates. In contrast to standard stochastic gradient optimization…

Optimization and Control · Mathematics 2023-03-23 Max Grieshammer , Lukas Pflug , Michael Stingl , Andrian Uihlein

This paper improves the convergence and robustness of a multigrid-based solver for the cross sections of the driven Schroedinger equation. Adding an Coupled Channel Correction Step (CCCS) after each multigrid (MG) V-cycle efficiently…

Computational Physics · Physics 2015-09-18 Siegfried Cools , Wim Vanroose

This paper deals with the definition and optimization of augmentation spaces for faster convergence of the conjugate gradient method in the resolution of sequences of linear systems. Using advanced convergence results from the literature,…

Numerical Analysis · Mathematics 2013-02-01 Pierre Gosselet , Christian Rey , Julien Pebrel

We introduce an algorithm for estimating the trace of a matrix function $f(\mathbf{A})$ using implicit products with a symmetric matrix $\mathbf{A}$. Existing methods for implicit trace estimation of a matrix function tend to treat…

Numerical Analysis · Mathematics 2023-08-30 Tyler Chen , Eric Hallman

Matrix--vector algorithms, particularly Krylov subspace methods, are widely viewed as the most effective algorithms for solving large systems of linear equations. This paper establishes lower bounds on the worst-case number of…

Data Structures and Algorithms · Computer Science 2026-02-19 Michał Dereziński , Ethan N. Epperly , Raphael A. Meyer

We investigate the method of conjugate gradients, exploiting inaccurate matrix-vector products, for the solution of convex quadratic optimization problems. Theoretical performance bounds are derived, and the necessary quantities occurring…

Numerical Analysis · Computer Science 2020-09-22 S. Gratton , E. Simon , D. Titley-Peloquin , Ph. L. Toint