English
Related papers

Related papers: Neural Preconditioning via Krylov Subspace Geometr…

200 papers

The convergence of Krylov-based linear iterative solvers applied to parametric partial differential equations (PDEs) is often highly sensitive to the domain, its discretization, the location/values of the applied Dirichlet/Neumann boundary…

Numerical Analysis · Mathematics 2026-05-12 Francesc Levrero-Florencio , Youngkyu Lee , Jay Pathak , George Em Karniadakis

We propose a scalable preconditioned primal-dual hybrid gradient algorithm for solving partial differential equations (PDEs). We multiply the PDE with a dual test function to obtain an inf-sup problem whose loss functional involves…

Numerical Analysis · Mathematics 2026-05-26 Shu Liu , Stanley Osher , Wuchen Li

Mixed-dimensional partial differential equations (PDEs) are characterized by coupled operators defined on domains of varying dimensions and pose significant computational challenges due to their inherent ill-conditioning. Moreover, the…

Numerical Analysis · Mathematics 2025-05-14 Nunzio Dimola , Nicola Rares Franco , Paolo Zunino

This work considers the iterative solution of large-scale problems subject to non-symmetric matrices or operators arising in discretizations of (port-)Hamiltonian partial differential equations. We consider problems governed by an operator…

Numerical Analysis · Mathematics 2025-10-21 Volker Mehrmann , Manuel Schaller , Martin Stoll

Advanced Krylov subspace methods are investigated for the solution of large sparse linear systems arising from stiff adjoint-based aerodynamic shape optimization problems. A special attention is paid to the flexible inner-outer GMRES…

Numerical Analysis · Mathematics 2024-04-30 Mehdi Jadoui , Christophe Blondeau , Emeric Martin , Florent Renac , François-Xavier Roux

This work is on a user-friendly reduced basis method for solving a family of parametric PDEs by preconditioned Krylov subspace methods including the conjugate gradient method, generalized minimum residual method, and bi-conjugate gradient…

Numerical Analysis · Mathematics 2026-02-24 Yuwen Li , Ludmil T. Zikatanov , Cheng Zuo

In this paper, we consider an efficient iterative approach to the solution of the discrete Helmholtz equation with Dirichlet, Neumann and Sommerfeld-like boundary conditions based on a compact sixth order approximation scheme and…

Numerical Analysis · Mathematics 2012-12-07 Yury Gryazin

We introduce the Neural Preconditioning Operator (NPO), a novel approach designed to accelerate Krylov solvers in solving large, sparse linear systems derived from partial differential equations (PDEs). Unlike classical preconditioners that…

Computational Engineering, Finance, and Science · Computer Science 2025-02-10 Zhihao Li , Di Xiao , Zhilu Lai , Wei Wang

Large linear systems are ubiquitous in modern computational science and engineering. The main recipe for solving them is the use of Krylov subspace iterative methods with well-designed preconditioners. Recently, GNNs have been shown to be a…

Machine Learning · Computer Science 2025-02-04 Vladislav Trifonov , Alexander Rudikov , Oleg Iliev , Yuri M. Laevsky , Ivan Oseledets , Ekaterina Muravleva

Many optimization problems require hyperparameters, i.e., parameters that must be pre-specified in advance, such as regularization parameters and parametric regularizers in variational regularization methods for inverse problems, and…

Optimization and Control · Mathematics 2025-10-09 Matthias J. Ehrhardt , Silvia Gazzola , Sebastian J. Scott

We propose a novel numerical inversion algorithm for the coefficients of parabolic partial differential equations, based on model reduction. The study is motivated by the application of controlled source electromagnetic exploration, where…

Numerical Analysis · Mathematics 2014-11-21 Liliana Borcea , Vladimir Druskin , Alexander V. Mamonov , Mikhail Zaslavsky

We design two classes of ultra-fast meta-solvers for linear systems arising after discretizing PDEs by combining neural operators with either simple iterative solvers, e.g., Jacobi and Gauss-Seidel, or with Krylov methods, e.g., GMRES and…

Numerical Analysis · Mathematics 2024-12-03 Youngkyu Lee , Shanqing Liu , Jerome Darbon , George Em Karniadakis

Preconditioned Krylov subspace (KSP) methods are widely used for solving large-scale sparse linear systems arising from numerical solutions of partial differential equations (PDEs). These linear systems are often nonsymmetric due to the…

Numerical Analysis · Mathematics 2018-09-05 Aditi Ghai , Cao Lu , Xiangmin Jiao

A Crank-Nicolson finite volume approximation for three-dimensional conservative space-fractional diffusion equation results in large and dense three-level Toeplitz discrete linear systems. Preconditioned Krylov subspace methods with sine…

Numerical Analysis · Mathematics 2026-03-19 Wei Qu , Siu-Long Lei , Sean Y. Hon , Yuan-Yuan Huang

The solution of linear inverse problems when the unknown parameters outnumber data requires addressing the problem of a nontrivial null space. After restating the problem within the Bayesian framework, a priori information about the unknown…

Numerical Analysis · Mathematics 2015-03-25 Daniela Calvetti , Francesca Pitolli , Erkki Somersalo , Barbara Vantaggi

An implementation of GMRES with multiple preconditioners (MPGMRES) is proposed for solving shifted linear systems with shift-and-invert preconditioners. With this type of preconditioner, the Krylov subspace can be built without requiring…

Numerical Analysis · Mathematics 2016-03-31 Tania Bakhos , Peter Kitanidis , Scott Ladenheim , Arvind K. Saibaba , Daniel Szyld

This work proposes a new class of preconditioners for the low rank Generalized Minimal Residual Method (GMRES) for multiterm matrix equations arising from implicit timestepping of linear matrix differential equations. We are interested in…

Numerical Analysis · Mathematics 2024-10-11 Shixu Meng , Daniel Appelo , Yingda Cheng

Hessian-free training has become a popular parallel second or- der optimization technique for Deep Neural Network training. This study aims at speeding up Hessian-free training, both by means of decreasing the amount of data used for…

Machine Learning · Computer Science 2013-12-11 Tara N. Sainath , Lior Horesh , Brian Kingsbury , Aleksandr Y. Aravkin , Bhuvana Ramabhadran

Kernel machines have sustained continuous progress in the field of quantum chemistry. In particular, they have proven to be successful in the low-data regime of force field reconstruction. This is because many equivariances and invariances…

Chemical Physics · Physics 2023-07-12 Stefan Blücher , Klaus-Robert Müller , Stefan Chmiela

The convergence behavior of classical iterative solvers for parametric partial differential equations (PDEs) is often highly sensitive to the domain and specific discretization of PDEs. Previously, we introduced hybrid solvers by combining…

Machine Learning · Computer Science 2025-12-17 Youngkyu Lee , Francesc Levrero Florencio , Jay Pathak , George Em Karniadakis
‹ Prev 1 2 3 10 Next ›