English
Related papers

Related papers: Stable Iterative Solvers for Ill-conditioned Linea…

200 papers

This paper surveys an important class of methods that combine iterative projection methods and variational regularization methods for large-scale inverse problems. Iterative methods such as Krylov subspace methods are invaluable in the…

Numerical Analysis · Mathematics 2021-08-23 Julianne Chung , Silvia Gazzola

For many applications involving a sequence of linear systems with slowly changing system matrices, subspace recycling, which exploits relationships among systems and reuses search space information, can achieve huge gains in iterations…

Numerical Analysis · Mathematics 2023-06-28 Misha E. Kilmer , Eric de Sturler

Many challenging tasks in sensor networks, including sensor calibration, ranking of nodes, monitoring, event region detection, collaborative filtering, collaborative signal processing, {\em etc.}, can be formulated as a problem of solving a…

Distributed, Parallel, and Cluster Computing · Computer Science 2008-11-21 Ezra N. Hoch , Danny Bickson , Danny Dolev

In this paper, we consider the iterative solution of linear algebraic equations under the condition that matrix-vector products with the coefficient matrix are computed only partially. At the same time, non-computed entries are set to…

Numerical Analysis · Mathematics 2024-10-15 Vassilis Kalantzis , Yuanzhe Xi , Lior Horesh , Yousef Saad

Pipelined Krylov subspace methods (also referred to as communication-hiding methods) have been proposed in the literature as a scalable alternative to classic Krylov subspace algorithms for iteratively computing the solution to a large…

Numerical Analysis · Computer Science 2019-05-16 Siegfried Cools , Jeffrey Cornelis , Wim Vanroose

In this paper, we derive a practical, general framework for creating adaptive iterative (linearization or splitting) algorithms to solve multi-physics problems. This means that, given an iterative method, we derive \textit{a posteriori}…

Numerical Analysis · Mathematics 2026-01-26 Jakob S. Stokke , Kundan Kumar , Florin A. Radu

In this paper, we introduce a unified framework for nonlinear Krylov subspace methods (nlKrylov) to solve systems of nonlinear equations. Building on classical GCR-like/type linear Krylov solvers such as GMRESR, we generalize these…

Numerical Analysis · Mathematics 2025-11-19 Tom Werner , Ning Wan , Agnieszka Miedlar

A hierarchical solver is proposed for solving sparse ill-conditioned linear systems in parallel. The solver is based on a modification of the LoRaSp method, but employs a deferred-compression technique, which provably reduces the…

Numerical Analysis · Mathematics 2019-09-04 Chao Chen , Leopold Cambier , Erik G. Boman , Sivasankaran Rajamanickam , Raymond S. Tuminaro , Eric Darve

Several problems in machine learning, statistics, and other fields rely on computing eigenvectors. For large scale problems, the computation of these eigenvectors is typically performed via iterative schemes such as subspace iteration or…

Numerical Analysis · Mathematics 2020-11-03 Vasileios Charisopoulos , Austin R. Benson , Anil Damle

Large, sparse linear systems are pervasive in modern science and engineering, and Krylov subspace solvers are an established means of solving them. Yet convergence can be slow for ill-conditioned matrices, so practical deployments usually…

Krylov subspace recycling is a powerful tool for solving long series of large, sparse linear systems that change slowly. In PDE constrained shape optimization, these appear naturally, as hundreds or more optimization steps are needed with…

Numerical Analysis · Mathematics 2020-10-23 Matthias Bolten , Eric de Sturler , Camilla Hahn

We consider the solution of large stiff systems of ordinary differential equations with explicit exponential Runge--Kutta integrators. These problems arise from semi-discretized semi-linear parabolic partial differential equations on…

Numerical Analysis · Mathematics 2023-08-24 Kai Bergermann , Martin Stoll

When an iterative method is applied to solve the linear equation system in interior point methods (IPMs), the attention is usually placed on accelerating their convergence by designing appropriate preconditioners, but the linear solver is…

Optimization and Control · Mathematics 2023-04-28 Filippo Zanetti , Jacek Gondzio

Most current prevalent iterative methods can be classified into the so-called extended Krylov subspace methods, a class of iterative methods which do not fall into this category are also proposed in this paper. Comparing with traditional…

Numerical Analysis · Mathematics 2015-11-26 Wujian Peng , Qun Lin

Iterative methods for solving large sparse systems of linear equations are widely used in many HPC applications. Extreme scaling of these methods can be difficult, however, since global communication to form dot products is typically…

Mathematical Software · Computer Science 2020-09-29 Nick Brown , J. Mark Bull , Iain Bethune

Linear systems governed by continuous-time difference equations cover a wide class of linear systems. From the Lyapunov-Krasovskii approach, we investigate stability for such a class of systems. Sufficient conditions, and in some particular…

Optimization and Control · Mathematics 2013-12-30 S. Damak , M. Di Loreto , W. Lombardi , V Andrieu

This paper presents our work on designing scalable linear solvers for large-scale reservoir simulations. The main objective is to support implementation of parallel reservoir simulators on distributed-memory parallel systems, where MPI…

Mathematical Software · Computer Science 2017-01-24 Hui Liu , Zhangxin Chen

It is shown in this paper that, almost all current prevalent iterative \mbox{methods} for solving linear system of equations can be classified as what we called extended Krylov subspace methods. In this paper a new type of iterative methods…

Numerical Analysis · Mathematics 2016-03-18 Wujian Peng , Shuhua Zhang

As we stride toward the exascale era, due to increasing complexity of supercomputers, hard and soft errors are causing more and more problems in high-performance scientific and engineering computation. In order to improve reliability…

Numerical Analysis · Mathematics 2013-09-03 Tao Cui , Jinchao Xu , Chen-Song Zhang

Scaling hyperparameter optimisation to very large datasets remains an open problem in the Gaussian process community. This paper focuses on iterative methods, which use linear system solvers, like conjugate gradients, alternating…

Machine Learning · Computer Science 2025-01-14 Jihao Andreas Lin , Shreyas Padhy , Bruno Mlodozeniec , Javier Antorán , José Miguel Hernández-Lobato