English
Related papers

Related papers: Bayes meets Krylov: preconditioning CGLS for under…

200 papers

We propose a novel numerical inversion algorithm for the coefficients of parabolic partial differential equations, based on model reduction. The study is motivated by the application of controlled source electromagnetic exploration, where…

Numerical Analysis · Mathematics 2014-11-21 Liliana Borcea , Vladimir Druskin , Alexander V. Mamonov , Mikhail Zaslavsky

Inverse problems arise in various scientific and engineering applications, necessitating robust numerical methods for their solution. In this work, we consider the effectiveness of Krylov subspace iterative methods, including GMRES, QMR,…

Numerical Analysis · Mathematics 2025-08-11 Moshen Hu , Lucas Onisk

Several recent works have developed a new, probabilistic interpretation for numerical algorithms solving linear systems in which the solution is inferred in a Bayesian framework, either directly or by inferring the unknown action of the…

Computation · Statistics 2018-10-18 Simon Bartels , Jon Cockayne , Ilse C. F. Ipsen , Philipp Hennig

For the large-scale linear discrete ill-posed problem $\min\|Ax-b\|$ or $Ax=b$ with $b$ contaminated by Gaussian white noise, the Lanczos bidiagonalization based Krylov solver LSQR and its mathematically equivalent CGLS, the Conjugate…

Numerical Analysis · Mathematics 2020-03-20 Zhongxiao Jia

Bilevel optimization, with broad applications in machine learning, has an intricate hierarchical structure. Gradient-based methods have emerged as a common approach to large-scale bilevel problems. However, the computation of the…

Optimization and Control · Mathematics 2025-02-27 Yan Yang , Bin Gao , Ya-xiang Yuan

We propose two techniques aimed at improving the convergence rate of steady state and eigenvalue solvers preconditioned by the inverse Stokes operator and realized via time-stepping. First, we suggest a generalization of the Stokes operator…

Computational Physics · Physics 2018-04-13 Alexander Gelfgat

CG, SYMMLQ, and MINRES are Krylov subspace methods for solving symmetric systems of linear equations. When these methods are applied to an incompatible system (that is, a singular symmetric least-squares problem), CG could break down and…

Numerical Analysis · Mathematics 2015-03-30 Sou-Cheng T. Choi , Christopher C. Paige , Michael A. Saunders

High-quality reconstructions of signals and images with sharp edges are needed in a wide range of applications. To overcome the large dimensionality of the parameter space and the complexity of the regularization functional,…

Numerical Analysis · Mathematics 2025-05-06 Jonathan Lindbloom , Mirjeta Pasha , Jan Glaubitz , Youssef Marzouk

In this paper, first a great number of inverse problems which arise in instrumentation, in computer imaging systems and in computer vision are presented. Then a common general forward modeling for them is given and the corresponding…

Data Analysis, Statistics and Probability · Physics 2007-05-23 Ali Mohammad-Djafari

When a mathematical or computational model is used to analyse some system, it is usual that some parameters resp.\ functions or fields in the model are not known, and hence uncertain. These parametric quantities are then identified by…

Probability · Mathematics 2016-07-01 Hermann G. Matthies , Elmar Zander , Bojana Rosic , Alexander Litvinenko

We consider the linear least squares problem with linear equality constraints (LSE problem) formulated as $\min_{x\in\mathbb{R}^{n}}\|Ax-b\|_2 \ \mathrm{s.t.} \ Cx = d$. Although there are some classical methods available to solve this…

Numerical Analysis · Mathematics 2025-01-06 Haibo Li

Many problems in science and engineering fields require the solution of shifted linear systems. To solve such systems efficiently, the recycling BiCG (RBiCG) algorithm in [SIAM J. SCI. COMPUT, 34 (2012) 1925-1949] is extended in this paper.…

Numerical Analysis · Mathematics 2014-06-26 Jing Meng , Pei-yong Zhu , Hou-Biao Li

Using observation data to estimate unknown parameters in computational models is broadly important. This task is often challenging because solutions are non-unique due to the complexity of the model and limited observation data. However,…

Methodology · Statistics 2018-12-18 Jiacheng Wu , Jian-Xun Wang , Shawn C. Shadden

This paper introduces inexact versions of several block-splitting preconditioners for solving the three-by-three block linear systems arising from a special class of indefinite least squares problems. We first establish the convergence…

Numerical Analysis · Mathematics 2026-05-26 Mohaddese Kaveh Shaldehi , Davod Khojasteh Salkuyeh

This paper presents a study of the inherent structural properties of Krylov subspaces, in particular for the self-adjoint class of operators, and how they relate with the important phenomenon of `Krylov solvability' of linear inverse…

Functional Analysis · Mathematics 2024-10-31 Noè Angelo Caruso

We consider deflation and augmentation techniques for accelerating the convergence of Krylov subspace methods for the solution of nonsingular linear algebraic systems. Despite some formal similarity, the two techniques are conceptually…

Numerical Analysis · Mathematics 2015-10-20 André Gaul , Martin H. Gutknecht , Jörg Liesen , Reinhard Nabben

In this paper, an idea to solve nonlinear equations is presented. During the solution of any problem with Newton's Method, it might happen that some of the unknowns satisfy the convergence criteria where the others fail. The convergence…

Mathematical Software · Computer Science 2012-03-15 Erhan Turan , Ali Ecder

It is well-known that the convergence of Krylov subspace methods to solve linear system depends on the spectrum of the coefficient matrix, moreover, it is widely accepted that for both symmetric and unsymmetric systems Krylov subspace…

Numerical Analysis · Mathematics 2013-04-09 Tao Zhao

Bayesian inverse problems use observed data to update a prior probability distribution for an unknown state or parameter of a scientific system to a posterior distribution conditioned on the data. In many applications, the unknown parameter…

Numerical Analysis · Mathematics 2026-05-12 Josie König , Elizabeth Qian , Melina A. Freitag

This work considers the iterative solution of large-scale problems subject to non-symmetric matrices or operators arising in discretizations of (port-)Hamiltonian partial differential equations. We consider problems governed by an operator…

Numerical Analysis · Mathematics 2025-10-21 Volker Mehrmann , Manuel Schaller , Martin Stoll