English
Related papers

Related papers: Polynomial Preconditioners for Regularized Linear …

200 papers

In this paper, we investigate regularization of linear inverse problems with irregular noise. In particular, we consider the case that the noise can be preprocessed by certain adjoint embedding operators. By introducing the consequent…

Numerical Analysis · Mathematics 2024-01-30 Xinyan Li , Simon Hubmer , Shuai Lu , Ronny Ramlau

Preconditioning is the most widely used and effective way for treating ill-conditioned linear systems in the context of classical iterative linear system solvers. We introduce a quantum primitive called fast inversion, which can be used as…

Quantum Physics · Physics 2021-09-29 Yu Tong , Dong An , Nathan Wiebe , Lin Lin

We present a polynomial preconditioner for solving large systems of linear equations. The polynomial is derived from the minimum residual polynomial (the GMRES polynomial) and is more straightforward to compute and implement than many…

Numerical Analysis · Mathematics 2022-01-13 Jennifer A. Loe , Ronald B. Morgan

In this work, we develop proximal preconditioned gradient methods with a focus on spectral gradient methods providing a proximal extension to the Muon and Scion optimizers. We introduce a family of stochastic algorithms that can handle a…

This paper explores preconditioning the normal equation for non-symmetric square linear systems arising from PDE discretization, focusing on methods like CGNE and LSQR. The concept of ``normal'' preconditioning is introduced and a strategy…

Numerical Analysis · Mathematics 2025-03-03 Lorenzo Lazzarino , Yuji Nakatsukasa , Umberto Zerbinati

In this paper we present general-purpose preconditioners for regularized augmented systems arising from optimization problems, and their corresponding normal equations. We discuss positive definite preconditioners, suitable for CG and…

Optimization and Control · Mathematics 2022-04-01 Jacek Gondzio , Spyridon Pougkakiotis , John W. Pearson

This paper investigates using the conjugate gradient iterative solver for ill-posed problems. We show that preconditioner and Tikhonov-regularization work in conjunction. In particular when they employ the same symmetric positive…

Numerical Analysis · Mathematics 2025-12-12 Ahmed Chabib , Jean-Francois Witz , Vincent Magnier , Pierre Gosselet

We are presenting a modification of the well-known Alternating Direction Method of Multipliers (ADMM) algorithm with additional preconditioning that aims at solving convex optimisation problems with nonlinear operator constraints.…

Numerical Analysis · Mathematics 2020-02-13 Martin Benning , Florian Knoll , Carola-Bibiane Schönlieb , Tuomo Valkonen

We deal with interval parametric systems of linear equations and the goal is to solve such systems, which basically comes down to finding an enclosure for a parametric solution set. Obviously we want this enclosure to be as tight as…

Numerical Analysis · Mathematics 2025-10-07 Iwona Skalna , Milan Hladík

Polynomial convergence bounds are considered for left, right, and split preconditioned GMRES. They include the cases of Weighted and Deflated GMRES for a linear system Ax = b. In particular, the case of positive definite A is considered.…

Numerical Analysis · Mathematics 2025-10-03 Nicole Spillane , Daniel B Szyld

Efficient numerical solvers for partial differential equations empower science and engineering. One of the commonly employed numerical solvers is the preconditioned conjugate gradient (PCG) algorithm which can solve large systems to a given…

Numerical Analysis · Mathematics 2023-09-07 Yichen Li , Peter Yichen Chen , Tao Du , Wojciech Matusik

Composite optimization problems involve minimizing the composition of a smooth map with a convex function. Such objectives arise in numerous data science and signal processing applications, including phase retrieval, blind deconvolution,…

Optimization and Control · Mathematics 2025-10-06 Mateo Díaz , Liwei Jiang , Abdel Ghani Labassi

We propose a method for the construction of preconditioners of parameter-dependent matrices for the solution of large systems of parameter-dependent equations. The proposed method is an interpolation of the matrix inverse based on a…

Numerical Analysis · Mathematics 2016-10-26 Olivier Zahm , Anthony Nouy

Preconditioning has long been a staple technique in optimization, often applied to reduce the condition number of a matrix and speed up the convergence of algorithms. Although there are many popular preconditioning techniques in practice,…

Optimization and Control · Mathematics 2022-11-08 Zhaonan Qu , Wenzhi Gao , Oliver Hinder , Yinyu Ye , Zhengyuan Zhou

We present a preconditioner based on spectral projection that is combined with a deflated Krylov subspace method for solving ill conditioned linear systems of equations. Our results show that the proposed algorithm requires many fewer…

Numerical Analysis · Mathematics 2016-09-23 Man-Chung Yeung , Craig C. Douglas , Long Lee

For real matrices of full column-rank, we analyze the conditioning of several types of normal equations that are preconditioned by a randomized preconditioner computed in lower precision. These include symmetrically preconditioned normal…

Numerical Analysis · Mathematics 2026-03-18 James E. Garrison , Ilse C. F. Ipsen

This paper considers the problem of approximating the inverse of the wave-equation Hessian, also called normal operator, in seismology and other types of wave-based imaging. An expansion scheme for the pseudodifferential symbol of the…

Numerical Analysis · Mathematics 2015-03-17 Laurent Demanet , Pierre-David Létourneau , Nicolas Boumal , Henri Calandra , Jiawei Chiu , Stanley Snelson

Pre-conditioning is a well-known concept that can significantly improve the convergence of optimization algorithms. For noise-free problems, where good pre-conditioners are not known a priori, iterative linear algebra methods offer one way…

Machine Learning · Computer Science 2019-02-21 Filip de Roos , Philipp Hennig

Regularization methods are a key tool in the solution of inverse problems. They are used to introduce prior knowledge and make the approximation of ill-posed (pseudo-)inverses feasible. In the last two decades interest has shifted from…

Numerical Analysis · Mathematics 2018-01-31 Martin Benning , Martin Burger

The boundary integral method is an efficient approach for solving time-harmonic obstacle scattering problems by a bounded scatterer. This paper presents the directional preconditioner for the iterative solution of linear systems of the…

Numerical Analysis · Mathematics 2014-09-17 Lexing Ying