English
Related papers

Related papers: Optimal preconditioners for systems defined by fun…

200 papers

Pre-conditioning is a well-known concept that can significantly improve the convergence of optimization algorithms. For noise-free problems, where good pre-conditioners are not known a priori, iterative linear algebra methods offer one way…

Machine Learning · Computer Science 2019-02-21 Filip de Roos , Philipp Hennig

We study preconditioners for a model problem describing the coupling of two elliptic subproblems posed over domains with different topological dimension by a parameter dependent constraint. A pair of parameter robust and efficient…

Numerical Analysis · Mathematics 2018-04-11 Miroslav Kuchta , Magne Nordaas , Joris C. G. Verschaeve , Mikael Mortensen , Kent-Andre Mardal

We propose an operator preconditioner for general elliptic pseudodifferential equations in a domain $\Omega$, where $\Omega$ is either in $\mathbb{R}^n$ or in a Riemannian manifold. For linear systems of equations arising from low-order…

Numerical Analysis · Mathematics 2021-06-03 Heiko Gimperlein , Jakub Stocek , Carolina Urzua-Torres

In this paper we propose an efficiently preconditioned Newton method for the computation of the leftmost eigenpairs of large and sparse symmetric positive definite matrices. A sequence of preconditioners based on the BFGS update formula is…

Numerical Analysis · Mathematics 2013-12-06 Luca Bergamaschi , Angeles Martinez

Preconditioning is at the core of modern many-fermion Monte Carlo algorithms, such as Hybrid Monte Carlo, where the repeated solution of a linear problem involving an ill-conditioned matrix is needed. We report on a performance comparison…

High Energy Physics - Lattice · Physics 2010-08-24 Timour Ten , Joaquín E. Drut , Timo A. Lähde

Under appropriate technical assumptions, the simple-loop theory allows to deduce various types of asymptotic expansions for the eigenvalues of Toeplitz matrices $T_{n}(f)$ generated by a function $f$, unfortunately, such a theory is not…

Numerical Analysis · Mathematics 2022-03-23 Manuel Bogoya , Stefano Serra-Cappizano , Paris Vassalos

This paper develops the preconditioning technique as a method to address the accuracy issue caused by ill-conditioning. Given a preconditioner $M$ for an ill-conditioned linear system $Ax=b$, we show that, if the inverse of the…

Numerical Analysis · Mathematics 2017-05-15 Qiang Ye

Off-lattice agent-based models (or cell-based models) of multicellular systems are increasingly used to create in-silico models of in-vitro and in-vivo experimental setups of cells and tissues, such as cancer spheroids, neural crest cell…

Numerical Analysis · Mathematics 2026-02-23 Justin Steinman , Andreas Buttenschön

The nearest circulant approximation of a real Toeplitz matrix in the Frobenius norm is derived. This matrix is symmetric. It is proven that symmetric circulant matrices are the only real circulant matrices with all real eigenvalues. The…

Rings and Algebras · Mathematics 2022-08-12 Chris Salahub

The Morse-Ingard equations of thermoacoustics are a system of coupled time-harmonic equations for the temperature and pressure of an excited gas. They form a critical aspect of modeling trace gas sensors. In this paper, we analyze a…

Numerical Analysis · Mathematics 2019-11-26 Peter Coogan , Robert C. Kirby

This paper introduces inexact versions of several block-splitting preconditioners for solving the three-by-three block linear systems arising from a special class of indefinite least squares problems. We first establish the convergence…

Numerical Analysis · Mathematics 2026-05-26 Mohaddese Kaveh Shaldehi , Davod Khojasteh Salkuyeh

We introduce and analyze a continuous primal-dual dynamical system in the context of the minimization problem $f(x)+g(Ax)$, where $f$ and $g$ are convex functions and $A$ is a linear operator. In this setting, the trajectories of the…

Optimization and Control · Mathematics 2025-06-03 Vassilis Apidopoulos , Cesare Molinari , Juan Peypouquet , Silvia Villa

At the heart of Newton based optimization methods is a sequence of symmetric linear systems. Each consecutive system in this sequence is similar to the next, so solving them separately is a waste of computational effort. Here we describe…

Optimization and Control · Mathematics 2014-12-30 Robert Mansel Gower , Jacek Gondzio

We analyze a preconditioned subgradient method for optimizing composite functions $h \circ c$, where $h$ is a locally Lipschitz function and $c$ is a smooth nonlinear mapping. We prove that when $c$ satisfies a constant rank property and…

Optimization and Control · Mathematics 2022-12-29 Damek Davis , Tao Jiang

Gaussian process hyperparameter optimization requires linear solves with, and log-determinants of, large kernel matrices. Iterative numerical techniques are becoming popular to scale to larger datasets, relying on the conjugate gradient…

Machine Learning · Computer Science 2022-06-22 Jonathan Wenger , Geoff Pleiss , Philipp Hennig , John P. Cunningham , Jacob R. Gardner

In this paper we introduce an algebraic recursive multilevel incomplete factorization preconditioner, based on a distributed Schur complement formulation, for solving general linear systems. The novelty of the proposed method is to combine…

Numerical Analysis · Mathematics 2015-09-23 Yiming Bu , Bruno Carpentieri , Zhaoli Shen , Tingzhu Huang

We consider an automatic construction of locally optimal preconditioners for positive definite linear systems. To achieve this goal, we introduce a differentiable loss function that does not explicitly include the estimation of minimal…

Numerical Analysis · Mathematics 2022-05-14 Vladimir Fanaskov , Ivan Oseledets

Large linear systems are ubiquitous in modern computational science and engineering. The main recipe for solving them is the use of Krylov subspace iterative methods with well-designed preconditioners. Recently, GNNs have been shown to be a…

Machine Learning · Computer Science 2025-02-04 Vladislav Trifonov , Alexander Rudikov , Oleg Iliev , Yuri M. Laevsky , Ivan Oseledets , Ekaterina Muravleva

In this paper we study the conditioning of optimal control problems constrained by linear parabolic equations with Neumann boundary conditions. While we concentrate on a given end-time target function the results hold also when the target…

Numerical Analysis · Mathematics 2025-03-24 Luise Blank

We consider the preconditioned conjugate gradient method (PCG) with optimal preconditioner in the frame of the boundary element method (BEM) for elliptic first-kind integral equations. Our adaptive algorithm steers the termination of PCG as…

Numerical Analysis · Mathematics 2019-03-21 Thomas Führer , Alexander Haberl , Dirk Praetorius , Stefan Schimanko