English
Related papers

Related papers: An all-at-once preconditioner for evolutionary par…

200 papers

In this paper, we present algorithms and implementations for the end-to-end GPU acceleration of matrix-free low-order-refined preconditioning of high-order finite element problems. The methods described here allow for the construction of…

Mathematical Software · Computer Science 2023-06-05 Will Pazner , Tzanio Kolev , Jean-Sylvain Camier

Adaptive regularization methods pre-multiply a descent direction by a preconditioning matrix. Due to the large number of parameters of machine learning problems, full-matrix preconditioning methods are prohibitively expensive. We show how…

Machine Learning · Computer Science 2020-11-19 Naman Agarwal , Brian Bullins , Xinyi Chen , Elad Hazan , Karan Singh , Cyril Zhang , Yi Zhang

In recent years, there has been a renewed interest in preconditioning for multilevel Toeplitz systems, a research field that has been extensively explored over the past several decades. This work introduces novel preconditioning strategies…

Numerical Analysis · Mathematics 2024-10-01 Sean Y. Hon , Congcong Li , Rosita L. Sormani , Rolf Krause , Stefano Serra-Capizzano

This paper presents a couple of preconditioning techniques that can be used to enhance the performance of iterative regularization methods applied to image deblurring problems with a variety of point spread functions (PSFs) and boundary…

Numerical Analysis · Mathematics 2022-12-13 Marco Donatelli , Paola Ferrari , Silvia Gazzola

For nonsymmetric block three-by-three singular saddle point problems arising from the Picard iteration method for a class of mixed finite element scheme, recently Salkuyeh et al. in (D.K. Salkuyeh, H. Aslani, Z.Z. Liang, An alternating…

Numerical Analysis · Mathematics 2022-08-02 Hamed Aslani , Davod Khojasteh Salkuyeh

In this article, a two-level overlapping domain decomposition preconditioner is developed for solving linear algebraic systems obtained from simulating Darcy flow in high-contrast media. Our preconditioner starts at a mixed finite element…

Numerical Analysis · Mathematics 2024-03-29 Changqing Ye , Shubin Fu , Eric T. Chung , Jizu Huang

Compatible finite element discretisations for the atmospheric equations of motion have recently attracted considerable interest. Semi-implicit timestepping methods require the repeated solution of a large saddle-point system of linear…

We propose parameter-robust preconditioners for the statically condensed linear system arising from a hybridizable discontinuous Galerkin discretization of the coupled Stokes--Darcy system. The design strategy relies on first applying the…

Numerical Analysis · Mathematics 2026-04-27 Esteban Henríquez , Miroslav Kuchta , Jeonghun J. Lee , Sander Rhebergen

We derive nonlinear acceleration methods based on the limited memory BFGS (L-BFGS) update formula for accelerating iterative optimization methods of alternating least squares (ALS) type applied to canonical polyadic (CP) and Tucker tensor…

Numerical Analysis · Mathematics 2018-06-28 Hans De Sterck , Alexander J. M. Howse

The use of the Preconditioned Conjugate Gradient (PCG) method for computing the Generalized Least Squares (GLS) estimator of the General Linear Model (GLM) is considered. The GLS estimator is expressed in terms of the solution of an…

Numerical Analysis · Mathematics 2025-10-17 Paolo Foschi

This paper focuses on the design, analysis and implementation of a new preconditioning concept for linear second order partial differential equations, including the convection-diffusion-reaction problems discretized by Galerkin or…

Numerical Analysis · Mathematics 2023-04-27 Liya Gaynutdinova , Martin Ladecký , Ivana Pultarová , Miloslav Vlasák , Jan Zeman

In this paper, we study a class of inexact block triangular preconditioners for double saddle-point symmetric linear systems arising from the mixed finite element and mixed hybrid finite element discretization of Biot's poroelasticity…

Numerical Analysis · Mathematics 2025-07-02 Luca Bergamaschi , Massimiliano Ferronato , Angeles Martinez

This paper explores preconditioning the normal equation for non-symmetric square linear systems arising from PDE discretization, focusing on methods like CGNE and LSQR. The concept of ``normal'' preconditioning is introduced and a strategy…

Numerical Analysis · Mathematics 2025-03-03 Lorenzo Lazzarino , Yuji Nakatsukasa , Umberto Zerbinati

The phase separation processes are typically modeled by Cahn-Hilliard equations. This equation was originally introduced to model phase separation in binary alloys, where phase stands for concentration of different components in alloy. When…

Numerical Analysis · Computer Science 2016-01-14 Pawan Kumar

We present a preconditioning method for the linear systems arising from the boundary element discretization of the Laplace hypersingular equation on a $2$-dimensional triangulated surface $\Gamma$ in $\mathbb{R}^3$. We allow $\Gamma$ to…

Numerical Analysis · Mathematics 2023-10-16 Martin Averseng , Xavier Claeys , Ralf Hiptmair

A block decomposition method is proposed for minimizing a (possibly non-convex) continuously differentiable function subject to one linear equality constraint and simple bounds on the variables. The proposed method iteratively selects a…

Optimization and Control · Mathematics 2019-03-06 Andrea Cristofari

This paper proposes and tests the first-ever reduced basis warm-start iterative method for the parametrized linear systems, exemplified by those discretizing the parametric partial differential equations. Traditional iterative methods are…

Numerical Analysis · Mathematics 2024-01-08 Shijin Hou , Yanlai Chen , Yinhua Xia

We consider using the preconditioned-Krylov subspace method to solve the system of linear equations with a three-by-three block structure. By making use of the three-by-three block structure, eight inexact block factorization…

Numerical Analysis · Mathematics 2022-11-18 Sheng-Zhong Song , Zheng-Da Huang

We introduce a unified framework for computing approximately-optimal preconditioners for solving linear and non-linear systems of equations. We demonstrate that the condition number minimization problem, under structured transformations…

Optimization and Control · Mathematics 2025-12-09 M. Levent Doğan , Alperen Ergür , Elias Tsigaridas

In several geophysical applications, such as full waveform inversion and data modelling, we are facing the solution of inhomogeneous Helmholtz equation. The difficulties of solving the Helmholtz equa- tion are two fold. Firstly, in the case…

Geophysics · Physics 2017-12-27 Nasser Kazemi