English
Related papers

Related papers: Matrix-free polynomial preconditioning of saddle p…

200 papers

In this paper, we derive a randomized version of the Mirror-Prox method for solving some structured matrix saddle-point problems, such as the maximal eigenvalue minimization problem. Deterministic first-order schemes, such as Nesterov's…

Optimization and Control · Mathematics 2011-12-07 Michel Baes , Michael Bürgisser , Arkadi Nemirovski

The model reduction problem for high-order multi-input, multi-output (MIMO) polynomial nonlinear systems based on moment matching is addressed. The technique of power-series decomposition is exploited: this decomposes the solution of the…

Systems and Control · Electrical Eng. & Systems 2025-08-20 Chao Huang , Alessandro Astolfi

We consider block preconditioners for double saddle-point systems, and investigate the effect of approximating the nested Schur complement associated with the trailing diagonal block on the eigenvalue distribution of the preconditioned…

Numerical Analysis · Mathematics 2026-01-27 Chen Greif

Rearranging the rows or columns of a sparse matrix using an appropriate ordering can significantly reduce fill-ins, i.e., new nonzeros introduced during matrix factorization, decreasing memory usage and runtime. However, finding an ordering…

Machine Learning · Computer Science 2026-05-19 Ziwei Li , Tao Yuan , Fangfang Liu , Shuzi Niu , Huiyuan Li , Wenjia Wu

This note proposes an efficient preconditioner for solving linear and semi-linear parabolic equations. With the Crank-Nicholson time stepping method, the algebraic system of equations at each time step is solved with the conjugate gradient…

Numerical Analysis · Mathematics 2021-05-11 Jordi Feliu-Fabà , Lexing Ying

The efficient solution of moderately large-scale linear systems arising from the KKT conditions in optimal control problems (OCPs) is a critical challenge in robotics. With the stagnation of Moore's law, there is growing interest in…

Optimization and Control · Mathematics 2025-05-21 Shaohui Yang , Toshiyuki Ohtsuka , Brian Plancher , Colin N. Jones

Polynomial preconditioning is an important tool in solving large linear systems and eigenvalue problems. A polynomial from GMRES can be used to precondition restarted GMRES and restarted Arnoldi. Here we give methods for indefinite matrices…

Numerical Analysis · Mathematics 2025-10-17 Hayden Henson , Ronald B. Morgan

Despite their popularity in the field of continuous optimisation, second-order quasi-Newton methods are challenging to apply in machine learning, as the Hessian matrix is intractably large. This computational burden is exacerbated by the…

Machine Learning · Computer Science 2024-02-28 Elre T. Oldewage , Ross M. Clarke , José Miguel Hernández-Lobato

The performance of finite element solvers on modern computer architectures is typically memory bound for sufficiently large problems. The main cause for this is that loading matrix elements from RAM into CPU cache is significantly slower…

Numerical Analysis · Mathematics 2019-05-01 Denis Davydov , Jean-Paul Pelteret , Daniel Arndt , Paul Steinmann

A central challenge to many fields of science and engineering involves minimizing non-convex error functions over continuous, high dimensional spaces. Gradient descent or quasi-Newton methods are almost ubiquitously used to perform such…

Machine Learning · Computer Science 2014-05-29 Razvan Pascanu , Yann N. Dauphin , Surya Ganguli , Yoshua Bengio

Vertex-patch smoothers offer an effective strategy for achieving robust geometric multigrid convergence for the Stokes equations, particularly in the context of high-order finite elements. However, their practical efficiency is often…

Numerical Analysis · Mathematics 2026-01-21 Michał Wichrowski

A non-overlapping domain decomposition algorithm is proposed to solve the linear system arising from mixed finite element approximation of incompressible Stokes equations. A continuous finite element space for the pressure is used. In the…

Numerical Analysis · Mathematics 2012-04-10 Jing Li , Xuemin Tu

In this paper we present an efficient iterative method of order six for the inclusion of the inverse of a given regular matrix. To provide the upper error bound of the outer matrix for the inverse matrix, we combine point and interval…

Numerical Analysis · Mathematics 2014-06-23 Marko D. Petkovic , Miodrag S. Petkovic

We introduce a robust and efficient preconditioner for a hybrid Newton-GMRES method for solving the nonlinear systems arising from incompressible Navier-Stokes equations. When the Reynolds number is relatively high, these systems often…

Computational Engineering, Finance, and Science · Computer Science 2021-08-16 Qiao Chen , Xiangmin Jiao , Oliver Yang

The block structure of double saddle-point problems has prompted extensive research into efficient preconditioners. This paper introduces a novel class of three-by-three block preconditioners tailored for such systems from the…

Numerical Analysis · Mathematics 2025-12-09 Achraf Badahmane

We study the performance of a new block preconditioner for a class of $3\times3$ block saddle point problems which arise from finite element methods for solving time-dependent Maxwell equations and some other practical problems. We also…

Numerical Analysis · Mathematics 2021-09-24 Maryam Abdolmaleki , Saeed Karimi , Davod Khojasteh Salkuyeh

In this article, we derive a new, fast, and robust preconditioned iterative solution strategy for the all-at-once solution of optimal control problems with time-dependent PDEs as constraints, including the heat equation and the non-steady…

Numerical Analysis · Mathematics 2020-07-17 Santolo Leveque , John W. Pearson

In this paper, we describe and analyze the spectral properties of a symmetric positive definite inexact block preconditioner for a class of symmetric, double saddle-point linear systems. We develop a spectral analysis of the preconditioned…

Numerical Analysis · Mathematics 2024-05-27 Luca Bergamaschi , Angeles Martinez , John Pearson , Andreas Potschka

Recently, Bai and Benzi proposed a class of regularized Hermitian and skew-Hermitian splitting methods (RHSS) iteration methods for solving the nonsingular saddle point problem. In this paper, we apply this method to solve the singular…

Numerical Analysis · Mathematics 2017-10-26 Zhen Chao , Guoliang Chen

Based on the needs of convergence proofs of preconditioned proximal point methods, we introduce notions of partial strong submonotonicity and partial (metric) subregularity of set-valued maps. We study relationships between these two…

Optimization and Control · Mathematics 2020-03-02 Tuomo Valkonen