English
Related papers

Related papers: Some preconditioning techniques for a class of dou…

200 papers

A general regularization strategy is considered for the efficient iterative solution of the lowest-order weak Galerkin approximation of singular Stokes problems. The strategy adds a rank-one regularization term to the zero (2,2) block of…

Numerical Analysis · Mathematics 2025-05-16 Weizhang Huang , Zhuoran Wang

We propose an augmented Lagrangian-based preconditioner to accelerate the convergence of Krylov subspace methods applied to linear systems of equations with a block three-by-three structure such as those arising from mixed finite element…

Numerical Analysis · Mathematics 2023-10-26 Fatemeh P. A. Beik , Michele Benzi

Polynomial preconditioning is an important tool in solving large linear systems and eigenvalue problems. A polynomial from GMRES can be used to precondition restarted GMRES and restarted Arnoldi. Here we give methods for indefinite matrices…

Numerical Analysis · Mathematics 2025-10-17 Hayden Henson , Ronald B. Morgan

In this article, we propose and study a stochastic and relaxed preconditioned Douglas--Rachford splitting method to solve saddle-point problems that have separable dual variables. We prove the almost sure convergence of the iteration…

Optimization and Control · Mathematics 2024-10-01 Yakun Dong , Kristian Bredies , Hongpeng Sun

Based on the needs of convergence proofs of preconditioned proximal point methods, we introduce notions of partial strong submonotonicity and partial (metric) subregularity of set-valued maps. We study relationships between these two…

Optimization and Control · Mathematics 2020-03-02 Tuomo Valkonen

In this paper, we present novel randomized algorithms for solving saddle point problems whose dual feasible region is given by the direct product of many convex sets. Our algorithms can achieve an ${\cal O}(1/N)$ and ${\cal O}(1/N^2)$ rate…

Optimization and Control · Mathematics 2015-11-16 Cong Dang , Guanghui Lan

We explore a scaled spectral preconditioner for the efficient solution of sequences of symmetric and positive-definite linear systems. We design the scaled preconditioner not only as an approximation of the inverse of the linear system but…

Numerical Analysis · Mathematics 2024-10-04 Youssef Diouane , Selime Gürol , Oussama Mouhtal , Dominique Orban

We address the problem of preconditioning a sequence of saddle point linear systems arising in the solution of PDE-constrained optimal control problems via active-set Newton methods, with control and (regularized) state constraints. We…

Numerical Analysis · Mathematics 2015-05-25 Margherita Porcelli , Valeria Simoncini , Mattia Tani

An inherent regularization strategy and block Schur complement preconditioning are studied for linear poroelasticity problems discretized using the lowest-order weak Galerkin FEM in space and the implicit Euler scheme in time. At each time…

Numerical Analysis · Mathematics 2025-07-31 Weizhang Huang , Zhuoran Wang

We shall propose and analyze some new preconditioners for the saddle-point systems arising from the edge element discretization of the time-harmonic Maxwell equations in three dimensions. We will first consider the saddle-point systems with…

Numerical Analysis · Mathematics 2016-10-12 Hua Xiang , Shiyang Zhang , Jun Zou

We present preconditioning techniques to solve linear systems of equations with a block two-by-two and three-by-three structure arising from finite element discretizations of the fictitious domain method with Lagrange multipliers. In…

Numerical Analysis · Mathematics 2026-03-09 Michele Benzi , Marco Feder , Luca Heltai , Federica Mugnaioni

The theory of mixed finite element methods for solving different types of elliptic partial differential equations in saddle point formulation is well established since many decades. This topic was mostly studied for variational formulations…

Numerical Analysis · Mathematics 2024-03-04 Vitoriano Ruas

The efficient solution of moderately large-scale linear systems arising from the KKT conditions in optimal control problems (OCPs) is a critical challenge in robotics. With the stagnation of Moore's law, there is growing interest in…

Optimization and Control · Mathematics 2025-05-21 Shaohui Yang , Toshiyuki Ohtsuka , Brian Plancher , Colin N. Jones

Preconditioning has long been a staple technique in optimization, often applied to reduce the condition number of a matrix and speed up the convergence of algorithms. Although there are many popular preconditioning techniques in practice,…

Optimization and Control · Mathematics 2022-11-08 Zhaonan Qu , Wenzhi Gao , Oliver Hinder , Yinyu Ye , Zhengyuan Zhou

We derive an extension of the sequential homotopy method that allows for the application of inexact solvers for the linear (double) saddle-point systems arising in the local semismooth Newton method for the homotopy subproblems. For the…

Optimization and Control · Mathematics 2023-11-30 John W. Pearson , Andreas Potschka

In contact mechanics computation, the constraint conditions on the contact surfaces are typically enforced by the Lagrange multiplier method, resulting in a saddle point system. Given that the saddle point matrix is indefinite, solving…

Numerical Analysis · Mathematics 2024-09-24 Xiaoyu Duan , Hengbin An

We consider the convex-concave saddle point problem $\min_{\mathbf{x}}\max_{\mathbf{y}}\Phi(\mathbf{x},\mathbf{y})$, where the decision variables $\mathbf{x}$ and/or $\mathbf{y}$ subject to a multi-block structure and affine coupling…

Optimization and Control · Mathematics 2023-03-17 Junyu Zhang , Mengdi Wang , Mingyi Hong , Shuzhong Zhang

The computation of a few singular triplets of large, sparse matrices is a challenging task, especially when the smallest magnitude singular values are needed in high accuracy. Most recent efforts try to address this problem through…

Numerical Analysis · Computer Science 2016-06-21 Lingfei Wu , Andreas Stathopoulos

Adaptive regularization methods pre-multiply a descent direction by a preconditioning matrix. Due to the large number of parameters of machine learning problems, full-matrix preconditioning methods are prohibitively expensive. We show how…

Machine Learning · Computer Science 2020-11-19 Naman Agarwal , Brian Bullins , Xinyi Chen , Elad Hazan , Karan Singh , Cyril Zhang , Yi Zhang

This study explores the integration of the hyper-power sequence, a method commonly employed for approximating the Moore-Penrose inverse, to enhance the effectiveness of an existing preconditioner. The approach is closely related to…

Computational Engineering, Finance, and Science · Computer Science 2023-11-14 Michał Łukasz Mika , Marco ten Eikelder , Dominik Schillinger , René Rinke Hiemstra