English
Related papers

Related papers: A new class of regularized preconditioners for dou…

200 papers

We propose a modified primal-dual method for general convex optimization problems with changing constraints. We obtain properties of Lagrangian saddle points for these problems which enable us to establish convergence of the proposed…

Optimization and Control · Mathematics 2022-01-04 Igor Konnov

We consider the numerical solution of large scale time-harmonic Maxwell equations. To this day, this problem remains difficult, in particular because the equations are neither Hermitian nor semi-definite. Our approach is to compare…

Numerical Analysis · Mathematics 2025-07-18 Elise Fressart , Sébastien Dubois , Loïc Gouarin , Marc Massot , Michel Nowak , Nicole Spillane

We develop a novel iterative solution method for the incompressible Navier-Stokes equations with boundary conditions coupled with reduced models. The iterative algorithm is designed based on the variational multiscale formulation and the…

Numerical Analysis · Mathematics 2020-06-24 Ju Liu , Weiguang Yang , Melody Dong , Alison L. Marsden

Recently, the problem of local minima in very high dimensional non-convex optimization has been challenged and the problem of saddle points has been introduced. This paper introduces a dynamic type of normalization that forces the system to…

Machine Learning · Computer Science 2017-02-08 Armen Aghajanyan

We develop an inexact primal-dual first-order smoothing framework to solve a class of non-bilinear saddle point problems with primal strong convexity. Compared with existing methods, our framework yields a significant improvement over the…

Optimization and Control · Mathematics 2023-07-25 Le Thi Khanh Hien , Renbo Zhao , William B. Haskell

We develop a parallel-in-time multigrid preconditioner for augmented systems. These saddle-point systems are foundational to numerical optimization. Our preconditioner, when paired with a suitable optimization method, accelerates the…

Optimization and Control · Mathematics 2025-12-08 Radoslav Vuchkov , Eric C. Cyr , Aurya Javeed , Denis Ridzal

In this paper, for a convex-concave bilinear saddle point problem, we propose a Tikhonov regularized second-order primal-dual dynamical system with slow damping, extrapolation and general time scaling parameters. Depending on the vanishing…

Optimization and Control · Mathematics 2024-09-10 Xiangkai Sun , Liang He , Xian-Jun Long

In this paper, several projection method based preconditioners for various incompressible flow models are studied. In particular, we are interested in the theoretical analysis of a pressure-correction projection method based preconditioner…

Numerical Analysis · Mathematics 2013-12-12 Mingchao Cai

Adaptive methods such as Adam and RMSProp are widely used in deep learning but are not well understood. In this paper, we seek a crisp, clean and precise characterization of their behavior in nonconvex settings. To this end, we first…

Machine Learning · Computer Science 2020-02-04 Matthew Staib , Sashank J. Reddi , Satyen Kale , Sanjiv Kumar , Suvrit Sra

The main focus of this paper is the study of efficient multigrid methods for large linear systems with a particular saddle-point structure. Indeed, when the system matrix is symmetric, but indefinite, the variational convergence theory that…

Numerical Analysis · Mathematics 2023-08-30 Marco Donatelli , Matthias Bolten , Paola Ferrari , Isabella Furci

This work proposes an original preconditioner that couples the Constrained Pressure Residual (CPR) method with block preconditioning for the efficient solution of the linearized systems of equations arising from fully implicit multiphase…

Numerical Analysis · Mathematics 2023-03-24 Stefano Nardean , Massimiliano Ferronato , Ahmad Abushaikha

We present a robust and scalable preconditioner for the solution of large-scale linear systems that arise from the discretization of elliptic PDEs amenable to rank compression. The preconditioner is based on hierarchical low-rank…

Numerical Analysis · Mathematics 2017-12-27 Gustavo Chávez , George Turkiyyah , Stefano Zampini , David Keyes

In this paper, we address the efficient numerical solution of linear and quadratic programming problems, often of large scale. With this aim, we devise an infeasible interior point method, blended with the proximal method of multipliers,…

Numerical Analysis · Mathematics 2021-01-18 Luca Bergamaschi , Jacek Gondzio , Ángeles Martínez , John W. Pearson , Spyridon Pougkakiotis

It is tested whether machine learning methods can be used for preconditioning to increase the performance of the linear solver -- the backbone of the semi-implicit, grid-point model approach for weather and climate models. Embedding the…

Atmospheric and Oceanic Physics · Physics 2020-10-07 Jan Ackmann , Peter D. Düben , Tim N. Palmer , Piotr K. Smolarkiewicz

The paper focuses on developing and studying efficient block preconditioners based on classical algebraic multigrid for the large-scale sparse linear systems arising from the fully coupled and implicitly cell-centered finite volume…

Numerical Analysis · Mathematics 2021-02-03 Xiaoqiang Yue , Shulei Zhang , Xiaowen Xu , Shi Shu , Weidong Shi

We deal with interval parametric systems of linear equations and the goal is to solve such systems, which basically comes down to finding an enclosure for a parametric solution set. Obviously we want this enclosure to be as tight as…

Numerical Analysis · Mathematics 2025-10-07 Iwona Skalna , Milan Hladík

The numerical solution of partial differential equations on high-dimensional domains gives rise to computationally challenging linear systems. When using standard discretization techniques, the size of the linear system grows exponentially…

Numerical Analysis · Mathematics 2015-08-13 Daniel Kressner , Michael Steinlechner , Bart Vandereycken

In recent years, solvers for finite-element discretizations of linear or linearized saddle-point problems, like the Stokes and Oseen equations, have become well established. There are two main classes of preconditioners for such systems:…

Numerical Analysis · Mathematics 2024-01-15 Lukas Spies , Luke Olson , Scott MacLachlan

The paper discusses a reuse of matrix factorization as a building block in the Augmented Lagrangian (AL) and modified AL preconditioners for non-symmetric saddle point linear algebraic systems. The strategy is applied to solve…

Numerical Analysis · Mathematics 2022-01-19 Maxim Olshanskii , Alexander Zhiliakov

We consider the convex-concave saddle point problem $\min_{\mathbf{x}}\max_{\mathbf{y}}\Phi(\mathbf{x},\mathbf{y})$, where the decision variables $\mathbf{x}$ and/or $\mathbf{y}$ subject to a multi-block structure and affine coupling…

Optimization and Control · Mathematics 2023-03-17 Junyu Zhang , Mengdi Wang , Mingyi Hong , Shuzhong Zhang