English
Related papers

Related papers: Adaptive Uzawa algorithm for nonsymmetric generali…

200 papers

In this paper, we propose a preconditioner based on the shift-splitting method for generalized saddle point problems with nonsymmetric positive definite (1,1)-block and symmetric positive semidefinite $(2,2)$-block. The proposed…

Numerical Analysis · Mathematics 2015-06-16 Davod Khojasteh Salkuyeh , Mohsen Masoudi , Davod Hezari

Stochastic nonconvex-concave min-max saddle point problems appear in many machine learning and control problems including distributionally robust optimization, generative adversarial networks, and adversarial learning. In this paper, we…

Optimization and Control · Mathematics 2023-09-12 Morteza Boroun , Zeinab Alizadeh , Afrooz Jalilzadeh

In this paper, the generalized shift-splitting preconditioner is implemented for saddle point problems with symmetric positive definite (1,1)-block and symmetric positive semidefinite (2,2)-block. The proposed preconditioner is extracted…

Numerical Analysis · Mathematics 2015-03-03 Davod Khojasteh Salkuyeh , Mohsen Masoudi , Davod Hezari

The generalized Golub-Kahan bidiagonalization has been used to solve saddle-point systems where the leading block is symmetric and positive definite. We extend this iterative method for the case where the symmetry condition no longer holds.…

Numerical Analysis · Mathematics 2023-10-12 Andrei Dumitrasc , Carola Kruse , Ulrich Ruede

In this paper, we execute the shift-splitting preconditioner for asymmetric saddle point problems with its (1,2) block's transposition unequal to its (2,1) block under the removed minus of its (2,1) block. The proposed preconditioner is…

Numerical Analysis · Mathematics 2021-09-13 Shi-Liang Wu , Davod Khojasteh Salkuyeh

We propose a neural network framework for solving stationary linear transport equations with inflow boundary conditions. The method represents the solution using a neural network and imposes the boundary condition via a Lagrange multiplier,…

Numerical Analysis · Mathematics 2025-07-29 Charalambos Makridakis , Aaron Pim , Tristan Pryer , Nikolaos Rekatsinas

Recently, the problem of local minima in very high dimensional non-convex optimization has been challenged and the problem of saddle points has been introduced. This paper introduces a dynamic type of normalization that forces the system to…

Machine Learning · Computer Science 2017-02-08 Armen Aghajanyan

This is a continuation of our previous work entitled \enquote{Alternating Proximity Mapping Method for Convex-Concave Saddle-Point Problems}, in which we proposed the alternating proximal mapping method and showed convergence results on the…

Optimization and Control · Mathematics 2023-11-01 Hui Ouyang

This paper focuses on the distributed optimization of stochastic saddle point problems. The first part of the paper is devoted to lower bounds for the centralized and decentralized distributed methods for smooth (strongly) convex-(strongly)…

Machine Learning · Computer Science 2025-04-28 Aleksandr Beznosikov , Valentin Samokhin , Alexander Gasnikov

We propose a unified iterative framework for the solution of frictionless mechanical contact problems, which relies exclusively on the solution of standard stiffness systems. The framework is built upon a two-step fixed-point algorithm:…

Numerical Analysis · Mathematics 2026-03-13 Daria Koliesnikova , Isabelle Ramière

This paper focuses on solving a stochastic saddle point problem (SPP) under an overparameterized regime for the case, when the gradient computation is impractical. As an intermediate step, we generalize Same-sample Stochastic Extra-gradient…

Optimization and Control · Mathematics 2024-06-05 Ekaterina Statkevich , Sofiya Bondar , Darina Dvinskikh , Alexander Gasnikov , Aleksandr Lobanov

In this paper, we propose a new primal-dual algorithmic framework for a class of convex-concave saddle point problems frequently arising from image processing and machine learning. Our algorithmic framework updates the primal variable…

Optimization and Control · Mathematics 2025-06-03 Hongjin He , Kai Wang , Jintao Yu

This paper directly builds upon previous work where we introduced new reduced basis a posteriori error bounds for parametrized saddle point problems based on Brezzi's theory. We here sharpen these estimates for the special case of a…

Numerical Analysis · Mathematics 2012-11-06 Anna-Lena Gerner , Karen Veroy

We study the \emph{Proximal Alternating Predictor-Corrector} (PAPC) algorithm introduced recently by Drori, Sabach and Teboulle to solve nonsmooth structured convex-concave saddle point problems consisting of the sum of a smooth convex…

Optimization and Control · Mathematics 2018-09-24 D. Russell Luke , Ron Shefi

In this paper, we aim at solving the Biot model under stabilized finite element discretizations. To solve the resulting generalized saddle point linear systems, some iterative methods are proposed and compared. In the first method, we apply…

Numerical Analysis · Mathematics 2017-08-30 Mingchao Cai , Guoping Zhang

We provide an overview of primal-dual algorithms for nonsmooth and non-convex-concave saddle-point problems. This flows around a new analysis of such methods, using Bregman divergences to formulate simplified conditions for convergence.

Optimization and Control · Mathematics 2021-08-03 Tuomo Valkonen

We present a new hybrid direct/iterative approach to the solution of a special class of saddle point matrices arising from the discretization of the steady incompressible Navier-Stokes equations on an Arakawa C-grid. The two-level method…

Numerical Analysis · Mathematics 2010-06-10 Fred Wubs , Jonas Thies

We consider non-convex optimization problems with constraint that is a product of simplices. A commonly used algorithm in solving this type of problem is the Multiplicative Weights Update (MWU), an algorithm that is widely used in game…

Optimization and Control · Mathematics 2022-04-26 Yi Feng , Ioannis Panageas , Xiao Wang

In this paper, we present novel randomized algorithms for solving saddle point problems whose dual feasible region is given by the direct product of many convex sets. Our algorithms can achieve an ${\cal O}(1/N)$ and ${\cal O}(1/N^2)$ rate…

Optimization and Control · Mathematics 2015-11-16 Cong Dang , Guanghui Lan

The article is devoted to the development of numerical methods for solving saddle point problems and variational inequalities with simplified requirements for the smoothness conditions of functionals. Recently there were proposed some…

Optimization and Control · Mathematics 2023-11-22 Alexander Titov , Fedor Stonyakin , Mohammad Alkousa , Alexander Gasnikov