English
Related papers

Related papers: An Inexact Uzawa Algorithm for Generalized Saddle-…

200 papers

Recent advances in symbolic dynamic programming (SDP) combined with the extended algebraic decision diagram (XADD) data structure have provided exact solutions for mixed discrete and continuous (hybrid) MDPs with piecewise linear dynamics…

Artificial Intelligence · Computer Science 2013-09-27 Luis Gustavo Vianna , Scott Sanner , Leliane Nunes de Barros

In this paper, we propose a variance-reduced primal-dual algorithm with Bregman distance for solving convex-concave saddle-point problems with finite-sum structure and nonbilinear coupling function. This type of problems typically arises in…

Optimization and Control · Mathematics 2021-06-02 Erfan Yazdandoost Hamedani , Afrooz Jalilzadeh

Saddle point optimization is a critical problem employed in numerous real-world applications, including portfolio optimization, generative adversarial networks, and robotics. It has been extensively studied in cases where the objective…

Machine Learning · Computer Science 2025-03-25 Shubhankar Agarwal , Hamzah I. Khan , Sandeep P. Chinchali , David Fridovich-Keil

In this work, we introduce two algorithmic frameworks, named Bregman extragradient method and Bregman extrapolation method, for solving saddle point problems. The proposed frameworks not only include the well-known extragradient and…

Optimization and Control · Mathematics 2021-08-26 Hui Zhang

We solve large-scale mixed-integer linear programs (MILPs) via distributed asynchronous saddle point computation. This is motivated by the MILPs being able to model problems in multi-agent autonomy, e.g., task assignment problems and…

Optimization and Control · Mathematics 2022-11-23 Luke Fina , Matthew Hale

We introduce a new sequential subspace optimization method for large-scale saddle-point problems. It solves iteratively a sequence of auxiliary saddle-point problems in low-dimensional subspaces, spanned by directions derived from…

Optimization and Control · Mathematics 2020-08-24 Yoni Choukroun , Michael Zibulevsky , Pavel Kisilev

This is a continuation of our previous work entitled \enquote{Alternating Proximity Mapping Method for Convex-Concave Saddle-Point Problems}, in which we proposed the alternating proximal mapping method and showed convergence results on the…

Optimization and Control · Mathematics 2023-11-01 Hui Ouyang

This paper concerns robust numerical treatment of an elliptic PDE with high contrast coefficients, for which classical finite-element discretizations yield ill-conditioned linear systems. This paper introduces a procedure by which the…

Numerical Analysis · Mathematics 2018-08-03 Yuliya Gorb , Vasiliy Kramarenko , Yuri Kuznetsov

The generalized Golub-Kahan bidiagonalization has been used to solve saddle-point systems where the leading block is symmetric and positive definite. We extend this iterative method for the case where the symmetry condition no longer holds.…

Numerical Analysis · Mathematics 2023-10-12 Andrei Dumitrasc , Carola Kruse , Ulrich Ruede

We consider the problem of convergence to a saddle point of a concave-convex function via gradient dynamics. Since first introduced by Arrow, Hurwicz and Uzawa in [1] such dynamics have been extensively used in diverse areas, there are,…

Optimization and Control · Mathematics 2019-08-06 Thomas Holding , Ioannis Lestas

In this paper, we propose a primal-dual algorithm with a novel momentum term using the partial gradients of the coupling function that can be viewed as a generalization of the method proposed by Chambolle and Pock in 2016 to solve saddle…

Optimization and Control · Mathematics 2020-10-22 Erfan Yazdandoost Hamedani , Necdet Serhat Aybat

We develop new adaptive algorithms for variational inequalities with monotone operators, which capture many problems of interest, notably convex optimization and convex-concave saddle point problems. Our algorithms automatically adapt to…

Machine Learning · Computer Science 2021-08-30 Alina Ene , Huy L. Nguyen

Large-scale saddle-point problems arise in such machine learning tasks as GANs and linear models with affine constraints. In this paper, we study distributed saddle-point problems (SPP) with strongly-convex-strongly-concave smooth…

Optimization and Control · Mathematics 2022-10-04 Dmitriy Metelev , Alexander Rogozin , Alexander Gasnikov , Dmitry Kovalev

We propose a regularized saddle-point algorithm for convex networked optimization problems with resource allocation constraints. Standard distributed gradient methods suffer from slow convergence and require excessive communication when…

Systems and Control · Computer Science 2012-08-16 Andrea Simonetto , Tamas Keviczky , Mikael Johansson

In this paper we propose a new inexact dual decomposition algorithm for solving separable convex optimization problems. This algorithm is a combination of three techniques: dual Lagrangian decomposition, smoothing and excessive gap. The…

Optimization and Control · Mathematics 2013-02-11 Quoc Tran Dinh , Ion Necoara , Moritz Diehl

In this paper we will discuss two variants of an inexact feasible interior point algorithm for convex quadratic programming. We will consider two different neighbourhoods: a (small) one induced by the use of the Euclidean norm which yields…

Optimization and Control · Mathematics 2012-08-30 Jacek Gondzio

In this paper, we propose an inexact golden ratio primal-dual algorithm with linesearch step(IP-GRPDAL) for solving the saddle point problems, where two subproblems can be approximately solved by applying the notations of inexact extended…

Optimization and Control · Mathematics 2025-09-23 Changjie Fang , Jinxiu Liu , Jingtao Qiu , Shenglan Chen

In this paper,we present an inexact primal-dual method with correction step for a saddle point problem by introducing the notations of inexact extended proximal operators with symmetric positive definite matrix $D$. Relaxing requirement on…

Optimization and Control · Mathematics 2025-04-01 Changjie Fang , Liliang Hu , Shenglan Chen

We study the iteration complexity of the optimistic gradient descent-ascent (OGDA) method and the extra-gradient (EG) method for finding a saddle point of a convex-concave unconstrained min-max problem. To do so, we first show that both…

Optimization and Control · Mathematics 2020-09-30 Aryan Mokhtari , Asuman Ozdaglar , Sarath Pattathil

Recent focus on robustness to adversarial attacks for deep neural networks produced a large variety of algorithms for training robust models. Most of the effective algorithms involve solving the min-max optimization problem for training…

Machine Learning · Computer Science 2021-03-03 Yasaman Esfandiari , Aditya Balu , Keivan Ebrahimi , Umesh Vaidya , Nicola Elia , Soumik Sarkar