English
Related papers

Related papers: A Generalized Primal-Dual Correction Method for Sa…

200 papers

This paper studies quasi-Newton methods for solving strongly-convex-strongly-concave saddle point problems (SPP). We propose greedy and random Broyden family updates for SPP, which have explicit local superlinear convergence rate of…

Optimization and Control · Mathematics 2022-04-12 Chengchang Liu , Luo Luo

We develop a second order primal-dual method for optimization problems in which the objective function is given by the sum of a strongly convex twice differentiable term and a possibly nondifferentiable convex regularizer. After introducing…

Optimization and Control · Mathematics 2020-08-31 Neil K. Dhingra , Sei Zhen Khong , Mihailo R. Jovanović

By the asymptotic oracle property, non-convex penalties represented by minimax concave penalty (MCP) and smoothly clipped absolute deviation (SCAD) have attracted much attentions in high-dimensional data analysis, and have been widely used…

Computation · Statistics 2021-11-24 Peili Li , Min Liu , Zhou Yu

Saddle point problems arise from many wireless applications, and primal-dual iterative algorithms are widely applied to find the saddle points. In the existing literature, the convergence results of such algorithms are established assuming…

Information Theory · Computer Science 2017-04-26 Junting Chen , Vincent K. N. Lau

Real-time optimization problems are ubiquitous in control and estimation, and are typically parameterized by incoming measurement data and/or operator commands. This paper proposes solving parameterized constrained nonlinear programs using…

Optimization and Control · Mathematics 2018-12-06 Dominic Liao-McPherson , Marco Nicotra , Ilya Kolmanovsky

A new primal-dual algorithm is presented for solving a class of non-convex minimization problems. This algorithm is based on canonical duality theory such that the original non-convex minimization problem is first reformulated as a…

Numerical Analysis · Computer Science 2013-01-01 Changzhi Wu , Chaojie Li , David Yang Gao

We consider the solution of linear saddle-point problems, using the alternating direction method-of-multipliers (ADMM) as a preconditioner for the generalized minimum residual method (GMRES). We show, using theoretical bounds and empirical…

Optimization and Control · Mathematics 2016-04-28 Richard Y. Zhang , Jacob K. White

The discretization of robust quadratic optimal control problems under uncertainty using the finite element method and the stochastic collocation method leads to large saddle-point systems, which are fully coupled across the random…

Numerical Analysis · Mathematics 2021-10-15 Fabio Nobile , Tommaso Vanzan

We develop an implementable stochastic proximal point (SPP) method for a class of weakly convex, composite optimization problems. The proposed stochastic proximal point algorithm incorporates a variance reduction mechanism and the resulting…

Optimization and Control · Mathematics 2024-03-27 Andre Milzarek , Fabian Schaipp , Michael Ulbrich

Recently, saddle point problems have received much attention due to their powerful modeling capability for a lot of problems from diverse domains. Applications of these problems occur in many applied areas, such as robust optimization,…

Optimization and Control · Mathematics 2022-02-15 Mohammad Alkousa , Alexander Gasnikov , Pavel Dvurechensky , Abdurakhmon Sadiev , Lama Razouk

In this paper we propose three $p$-th order tensor methods for $\mu$-strongly-convex-strongly-concave saddle point problems (SPP). The first method is based on the assumption of $p$-th order smoothness of the objective and it achieves a…

Optimization and Control · Mathematics 2021-04-14 Petr Ostroukhov , Rinat Kamalov , Pavel Dvurechensky , Alexander Gasnikov

A modification of the generalized shift-splitting (GSS) method is presented for solving singular saddle point problems. In this kind of modification, the diagonal shift matrix is replaced by a block diagonal matrix which is symmetric…

Numerical Analysis · Mathematics 2017-04-26 Davod Khojasteh Salkuyeh , Maryam Rahimian

We consider the convex-concave saddle point problem $\min_{\mathbf{x}}\max_{\mathbf{y}}\Phi(\mathbf{x},\mathbf{y})$, where the decision variables $\mathbf{x}$ and/or $\mathbf{y}$ subject to a multi-block structure and affine coupling…

Optimization and Control · Mathematics 2023-03-17 Junyu Zhang , Mengdi Wang , Mingyi Hong , Shuzhong Zhang

We study the problem of computing an optimal policy of an infinite-horizon discounted constrained Markov decision process (constrained MDP). Despite the popularity of Lagrangian-based policy search methods used in practice, the oscillation…

Optimization and Control · Mathematics 2024-01-18 Dongsheng Ding , Chen-Yu Wei , Kaiqing Zhang , Alejandro Ribeiro

In this paper, we present two stepsize strategies for the extended Golden Ratio primal-dual algorithm (E-GRPDA) designed to address structured convex optimization problems in finite-dimensional real Hilbert spaces. The first rule features a…

Optimization and Control · Mathematics 2025-12-23 Santanu Soe , Matthew K. Tam , V. Vetrivel

In this paper we consider solving saddle point problems using two variants of Gradient Descent-Ascent algorithms, Extra-gradient (EG) and Optimistic Gradient Descent Ascent (OGDA) methods. We show that both of these algorithms admit a…

Optimization and Control · Mathematics 2019-09-06 Aryan Mokhtari , Asuman Ozdaglar , Sarath Pattathil

This paper aims to address distributed optimization problems over directed and time-varying networks, where the global objective function consists of a sum of locally accessible convex objective functions subject to a feasible set…

Optimization and Control · Mathematics 2020-07-14 Xiuxian Li , Gang Feng , Lihua Xie

This paper focuses on the distributed optimization of stochastic saddle point problems. The first part of the paper is devoted to lower bounds for the centralized and decentralized distributed methods for smooth (strongly) convex-(strongly)…

Machine Learning · Computer Science 2025-04-28 Aleksandr Beznosikov , Valentin Samokhin , Alexander Gasnikov

In this article, we propose and study a stochastic and relaxed preconditioned Douglas--Rachford splitting method to solve saddle-point problems that have separable dual variables. We prove the almost sure convergence of the iteration…

Optimization and Control · Mathematics 2024-10-01 Yakun Dong , Kristian Bredies , Hongpeng Sun

We solve large-scale mixed-integer linear programs (MILPs) via distributed asynchronous saddle point computation. This is motivated by the MILPs being able to model problems in multi-agent autonomy, e.g., task assignment problems and…

Optimization and Control · Mathematics 2022-11-23 Luke Fina , Matthew Hale