English
Related papers

Related papers: Inertial primal-dual methods for linear equality c…

200 papers

We develop an inexact primal-dual first-order smoothing framework to solve a class of non-bilinear saddle point problems with primal strong convexity. Compared with existing methods, our framework yields a significant improvement over the…

Optimization and Control · Mathematics 2023-07-25 Le Thi Khanh Hien , Renbo Zhao , William B. Haskell

We propose a primal-dual smoothing framework for finding a near-stationary point of a class of non-smooth non-convex optimization problems with max-structure. We analyze the primal and dual gradient complexities of the framework via two…

Optimization and Control · Mathematics 2023-07-19 Renbo Zhao

Primal-Dual Interior-Point methods are capable of solving constrained convex optimization problems to tight tolerances in a fast and robust manner. The derivatives of the primal-dual solution with respect to the problem matrices can be…

Optimization and Control · Mathematics 2024-06-21 Kevin Tracy , Zachary Manchester

Using convex combination and linesearch techniques, we introduce a novel primal-dual algorithm for solving structured convex-concave saddle point problems with a generic smooth nonbilinear coupling term. Our adaptive linesearch strategy…

Optimization and Control · Mathematics 2024-01-17 Xiaokai Chang , Junfeng Yang , Hongchao Zhang

We develop a second order primal-dual method for optimization problems in which the objective function is given by the sum of a strongly convex twice differentiable term and a possibly nondifferentiable convex regularizer. After introducing…

Optimization and Control · Mathematics 2020-08-31 Neil K. Dhingra , Sei Zhen Khong , Mihailo R. Jovanović

We propose a new first-order primal-dual optimization framework for a convex optimization template with broad applications. Our optimization algorithms feature optimal convergence guarantees under a variety of common structure assumptions…

Optimization and Control · Mathematics 2018-02-23 Quoc Tran-Dinh , Olivier Fercoq , Volkan Cevher

In this paper, we consider a nonconvex optimization problem with nonlinear equality constraints. We assume that both, the objective function and the functional constraints are locally smooth. For solving this problem, we propose a…

Optimization and Control · Mathematics 2025-05-08 Lahcen El Bourkhissi , Ion Necoara

In this paper, we suggest a new framework for analyzing primal subgradient methods for nonsmooth convex optimization problems. We show that the classical step-size rules, based on normalization of subgradient, or on the knowledge of optimal…

Optimization and Control · Mathematics 2023-11-27 Yurii Nesterov

In this paper, we propose a continuous-time primal-dual approach for linearly constrained multiobjective optimization problems. A novel dynamical model, called accelerated multiobjective primal-dual flow, is presented with a second-order…

Optimization and Control · Mathematics 2025-11-06 Hao Luo , Qiaoyuan Shu , Xinmin Yang

In this paper we analyze several inexact fast augmented Lagrangian methods for solving linearly constrained convex optimization problems. Mainly, our methods rely on the combination of excessive-gap-like smoothing technique developed in…

Optimization and Control · Mathematics 2015-05-14 Andrei Patrascu , Ion Necoara , Quoc Tran-Dinh

We propose a novel continuous-time algorithm for inequality-constrained convex optimization inspired by proportional-integral control. Unlike the popular primal-dual gradient dynamics, our method includes a proportional term to control the…

Optimization and Control · Mathematics 2024-09-12 V. Cerone , S. M. Fosson , S. Pirrera , D. Regruto

We consider a scalar objective minimization problem over the solution set of another optimization problem. This problem is known as simple bilevel optimization problem and has drawn a significant attention in the last few years. Our inner…

Optimization and Control · Mathematics 2018-09-18 Yekini Shehu , Phan Tu Vuong , Alain Zemkoho

We provide an overview of primal-dual algorithms for nonsmooth and non-convex-concave saddle-point problems. This flows around a new analysis of such methods, using Bregman divergences to formulate simplified conditions for convergence.

Optimization and Control · Mathematics 2021-08-03 Tuomo Valkonen

In this paper we propose a primal-dual dynamical approach to the minimization of a structured convex function consisting of a smooth term, a nonsmooth term, and the composition of another nonsmooth term with a linear continuous operator. In…

Optimization and Control · Mathematics 2020-08-03 Radu Ioan Bot , Ernö Robert Csetnek , Szilard Laszlo

We introduce an efficient first-order primal-dual method for the solution of nonsmooth PDE-constrained optimization problems. We achieve this efficiency through not solving the PDE or its linearisation on each iteration of the optimization…

Optimization and Control · Mathematics 2024-06-11 Bjørn Jensen , Tuomo Valkonen

In this work, we revisit a classical incremental implementation of the primal-descent dual-ascent gradient method used for the solution of equality constrained optimization problems. We provide a short proof that establishes the linear…

Optimization and Control · Mathematics 2020-01-17 Sulaiman A. Alghunaim , Ali H. Sayed

We propose an implicit iterative algorithm for an exact penalty method arising from inequality constrained optimization problems. A rapidly convergent fixed point method is developed for a regularized penalty functional. The applicability…

Optimization and Control · Mathematics 2012-10-05 Kazufumi Ito , Tomoya Takeuchi

For a linear equality constrained convex optimization problem involving two objective functions with a ``nonsmooth" + ``nonsmooth" composite structure, we study two algorithms derived from a mixed-order dynamical system which incorporates…

Optimization and Control · Mathematics 2026-03-25 Geng-Hua Li , Hai-Yi Zhao , Xiangkai Sun

In this article we investigate the possibilities of accelerating the double smoothing technique when solving unconstrained nondifferentiable convex optimization problems. This approach relies on the regularization in two steps of the…

Optimization and Control · Mathematics 2012-05-04 Radu Ioan Bot , Christopher Hendrich

We develop a novel unified randomized block-coordinate primal-dual algorithm to solve a class of nonsmooth constrained convex optimization problems, which covers different existing variants and model settings from the literature. We prove…

Optimization and Control · Mathematics 2021-10-29 Quoc Tran-Dinh , Deyi Liu