English
Related papers

Related papers: Convergence Rates of Inertial Primal-Dual Dynamica…

200 papers

We introduce a primal-dual framework for solving linearly constrained nonconvex composite optimization problems. Our approach is based on a newly developed Lagrangian, which incorporates \emph{false penalty} and dual smoothing terms. This…

Optimization and Control · Mathematics 2023-06-21 Jong Gwang Kim

In a Hilbert space setting, for convex optimization, we show the convergence of the iterates to optimal solutions for a class of accelerated first-order algorithms. They can be interpreted as discrete temporal versions of an inertial…

Optimization and Control · Mathematics 2021-07-14 Hedy Attouch , Zaki Chbani , Jalal Fadili , Hassan Riahi

We consider a second order linear evolution equation with a dissipative term multiplied by a time-dependent coefficient. Our aim is to design the coefficient in such a way that all solutions decay in time as fast as possible. We discover…

Analysis of PDEs · Mathematics 2015-06-24 Marina Ghisi , Massimo Gobbino , Alain Haraux

In a Hilbert space, we provide a fast dynamic approach to the hierarchical minimization problem which consists in finding the minimum norm solution of a convex minimization problem. For this, we study the convergence properties of the…

Optimization and Control · Mathematics 2021-08-21 Hedy Attouch , Aicha Balhag , Zaki Chbani , Hassan Riahi

In this paper we consider resource allocation problem stated as a convex minimization problem with linear constraints. To solve this problem, we use gradient and accelerated gradient descent applied to the dual problem and prove the…

Optimization and Control · Mathematics 2019-10-01 Anastasiya Ivanova , Pavel Dvurechensky , Alexander Gasnikov , Dmitry Kamzolov

This paper considers a class of nonlinear systems consisting of a linear part with an external input and a nonlinear feedback with a backlash. Assuming that the latter is specified by a strongly convex set, we establish estimates for the…

Systems and Control · Electrical Eng. & Systems 2019-12-23 Igor G. Vladimirov , Ian R. Petersen

We introduce an efficient first-order primal-dual method for the solution of nonsmooth PDE-constrained optimization problems. We achieve this efficiency through not solving the PDE or its linearisation on each iteration of the optimization…

Optimization and Control · Mathematics 2024-06-11 Bjørn Jensen , Tuomo Valkonen

We study single-loop gradient-flow dynamics for nested optimization, where the outer variable evolves while auxiliary variables track the inner solution map. While existing analyses typically rely on problem- and condition-specific Lyapunov…

Optimization and Control · Mathematics 2026-05-21 Hyunwoo Lee , Jeongyeol Kwon , Dohyun Kwon

We provide an overview of primal-dual algorithms for nonsmooth and non-convex-concave saddle-point problems. This flows around a new analysis of such methods, using Bregman divergences to formulate simplified conditions for convergence.

Optimization and Control · Mathematics 2021-08-03 Tuomo Valkonen

We propose and analyze a class of second-order dynamical systems for continuous-time optimization that incorporate fractional-order gradient terms. The system is given by \begin{equation} \ddot{x}(t) + \frac{\alpha}{t}\dot{x}(t) +…

Optimization and Control · Mathematics 2025-09-16 Tumelo Ranoto

We study convex-concave saddle point problems with bilinear coupling, covering linearly constrained convex optimization and more general nonsmooth or constrained models via a proximable term in the dual objective. In linearly convergent…

Optimization and Control · Mathematics 2026-03-02 Meng Li , Paul Grigas

This paper proposes a novel first-order algorithm that solves composite nonsmooth and stochastic convex optimization problem with function constraints. Most of the works in the literature provide convergence rate guarantees on the…

Optimization and Control · Mathematics 2024-10-25 Digvijay Boob , Mohammad Khalafi

Solving equilibrium problems under constraints is an important problem in optimization and optimal control. In this context an important practical challenge is the efficient incorporation of constraints. We develop a continuous-time method…

Optimization and Control · Mathematics 2024-03-21 Siqi Qu , Mathias Staudigl

Separable convex optimization problems with linear ascending inequality and equality constraints are addressed in this paper. Under an ordering condition on the slopes of the functions at the origin, an algorithm that determines the optimum…

Information Theory · Computer Science 2011-07-22 Arun Padakandla , Rajesh Sundaresan

We consider convex-concave saddle point problems with a separable structure and non-strongly convex functions. We propose an efficient stochastic block coordinate descent method using adaptive primal-dual updates, which enables flexible…

Machine Learning · Statistics 2015-11-24 Zhanxing Zhu , Amos J. Storkey

We present a parallelized primal-dual algorithm for solving constrained convex optimization problems. The algorithm is "block-based," in that vectors of primal and dual variables are partitioned into blocks, each of which is updated only by…

Optimization and Control · Mathematics 2020-09-01 Katherine Hendrickson , Matthew Hale

This paper considers decentralized dynamic optimization problems where nodes of a network try to minimize a sequence of time-varying objective functions in a real-time scheme. At each time slot, nodes have access to different summands of an…

Optimization and Control · Mathematics 2016-03-29 Aryan Mokhtari , Wei Shi , Qing Ling , Alejandro Ribeiro

We consider a continuous time stochastic optimal control problem under both equality and inequality constraints on the expectation of some functionals of the controlled process. Under a qualification condition, we show that the problem is…

Optimization and Control · Mathematics 2021-07-09 Laurent Pfeiffer , Xiaolu Tan , Yulong Zhou

We study a continuous-time primal-dual algorithm for distributed optimization with nonconvex local cost functions over weight-unbalanced digraphs, and analyze its performance from a dissipativity-based perspective. We first reformulate the…

Optimization and Control · Mathematics 2026-02-10 Weijian Li , Panos J. Antsaklis , Hai Lin

We develop two new proximal alternating penalty algorithms to solve a wide range class of constrained convex optimization problems. Our approach mainly relies on a novel combination of the classical quadratic penalty, alternating…

Optimization and Control · Mathematics 2018-09-20 Quoc Tran-Dinh