English
Related papers

Related papers: An accelerated primal-dual flow for linearly const…

200 papers

This paper provides a self-contained ordinary differential equation solver approach for separable convex optimization problems. A novel primal-dual dynamical system with built-in time rescaling factors is introduced, and the exponential…

Optimization and Control · Mathematics 2023-04-26 Hao Luo , Zihang Zhang

In this work, based on the continuous time approach, we propose an accelerated gradient method with adaptive residual restart for convex multiobjective optimization problems. For the first, we derive rigorously the continuous limit of the…

Optimization and Control · Mathematics 2025-02-06 Hao Luo , Liping Tang , Xinmin Yang

This paper generalizes the dynamical system proposed by Wang et al. [Siam. J. Sci. Comput., 2021] to multiobjective optimization by investigating a multiobjective accelerated gradient-like flow with asymptotically vanishing normalized…

Optimization and Control · Mathematics 2025-11-25 Yingdong Yin

This paper studies the continuous-time dynamics of primal-dual algorithms for linearly constrained convex optimization problems and provides a quantitative convergence analysis using the Lyapunov functions. With the growing prevalence of…

Optimization and Control · Mathematics 2026-05-26 Chise Ishii , Yasushi Narushima

This paper studies distributed convex optimization with both affine equality and nonlinear inequality couplings through the duality analysis. We first formulate the dual of the coupling-constraint problem and reformulate it as a consensus…

Optimization and Control · Mathematics 2025-12-05 Chenyang Qiu , Yangyang Qian , Zongli Lin , Yacov A. Shamash

In a Hilbert space, we propose a class of general mixed-order primal-dual dynamical systems with Tikhonov regularization for a convex optimization problem with linear equality constraints. The proposed dynamical system is characterized by…

Optimization and Control · Mathematics 2025-07-31 Honglu Li , Rong Hu , Xin He , Yibin Xiao

In this paper, a new variant of accelerated gradient descent is proposed. The pro-posed method does not require any information about the objective function, usesexact line search for the practical accelerations of convergence, converges…

Optimization and Control · Mathematics 2019-05-14 Yurii Nesterov , Alexander Gasnikov , Sergey Guminov , Pavel Dvurechensky

First-order methods are often analyzed via their continuous-time models, where their worst-case convergence properties are usually approached via Lyapunov functions. In this work, we provide a systematic and principled approach to find and…

Numerical Analysis · Mathematics 2024-03-12 Céline Moucer , Adrien Taylor , Francis Bach

For a class of nonsmooth composite optimization problems with linear equality constraints, we utilize a Lyapunov-based approach to establish the global exponential stability of the primal-dual gradient flow dynamics based on the proximal…

Optimization and Control · Mathematics 2019-10-03 Dongsheng Ding , Mihailo R. Jovanović

We study a class of optimization problems in which the objective function is given by the sum of a differentiable but possibly nonconvex component and a nondifferentiable convex regularization term. We introduce an auxiliary variable to…

Optimization and Control · Mathematics 2019-08-27 Neil K. Dhingra , Sei Zhen Khong , Mihailo R. Jovanović

In this work we consider a possibility to use the conception of $(\delta, L)$-model of a function for optimization tasks, whereby solving a primal problem there is a necessity to recover a solution of a dual problem. The conception of…

Optimization and Control · Mathematics 2019-06-25 Alexander Tyurin

We introduce a randomly extrapolated primal-dual coordinate descent method that adapts to sparsity of the data matrix and the favorable structures of the objective function. Our method updates only a subset of primal and dual variables with…

Optimization and Control · Mathematics 2020-07-14 Ahmet Alacaoglu , Olivier Fercoq , Volkan Cevher

Primal-dual methods for solving convex optimization problems with functional constraints often exhibit a distinct two-stage behavior. Initially, they converge towards a solution at a sublinear rate. Then, after a certain point, the method…

Optimization and Control · Mathematics 2026-02-12 Mateo Díaz , Pedro Izquierdo Lehmann , Haihao Lu , Jinwen Yang

Optimization methods are at the core of many problems in signal/image processing, computer vision, and machine learning. For a long time, it has been recognized that looking at the dual of an optimization problem may drastically simplify…

Numerical Analysis · Computer Science 2014-12-04 Nikos Komodakis , Jean-Christophe Pesquet

In this work, we approach the minimization of a continuously differentiable convex function under linear equality constraints by a second-order dynamical system with an asymptotically vanishing damping term. The system under consideration…

Optimization and Control · Mathematics 2022-09-15 David Alexander Hulett , Dang-Khoa Nguyen

This paper investigates two accelerated primal-dual mirror dynamical approaches for smooth and nonsmooth convex optimization problems with affine and closed, convex set constraints. In the smooth case, an accelerated primal-dual mirror…

Optimization and Control · Mathematics 2022-09-15 You Zhao , Xiaofeng Liao , Xing He , Chaojie Li

In this paper we propose distributed dual gradient algorithms for linearly constrained separable convex problems and analyze their rate of convergence under different assumptions. Under the strong convexity assumption on the primal…

Optimization and Control · Mathematics 2014-02-04 Ion Necoara , Valentin Nedelcu

We investigate the convergence of the primal-dual algorithm for composite optimization problems when the objective functions are weakly convex. We introduce a modified duality gap function, which is a lower bound of the standard duality gap…

Optimization and Control · Mathematics 2024-10-29 Ewa Bednarczuk , The Hung Tran , Monika Syga

We examine stability properties of primal-dual gradient flow dynamics for composite convex optimization problems with multiple, possibly nonsmooth, terms in the objective function under the generalized consensus constraint. The proposed…

Optimization and Control · Mathematics 2026-01-14 Ibrahim K. Ozaslan , Panagiotis Patrinos , Mihailo R. Jovanović

This paper studies the distributed optimization problem when the objective functions might be nondifferentiable and subject to heterogeneous set constraints. Unlike existing subgradient methods, we focus on the case when the exact…

Optimization and Control · Mathematics 2021-11-23 Kui Zhu , Yutao Tang