中文
相关论文

相关论文: A Unified Primal-Dual Recipe for Accelerating Thre…

200 篇论文

We propose a novel methodology for solving a two-stage adjustable robust convex optimisation problem with a general (proximable) convex objective function and constraints defined by sum-of-squares (SOS) convex polynomials. These problems…

最优化与控制 · 数学 2026-02-17 Neil D. Dizon , Bethany I. Caldwell , Vaithilingam Jeyakumar , Guoyin Li

We address the problem of finding the optimal policy of a constrained Markov decision process (CMDP) using a gradient descent-based algorithm. Previous results have shown that a primal-dual approach can achieve an $\mathcal{O}(1/\sqrt{T})$…

机器学习 · 计算机科学 2022-02-07 Tao Liu , Ruida Zhou , Dileep Kalathil , P. R. Kumar , Chao Tian

We study a stochastic primal-dual method for constrained optimization over Riemannian manifolds with bounded sectional curvature. We prove non-asymptotic convergence to the optimal objective value. More precisely, for the class of…

最优化与控制 · 数学 2017-03-24 Masoud Badiei Khuzani , Na Li

Inspired by a recent breakthrough of Mishchenko et al (2022), who for the first time showed that local gradient steps can lead to provable communication acceleration, we propose an alternative algorithm which obtains the same communication…

机器学习 · 计算机科学 2022-07-11 Abdurakhmon Sadiev , Dmitry Kovalev , Peter Richtárik

Convergence analysis of accelerated first-order methods for convex optimization problems are presented from the point of view of ordinary differential equation solvers. A new dynamical system, called Nesterov accelerated gradient flow, has…

最优化与控制 · 数学 2022-03-01 Hao Luo , Long Chen

First-order primal-dual methods are appealing for their low memory overhead, fast iterations, and effective parallelization. However, they are often slow at finding high accuracy solutions, which creates a barrier to their use in…

最优化与控制 · 数学 2023-12-05 David Applegate , Oliver Hinder , Haihao Lu , Miles Lubin

In this paper, we introduce faster accelerated primal-dual algorithms for minimizing a convex function subject to strongly convex function constraints. Prior to our work, the best complexity bound was $\mathcal{O}(1/{\varepsilon})$,…

最优化与控制 · 数学 2024-11-28 Zhenwei Lin , Qi Deng

We present a novel accelerated primal-dual (APD) method for solving a class of deterministic and stochastic saddle point problems (SPP). The basic idea of this algorithm is to incorporate a multi-step acceleration scheme into the…

最优化与控制 · 数学 2013-09-24 Yunmei Chen , Guanghui Lan , Yuyuan Ouyang

We consider finite Markov decision processes (MDPs) with convex constraints and known dynamics. In principle, this problem is amenable to off-the-shelf convex optimization solvers, but typically this approach suffers from poor scalability.…

最优化与控制 · 数学 2024-12-19 Panagiotis D. Grontas , Anastasios Tsiamis , John Lygeros

In this paper, we consider solving a class of convex optimization problem which minimizes the sum of three convex functions $f(x)+g(x)+h(Bx)$, where $f(x)$ is differentiable with a Lipschitz continuous gradient, $g(x)$ and $h(x)$ have a…

最优化与控制 · 数学 2019-04-30 Yu-Chao Tang , Guo-Rong Wu , Chuan-Xi Zhu

We introduce and analyze a continuous primal-dual dynamical system in the context of the minimization problem $f(x)+g(Ax)$, where $f$ and $g$ are convex functions and $A$ is a linear operator. In this setting, the trajectories of the…

最优化与控制 · 数学 2025-06-03 Vassilis Apidopoulos , Cesare Molinari , Juan Peypouquet , Silvia Villa

We develop two new proximal alternating penalty algorithms to solve a wide range class of constrained convex optimization problems. Our approach mainly relies on a novel combination of the classical quadratic penalty, alternating…

最优化与控制 · 数学 2018-09-20 Quoc Tran-Dinh

This paper is devoted to the study of an inertial accelerated primal-dual algorithm, which is based on a second-order differential system with time scaling, for solving a non-smooth convex optimization problem with linear equality…

最优化与控制 · 数学 2026-04-30 Huan Zhang , Xiangkai Sun , Shengjie Li , Kok Lay Teo

In this paper, we present a convergence rate analysis for the inexact Krasnosel'skii-Mann iteration built from nonexpansive operators. Our results include two main parts: we first establish global pointwise and ergodic iteration-complexity…

最优化与控制 · 数学 2015-09-17 Jingwei Liang , Jalal Fadili , Gabriel Peyré

Proximal splitting algorithms for monotone inclusions (and convex optimization problems) in Hilbert spaces share the common feature to guarantee for the generated sequences in general weak convergence to a solution. In order to achieve…

最优化与控制 · 数学 2017-11-21 Radu Ioan Bot , Ernö Robert Csetnek , Dennis Meier

The increasing penetration of renewable energy resources and utilization of energy storage systems pose new challenges in maintaining power system's stability. Specifically, the cost function of regulation no longer remains smooth, which…

最优化与控制 · 数学 2023-11-27 Yifan Wang , Shuai Liu , Xianghui Cao , Mo-Yuen Chow

We consider a distributed optimization problem over a network of agents aiming to minimize a global objective function that is the sum of local convex and composite cost functions. To this end, we propose a distributed Chebyshev-accelerated…

最优化与控制 · 数学 2018-10-17 Jacob H. Seidman , Mahyar Fazlyab , George J. Pappas , Victor M. Preciado

In this paper, we consider the problem of distributed optimisation of a separable convex cost function over a graph, where every edge and node in the graph could carry both linear equality and/or inequality constraints. We show how to…

分布式、并行与集群计算 · 计算机科学 2024-02-20 Richard Heusdens , Guoqiang Zhang

In this paper, we propose a new primal-dual algorithmic framework for a class of convex-concave saddle point problems frequently arising from image processing and machine learning. Our algorithmic framework updates the primal variable…

最优化与控制 · 数学 2025-06-03 Hongjin He , Kai Wang , Jintao Yu

The Chambolle-Pock algorithm (CPA), also known as the primal-dual hybrid gradient method, has gained popularity over the last decade due to its success in solving large-scale convex structured problems. This work extends its convergence…

最优化与控制 · 数学 2025-03-11 Brecht Evens , Puya Latafat , Panagiotis Patrinos