English
Related papers

Related papers: Linear Convergence of Randomized Primal-Dual Coord…

200 papers

We develop two penalty based difference of convex (DC) algorithms for solving chance constrained programs. First, leveraging a rank-based DC decomposition of the chance constraint, we propose a proximal penalty based DC algorithm in the…

Optimization and Control · Mathematics 2026-03-16 Zhiping Li , Nan Jiang , Rujun Jiang

In this paper, we propose a unified primal-dual algorithm framework based on the augmented Lagrangian function for composite convex problems with conic inequality constraints. The new framework is highly versatile. First, it not only covers…

Optimization and Control · Mathematics 2022-08-31 Zhenyuan Zhu , Fan Chen , Junyu Zhang , Zaiwen Wen

This paper develops a continuous-time primal-dual accelerated method with an increasing damping coefficient for a class of convex optimization problems with affine equality constraints. This paper analyzes critical values for parameters in…

Optimization and Control · Mathematics 2022-02-16 Xianlin Zeng , Jinlong Lei , Jie Chen

In this paper, we propose a primal-dual algorithm with a novel momentum term using the partial gradients of the coupling function that can be viewed as a generalization of the method proposed by Chambolle and Pock in 2016 to solve saddle…

Optimization and Control · Mathematics 2020-10-22 Erfan Yazdandoost Hamedani , Necdet Serhat Aybat

We introduce a primal-dual stochastic gradient oracle method for distributed convex optimization problems over networks. We show that the proposed method is optimal in terms of communication steps. Additionally, we propose a new analysis…

Optimization and Control · Mathematics 2019-11-28 Darina Dvinskikh , Eduard Gorbunov , Alexander Gasnikov , Pavel Dvurechensky , Cesar A. Uribe

We propose a doubly stochastic primal-dual coordinate optimization algorithm for empirical risk minimization, which can be formulated as a bilinear saddle-point problem. In each iteration, our method randomly samples a block of coordinates…

Machine Learning · Computer Science 2017-04-13 Adams Wei Yu , Qihang Lin , Tianbao Yang

In this paper a robust second-order method is developed for the solution of strongly convex l1-regularized problems. The main aim is to make the proposed method as inexpensive as possible, while even difficult problems can be efficiently…

Optimization and Control · Mathematics 2015-01-13 Kimon Fountoulakis , Jacek Gondzio

In this paper we consider the problem of finding the minimizations of the sum of two convex functions and the composition of another convex function with a continuous linear operator. With the idea of coordinate descent, we design a…

Optimization and Control · Mathematics 2016-04-15 Meng Wen , Shigang Yue , Yuchao Tang , Jigen Peng

In this paper, we study the local linear convergence properties of a versatile class of Primal-Dual splitting methods for minimizing composite non-smooth convex optimization problems. Under the assumption that the non-smooth components of…

Optimization and Control · Mathematics 2018-01-10 Jingwei Liang , Jalal Fadili , Gabriel Peyré

In this paper, we study randomized and cyclic coordinate descent for convex unconstrained optimization problems. We improve the known convergence rates in some cases by using the numerical semidefinite programming performance estimation…

Optimization and Control · Mathematics 2022-12-26 Hadi Abbaszadehpeivasti , Etienne de Klerk , Moslem Zamani

In this paper we propose a parallel coordinate descent algorithm for solving smooth convex optimization problems with separable constraints that may arise e.g. in distributed model predictive control (MPC) for linear network systems. Our…

Optimization and Control · Mathematics 2014-11-19 Ion Necoara , Dragos Clipici

Nonlinear convex problems arise in various areas of applied mathematics and engineering. Classical techniques such as the relaxed proximal point algorithm (PPA) and the prediction correction (PC) method were proposed for linearly…

Optimization and Control · Mathematics 2023-07-28 Sai Wang , Yi Gong

The optimal transport (OT) problem can be reduced to a linear programming (LP) problem through discretization. In this paper, we introduced the random block coordinate descent (RBCD) methods to directly solve this LP problem. Our approach…

Optimization and Control · Mathematics 2023-11-27 Yue Xie , Zhongjian Wang , Zhiwen Zhang

In this paper, a new variant of accelerated gradient descent is proposed. The pro-posed method does not require any information about the objective function, usesexact line search for the practical accelerations of convergence, converges…

Optimization and Control · Mathematics 2019-05-14 Yurii Nesterov , Alexander Gasnikov , Sergey Guminov , Pavel Dvurechensky

We propose primal-dual stochastic mirror descent for the convex optimization problems with functional constraints. We obtain the rate of convergence in terms of probability of large deviations.

Optimization and Control · Mathematics 2017-08-01 Anastasia Bayandina , Alexander Gasnikov , Evgenia Gasnikova , Sergey Matsievsky

We propose a semi-proximal augmented Lagrangian based decomposition method for convex composite quadratic conic programming problems with primal block angular structures. Using our algorithmic framework, we are able to naturally derive…

Optimization and Control · Mathematics 2018-12-13 Xin-Yee Lam , Defeng Sun , Kim-Chuan Toh

In this paper we propose a variant of the random coordinate descent method for solving linearly constrained convex optimization problems with composite objective functions. If the smooth part of the objective function has Lipschitz…

Optimization and Control · Mathematics 2013-02-14 Ion Necoara , Andrei Patrascu

In this paper, we establish the convergence of the proximal alternating direction method of multipliers (ADMM) and block coordinate descent (BCD) for nonseparable minimization models with quadratic coupling terms. The novel convergence…

Optimization and Control · Mathematics 2017-03-16 Caihua Chen , Min Li , Xin Liu , Yinyu Ye

In many operations management problems, we need to make decisions sequentially to minimize the cost while satisfying certain constraints. One modeling approach to study such problems is constrained Markov decision process (CMDP). When…

Optimization and Control · Mathematics 2021-01-27 Yi Chen , Jing Dong , Zhaoran Wang

Nonlinear Convex Cone Programming (NCCP) problems are important and have many practical applications. In this paper, we introduces a flexible first-order primal-dual algorithm called the Variant Auxiliary Problem Principle (VAPP) for…

Optimization and Control · Mathematics 2019-11-05 Lei Zhao , Daoli Zhu
‹ Prev 1 3 4 5 6 7 10 Next ›