English
Related papers

Related papers: A Globally Linearly Convergent Method for Pointwis…

200 papers

This paper proposes a Perturbed Proximal Gradient ADMM (PPG-ADMM) framework for solving general nonconvex composite optimization problems, where the objective function consists of a smooth nonconvex term and a nonsmooth weakly convex term…

Optimization and Control · Mathematics 2026-01-06 Yuan Zhou , Xinli Shi , Luyao Guo , Jinde Cao , Mahmoud Abdel-Aty

We consider (stochastic) convex-concave saddle point (SP) problems with high-dimensional decision variables, arising in various applications including machine learning problems. To contend with the challenges in computing full gradients, we…

Optimization and Control · Mathematics 2025-09-30 Erfan Yazdandoost Hamedani , Afrooz Jalilzadeh , Necdet Serhat Aybat

The scalable adaptive cubic regularization method ($\mathrm{ARC_{q}K}$: Dussault et al. in Math. Program. Ser. A 207(1-2): 191-225, 2024) has been recently proposed for unconstrained optimization. It has excellent convergence properties,…

Optimization and Control · Mathematics 2026-03-17 Yonggang Pei , Yubing Lin , Shuai Shao , Mauricio Silva Louzeiro , Detong Zhu

We consider the problem of finding a saddle point for the convex-concave objective $\min_x \max_y f(x) + \langle Ax, y\rangle - g^*(y)$, where $f$ is a convex function with locally Lipschitz gradient and $g$ is convex and possibly…

Optimization and Control · Mathematics 2021-10-29 Maria-Luiza Vladarean , Yura Malitsky , Volkan Cevher

We consider the application of the type-I Anderson acceleration to solving general non-smooth fixed-point problems. By interleaving with safe-guarding steps, and employing a Powell-type regularization and a re-start checking for strong…

Optimization and Control · Mathematics 2018-08-14 Junzi Zhang , Brendan O'Donoghue , Stephen Boyd

The proximal generalized alternating direction method of multipliers (p-GADMM) is substantially efficient for solving convex composite programming problems of high-dimensional to moderate accuracy. The global convergence of this method was…

Optimization and Control · Mathematics 2022-08-19 Han Wang , Yunhai Xiao

In this paper we propose a randomized primal-dual proximal block coordinate updating framework for a general multi-block convex optimization model with coupled objective function and linear constraints. Assuming mere convexity, we establish…

Optimization and Control · Mathematics 2017-01-25 Xiang Gao , Yangyang Xu , Shuzhong Zhang

We introduce a novel approach addressing global analysis of a difficult class of nonconvex-nonsmooth optimization problems within the important framework of Lagrangian-based methods. This genuine nonlinear class captures many problems in…

Optimization and Control · Mathematics 2018-01-10 Jérôme Bolte , Shoham Sabach , Marc Teboulle

Solving large scale convex semidefinite programming (SDP) problems has long been a challenging task numerically. Fortunately, several powerful solvers including SDPNAL, SDPNAL+ and QSDPNAL have recently been developed to solve linear and…

Optimization and Control · Mathematics 2016-10-05 Ying Cui , Defeng Sun , Kim-Chuan Toh

This paper analyzes the iteration-complexity of a quadratic penalty accelerated inexact proximal point method for solving linearly constrained nonconvex composite programs. More specifically, the objective function is of the form $f + h$…

Optimization and Control · Mathematics 2019-07-17 Weiwei Kong , Jefferson G. Melo , Renato D. C. Monteiro

This paper proposes QPALM, a proximal augmented Lagrangian method based on quadratic approximations, for solving nonlinear programming problems with weakly convex objective and constraint functions. The algorithm is constructed by…

Optimization and Control · Mathematics 2026-05-06 Yule Zhang , Benqi Liu , Xiantao Xiao , Liwei Zhang

Many scientific and engineering applications feature nonsmooth convex minimization problems over convex sets. In this paper, we address an important instance of this broad class where we assume that the nonsmooth objective is equipped with…

Optimization and Control · Mathematics 2014-06-23 Quoc Tran Dinh , Anastasios Kyrillidis , Volkan Cevher

In this paper, a projected primal-dual gradient flow of augmented Lagrangian is presented to solve convex optimization problems that are not necessarily strictly convex. The optimization variables are restricted by a convex set with…

Optimization and Control · Mathematics 2018-10-31 Han Zhang , Jieqiang Wei , Peng Yi , Xiaoming Hu

In [1], the distributed linear-quadratic problem with fixed communication topology (DFT-LQ) and the sparse feedback LQ problem (SF-LQ) are formulated into a nonsmooth and nonconvex optimization problem with affine constraints. Moreover, a…

Optimization and Control · Mathematics 2025-08-14 Lechen Feng , Xun Li , Yuan-Hua Ni

In this paper,we present an inexact primal-dual method with correction step for a saddle point problem by introducing the notations of inexact extended proximal operators with symmetric positive definite matrix $D$. Relaxing requirement on…

Optimization and Control · Mathematics 2025-04-01 Changjie Fang , Liliang Hu , Shenglan Chen

In this work, we consider the low rank decomposition (SDPR) of general convex semidefinite programming problems (SDP) that contain both a positive semidefinite matrix and a nonnegative vector as variables. We develop a rank-support-adaptive…

Optimization and Control · Mathematics 2023-12-14 Tianyun Tang , Kim-Chuan Toh

In this paper, we consider a proximal linearized alternating direction method of multipliers (PL-ADMM) for solving linearly constrained nonconvex and possibly nonsmooth optimization problems. The algorithm is generalized by using variable…

Optimization and Control · Mathematics 2021-07-06 Maryam Yashtini

In this work, we consider strongly convex strongly concave (SCSC) saddle point (SP) problems $\min_{x\in\mathbb{R}^{d_x}}\max_{y\in\mathbb{R}^{d_y}}f(x,y)$ where $f$ is $L$-smooth, $f(.,y)$ is $\mu$-strongly convex for every $y$, and…

Optimization and Control · Mathematics 2022-02-22 Bugra Can , Mert Gurbuzbalaban , Necdet Serhat Aybat

Pseudo-arclength continuation is a well-established method for generating a numerical curve approximating the solution of an underdetermined system of nonlinear equations. It is an inherently sequential predictor-corrector method in which…

Numerical Analysis · Mathematics 2013-12-13 Dhavide Aruliah , Lennaert van Veen , Alex Dubitski

This article explores distributed convex optimization with globally-coupled constraints, where the objective function is a general nonsmooth convex function, the constraints include nonlinear inequalities and affine equalities, and the…

Optimization and Control · Mathematics 2025-03-14 Zixuan Liu , Xuyang Wu , Dandan Wang , Jie Lu