中文
相关论文

相关论文: Random multi-block ADMM: an ALM based view for the…

200 篇论文

A lift-and-permute scheme of alternating direction method of multipliers (ADMM) is proposed for linearly constrained convex programming. It contains not only the newly developed balanced augmented Lagrangian method and its dual-primal…

最优化与控制 · 数学 2022-03-31 Shiru Li , Yong Xia , Tao Zhang

The linearly constrained convex composite programming problems whose objective function contains two blocks with each block being the form of nonsmooth+smooth arises frequently in multiple fields of applications. If both of the smooth terms…

最优化与控制 · 数学 2021-11-25 Congying Qin , Yunhai Xiao , Peili Li

This paper aims to develop distributed algorithms for nonconvex optimization problems with complicated constraints associated with a network. The network can be a physical one, such as an electric power network, where the constraints are…

最优化与控制 · 数学 2022-11-21 Kaizhao Sun , X. Andy Sun

Nonconvex and structured optimization problems arise in many engineering applications that demand scalable and distributed solution methods. The study of the convergence properties of these methods is in general difficult due to the…

In this paper, we aim to provide a comprehensive analysis on the linear rate convergence of the alternating direction method of multipliers (ADMM) for solving linearly constrained convex composite optimization problems. Under a certain…

最优化与控制 · 数学 2015-08-11 Deren Han , Defeng Sun , Liwei Zhang

We consider a multi-block separable convex optimization problem with the linear constraints, where the objective function is the sum of m individual convex functions without overlapping variables. The linearized version of the generalized…

最优化与控制 · 数学 2022-04-19 He Jian , Zhang Bangzhong , Li Jinlin

This paper is devoted to the design of an efficient and convergent {semi-proximal} alternating direction method of multipliers (ADMM) for finding a solution of low to medium accuracy to convex quadratic conic programming and related…

最优化与控制 · 数学 2014-09-10 Xudong Li , Defeng Sun , Kim-Chuan Toh

Alternating Direction Method of Multipliers (ADMM) has become a widely used optimization method for convex problems, particularly in the context of data mining in which large optimization problems are often encountered. ADMM has several…

机器学习 · 统计学 2019-07-11 Andre Goncalves , Xiaoli Liu , Arindam Banerjee

In this paper, we propose an algorithmic framework, dubbed inertial alternating direction methods of multipliers (iADMM), for solving a class of nonconvex nonsmooth multiblock composite optimization problems with linear constraints. Our…

最优化与控制 · 数学 2023-01-26 Le Thi Khanh Hien , Duy Nhat Phan , Nicolas Gillis

We design inexact proximal augmented Lagrangian based decomposition methods for convex composite programming problems with dual block-angular structures. Our methods are particularly well suited for convex quadratic programming problems…

最优化与控制 · 数学 2023-03-14 Kuang-Yu Ding , Xin-Yee Lam , Kim-Chuan Toh

Non-convex quadratically constrained quadratic programming (QCQP) problems have numerous applications in signal processing, machine learning, and wireless communications, albeit the general QCQP is NP-hard, and several interesting special…

最优化与控制 · 数学 2016-09-21 Kejun Huang , Nicholas D. Sidiropoulos

We analyze the convergence rate of the alternating direction method of multipliers (ADMM) for minimizing the sum of two or more nonsmooth convex separable functions subject to linear constraints. Previous analysis of the ADMM typically…

最优化与控制 · 数学 2013-03-27 Mingyi Hong , Zhi-Quan Luo

The objective of this paper is to design an efficient and convergent alternating direction method of multipliers (ADMM) for finding a solution of medium accuracy to conic programming problems whose constraints consist of linear equalities,…

最优化与控制 · 数学 2014-12-02 Defeng Sun , Kim-Chuan Toh , Liuqin Yang

We study a class of structured convex optimization problems, which have a two-block separable objective and nonlinear functional constraints as well as affine constraints that couple the two block variables. Such problems naturally arise…

最优化与控制 · 数学 2026-02-27 Zhengjie Xiong , Yangyang Xu

In this paper, we develop a symmetric accelerated stochastic Alternating Direction Method of Multipliers (SAS-ADMM) for solving separable convex optimization problems with linear constraints. The objective function is the sum of a possibly…

最优化与控制 · 数学 2021-12-21 Jianchao Bai , Deren Han , Hao Sun , Hongchao Zhang

Inexact alternating direction multiplier methods (ADMMs) are developed for solving general separable convex optimization problems with a linear constraint and with an objective that is the sum of smooth and nonsmooth terms. The approach…

最优化与控制 · 数学 2016-04-12 William W. Hager , Hongchao Zhang

In this paper, we consider a prototypical convex optimization problem with multi-block variables and separable structures. By adding the Logarithmic Quadratic Proximal (LQP) regularizer with suitable proximal parameter to each of the first…

数值分析 · 数学 2021-04-01 Jianchao Bai , Yuxue Ma , Hao Sun , Miao Zhang

The alternating direction method of multipliers (ADMM) proposed by Glowinski and Marrocco is a benchmark algorithm for two-block separable convex optimization problems with linear equality constraints. It has been modified, specified, and…

最优化与控制 · 数学 2021-07-15 Bingsheng He , Shengjie Xu , Xiaoming Yuan

Quantization of the parameters of machine learning models, such as deep neural networks, requires solving constrained optimization problems, where the constraint set is formed by the Cartesian product of many simple discrete sets. For such…

最优化与控制 · 数学 2021-03-02 Tianjian Huang , Prajwal Singhania , Maziar Sanjabi , Pabitra Mitra , Meisam Razaviyayn

In this paper, we propose a new stochastic alternating direction method of multipliers (ADMM) algorithm, which incrementally approximates the full gradient in the linearized ADMM formulation. Besides having a low per-iteration complexity as…

机器学习 · 计算机科学 2013-08-19 Leon Wenliang Zhong , James T. Kwok