中文
相关论文

相关论文: An over-relaxed ADMM for separable convex programm…

200 篇论文

The alternating direction method of multipliers (ADMM) is a powerful operator splitting technique for solving structured convex optimization problems. Due to its relatively low per-iteration computational cost and ability to exploit…

最优化与控制 · 数学 2020-06-09 Michel Schubiger , Goran Banjac , John Lygeros

This work investigates the theoretical performance of the alternating-direction method of multipliers (ADMM) as it applies to nonconvex optimization problems, and in particular, problems with nonconvex constraint sets. The alternating…

最优化与控制 · 数学 2022-03-16 Stuart M. Harwood

The proximal point algorithm (PPA) has been well studied in the literature. In particular, its linear convergence rate has been studied by Rockafellar in 1976 under certain condition. We consider a generalized PPA in the generic setting of…

最优化与控制 · 数学 2016-05-19 Min Tao , Xiaoming Yuan

The alternating direction method of multipliers (ADMM) is one of the most widely used first-order optimisation methods in the literature owing to its simplicity, flexibility and efficiency. Over the years, numerous efforts are made to…

最优化与控制 · 数学 2019-12-02 Clarice Poon , Jingwei Liang

Recently, many variance reduced stochastic alternating direction method of multipliers (ADMM) methods (e.g.\ SAG-ADMM, SDCA-ADMM and SVRG-ADMM) have made exciting progress such as linear convergence rates for strongly convex problems.…

机器学习 · 计算机科学 2017-07-12 Yuanyuan Liu , Fanhua Shang , James Cheng

This paper proposes a proximal variant of the alternating direction method of multipliers (ADMM) for distributed optimization. Although the current versions of ADMM algorithm provide promising numerical results in producing solutions that…

最优化与控制 · 数学 2023-09-01 Reza Mirzaeifard , Naveen K. D. Venkategowda , Alexander Jung , Stefan Werner

Douglas-Rachford splitting and its equivalent dual formulation ADMM are widely used iterative methods in composite optimization problems arising in control and machine learning applications. The performance of these algorithms depends on…

最优化与控制 · 数学 2019-06-28 Jacob H. Seidman , Mahyar Fazlyab , Victor M. Preciado , George J. Pappas

Aiming at solving large-scale learning problems, this paper studies distributed optimization methods based on the alternating direction method of multipliers (ADMM). By formulating the learning problem as a consensus problem, the ADMM can…

分布式、并行与集群计算 · 计算机科学 2016-05-04 Tsung-Hui Chang , Mingyi Hong , Wei-Cheng Liao , Xiangfeng Wang

The alternating direction method with multipliers (ADMM) has been one of most powerful and successful methods for solving various convex or nonconvex composite problems that arise in the fields of image & signal processing and machine…

最优化与控制 · 数学 2014-12-08 Fenghui Wang , Zongben Xu , Hong-Kun Xu

Accompanied with the rising popularity of compressed sensing, the Alternating Direction Method of Multipliers (ADMM) has become the most widely used solver for linearly constrained convex problems with separable objectives. In this work, we…

数值分析 · 计算机科学 2016-07-12 Canyi Lu , Jiashi Feng , Shuicheng Yan , Zhouchen Lin

In this paper we propose a corrected semi-proximal ADMM (alternating direction method of multipliers) for the general $p$-block $(p\!\ge 3)$ convex optimization problems with linear constraints, aiming to resolve the dilemma that almost all…

最优化与控制 · 数学 2015-02-12 Li Shen , Shaohua Pan

The linearly constrained convex composite programming problems whose objective function contains two blocks with each block being the form of nonsmooth+smooth arises frequently in multiple fields of applications. If both of the smooth terms…

最优化与控制 · 数学 2021-11-25 Congying Qin , Yunhai Xiao , Peili Li

Consider the minimization of a nonconvex differentiable function over a polyhedron. A popular primal-dual first-order method for this problem is to perform a gradient projection iteration for the augmented Lagrangian function and then…

最优化与控制 · 数学 2020-08-05 Jiawei Zhang , Zhi-Quan Luo

In recent years, several convergent multi-block variants of the alternating direction method of multipliers (ADMM) have been proposed for solving the convex quadratic semidefinite programming via its dual, which is naturally a 3-block…

最优化与控制 · 数学 2018-07-06 Xiaokai Chang , Liang Chen , Sanyang Liu

We consider a proximal operator given by a quadratic function subject to bound constraints and give an optimization algorithm using the alternating direction method of multipliers (ADMM). The algorithm is particularly efficient to solve a…

最优化与控制 · 数学 2014-12-31 Miguel Á. Carreira-Perpiñán

We study connections between Dykstra's algorithm for projecting onto an intersection of convex sets, the augmented Lagrangian method of multipliers or ADMM, and block coordinate descent. We prove that coordinate descent for a regularized…

统计计算 · 统计学 2017-05-16 Ryan J. Tibshirani

It is widely acknowledged that hyperparameter selection plays a critical role in the effectiveness of sparse optimization problems. The bilevel optimization provides a robust framework for addressing this issue, but these existing methods…

最优化与控制 · 数学 2026-03-11 Yunhai Xiao , Anqi Liu , Peili Li , Yanyun Ding

The alternating direction method of multipliers (ADMM) is a widely used method for solving many convex minimization models arising in signal and image processing. In this paper, we propose an inertial ADMM for solving a two-block separable…

最优化与控制 · 数学 2021-04-02 Yang Yang , Yuchao Tang

The Alternating Direction Method of Multipliers (ADMM) has gained a lot of attention for solving large-scale and objective-separable constrained optimization. However, the two-block variable structure of the ADMM still limits the practical…

最优化与控制 · 数学 2020-03-24 Kresimir Mihic , Mingxi Zhu , Yinyu Ye

Nonconvex and structured optimization problems arise in many engineering applications that demand scalable and distributed solution methods. The study of the convergence properties of these methods is in general difficult due to the…