中文
相关论文

相关论文: Extensions of ADMM for Separable Convex Optimizati…

200 篇论文

In this paper, we develop a symmetric accelerated stochastic Alternating Direction Method of Multipliers (SAS-ADMM) for solving separable convex optimization problems with linear constraints. The objective function is the sum of a possibly…

最优化与控制 · 数学 2021-12-21 Jianchao Bai , Deren Han , Hao Sun , Hongchao Zhang

This paper considers the problem of distributed model fitting using the alternating directions method of multipliers (ADMM). ADMM splits the learning problem into several smaller subproblems, usually by partitioning the data samples. The…

最优化与控制 · 数学 2022-03-04 Dinesh Krishnamoorthy , Vyacheslav Kungurtsev

This work proposes a novel adaptive linearized alternating direction multiplier method (LADMM) to convex optimization, which improves the convergence rate of the LADMM-based algorithm by adjusting step-size iteratively.The innovation of…

最优化与控制 · 数学 2024-07-04 Boran Wang

The alternating direction method of multipliers (ADMM) is an effective method for solving wide fields of convex problems. At each iteration, the classical ADMM solves two subproblems exactly. However, in many applications, it is expensive…

最优化与控制 · 数学 2019-03-07 Yan Gu , Nobuo Yamashita

This paper considers a convex optimization problem with cost and constraints that evolve over time. The function to be minimized is strongly convex and possibly non-differentiable, and variables are coupled through linear constraints. In…

系统与控制 · 电气工程与系统科学 2021-01-13 Yijian Zhang , Emiliano Dall'Anese , Mingyi Hong

We consider a multi-block separable convex optimization problem with the linear constraints, where the objective function is the sum of m individual convex functions without overlapping variables. The linearized version of the generalized…

最优化与控制 · 数学 2022-04-19 He Jian , Zhang Bangzhong , Li Jinlin

The alternating direction method of multipliers (ADMM) has been recognized as a versatile approach for solving modern large-scale machine learning and signal processing problems efficiently. When the data size and/or the problem dimension…

分布式、并行与集群计算 · 计算机科学 2016-05-04 Tsung-Hui Chang , Wei-Cheng Liao , Mingyi Hong , Xiangfeng Wang

In this paper we propose an iterative method using alternating direction method of multipliers (ADMM) strategy to solve linear inverse problems in Hilbert spaces with general convex penalty term. When the data is given exactly, we give a…

数值分析 · 数学 2016-01-13 Yuling Jiao , Qinian Jin , Xiliang Lu , Weijie Wang

In this paper, we study a class of non-convex optimization problems known as multi-affine quadratic equality constrained problems, which appear in various applications--from generating feasible force trajectories in robotic locomotion and…

最优化与控制 · 数学 2026-03-13 Yutong Chao , Michal Ciebielski , Jalal Etesami , Majid Khadiv

The alternating direction method with multipliers (ADMM) has been one of most powerful and successful methods for solving various composite problems. The convergence of the conventional ADMM (i.e., 2-block) for convex objective functions…

最优化与控制 · 数学 2015-05-13 Fenghui Wang , Wenfei Cao , Zongben Xu

Nonconvex and structured optimization problems arise in many engineering applications that demand scalable and distributed solution methods. The study of the convergence properties of these methods is in general difficult due to the…

Alternating Direction Method of Multipliers (ADMM) has been used successfully in many conventional machine learning applications and is considered to be a useful alternative to Stochastic Gradient Descent (SGD) as a deep learning optimizer.…

最优化与控制 · 数学 2021-07-07 Junxiang Wang , Fuxun Yu , Xiang Chen , Liang Zhao

We provide a new proof of the linear convergence of the alternating direction method of multipliers (ADMM) when one of the objective terms is strongly convex. Our proof is based on a framework for analyzing optimization algorithms…

最优化与控制 · 数学 2015-05-20 Robert Nishihara , Laurent Lessard , Benjamin Recht , Andrew Packard , Michael I. Jordan

This dissertation explores block decomposable methods for large-scale optimization problems. It focuses on alternating direction method of multipliers (ADMM) schemes and block coordinate descent (BCD) methods. Specifically, it introduces a…

最优化与控制 · 数学 2026-01-15 Leandro Farias Maia

Aiming at solving large-scale learning problems, this paper studies distributed optimization methods based on the alternating direction method of multipliers (ADMM). By formulating the learning problem as a consensus problem, the ADMM can…

分布式、并行与集群计算 · 计算机科学 2016-05-04 Tsung-Hui Chang , Mingyi Hong , Wei-Cheng Liao , Xiangfeng Wang

This paper aims to develop distributed algorithms for nonconvex optimization problems with complicated constraints associated with a network. The network can be a physical one, such as an electric power network, where the constraints are…

最优化与控制 · 数学 2022-11-21 Kaizhao Sun , X. Andy Sun

Accompanied with the rising popularity of compressed sensing, the Alternating Direction Method of Multipliers (ADMM) has become the most widely used solver for linearly constrained convex problems with separable objectives. In this work, we…

数值分析 · 计算机科学 2016-07-12 Canyi Lu , Jiashi Feng , Shuicheng Yan , Zhouchen Lin

In this paper we consider from two different aspects the proximal alternating direction method of multipliers (ADMM) in Hilbert spaces. We first consider the application of the proximal ADMM to solve well-posed linearly constrained…

最优化与控制 · 数学 2023-10-11 Qinian Jin

Many problems in machine learning and other fields can be (re)for-mulated as linearly constrained separable convex programs. In most of the cases, there are multiple blocks of variables. However, the traditional alternating direction method…

数值分析 · 计算机科学 2014-05-30 Zhouchen Lin , Risheng Liu , Huan Li

This paper studies efficient distributed optimization methods for multi-agent networks. Specifically, we consider a convex optimization problem with a globally coupled linear equality constraint and local polyhedra constraints, and develop…

系统与控制 · 计算机科学 2016-11-15 Tsung-Hui Chang