中文
相关论文

相关论文: Preconditioned ADMM with nonlinear operator constr…

200 篇论文

Alternating Direction Method of Multipliers (ADMM) is a popular algorithm for distributed learning, where a network of nodes collaboratively solve a regularized empirical risk minimization by iterative local computation associated with…

机器学习 · 计算机科学 2020-05-19 Zonghao Huang , Yanmin Gong

In this paper, a stochastic alternating direction method of multipliers (ADMM) is proposed for a class of nonsmooth composite and stochastic convex optimization problems in Hilbert space, motivated by optimization problems constrained by…

最优化与控制 · 数学 2026-05-18 Weihua Deng , Haiming Song , Hao Wang , Jinda Yang

In this paper, we show that for a class of linearly constrained convex composite optimization problems, an (inexact) symmetric Gauss-Seidel based majorized multi-block proximal alternating direction method of multipliers (ADMM) is…

最优化与控制 · 数学 2019-01-29 Liang Chen , Xudong Li , Defeng Sun , Kim-Chuan Toh

In this paper, we develop a variant of the well-known Gauss-Newton (GN) method to solve a class of nonconvex optimization problems involving low-rank matrix variables. As opposed to the standard GN method, our algorithm allows one to handle…

最优化与控制 · 数学 2020-10-27 Quoc Tran-Dinh

The Alternating Direction Method of Multipliers (ADMM) has been studied for years. The traditional ADMM algorithm needs to compute, at each iteration, an (empirical) expected loss function on all training examples, resulting in a…

机器学习 · 统计学 2014-06-10 Peilin Zhao , Jinwei Yang , Tong Zhang , Ping Li

In the paper, we study the stochastic alternating direction method of multipliers (ADMM) for the nonconvex optimizations, and propose three classes of the nonconvex stochastic ADMM with variance reduction, based on different reduced…

最优化与控制 · 数学 2017-07-27 Feihu Huang , Songcan Chen , Zhaosong Lu

We consider a class of structured, nonconvex, nonsmooth optimization problems under orthogonality constraints, where the objectives combine a smooth function, a nonsmooth concave function, and a nonsmooth weakly convex function. This class…

最优化与控制 · 数学 2025-01-14 Ganzhao Yuan

As a well-known optimization framework, the Alternating Direction Method of Multipliers (ADMM) has achieved tremendous success in many classification and regression applications. Recently, it has attracted the attention of deep learning…

机器学习 · 计算机科学 2021-12-23 Junxiang Wang , Hongyi Li , Liang Zhao

In the present paper we propose a novel convergence analysis of the Alternating Direction Methods of Multipliers (ADMM), based on its equivalence with the overrelaxed Primal-Dual Hybrid Gradient (oPDHG) algorithm. We consider the smooth…

最优化与控制 · 数学 2017-01-19 Pauline Tan

The alternating direction method of multipliers (ADMM) is a popular method for solving convex separable minimization problems with linear equality constraints. The generalization of the two-block ADMM to the three-block ADMM is not trivial…

最优化与控制 · 数学 2021-05-10 Yang Yang , Yuchao Tang , Jigen Peng

Numerous problems in machine learning are formulated as optimization with manifold constraints. In this paper, we propose the Manifold alternating directions method of multipliers (MADMM), an extension of the classical ADMM scheme for…

最优化与控制 · 数学 2015-05-29 Artiom Kovnatsky , Klaus Glashoff , Michael M. Bronstein

The alternating direction method of multipliers (ADMM) is a popular approach for solving optimization problems that are potentially non-smooth and with hard constraints. It has been applied to various computer graphics applications,…

图形学 · 计算机科学 2019-09-04 Juyong Zhang , Yue Peng , Wenqing Ouyang , Bailin Deng

The Alternating Direction Method of Multipliers (ADMM) has now days gained tremendous attentions for solving large-scale machine learning and signal processing problems due to the relative simplicity. However, the two-block structure of the…

最优化与控制 · 数学 2020-03-23 Mingxi Zhu , Kresimir Mihic , Yinyu Ye

In this paper, we consider solving multiple-block separable convex minimization problems using alternating direction method of multipliers (ADMM). Motivated by the fact that the existing convergence theory for ADMM is mostly limited to the…

最优化与控制 · 数学 2013-08-27 Xiangfeng Wang , Mingyi Hong , Shiqian Ma , Zhi-Quan Luo

This paper presents centralized and distributed Alternating Direction Method of Multipliers (ADMM) frameworks for solving large-scale nonconvex optimization problems with binary decision variables subject to spanning tree or rooted…

最优化与控制 · 数学 2026-03-10 Yacine Mokhtari

We provide a new proof of the linear convergence of the alternating direction method of multipliers (ADMM) when one of the objective terms is strongly convex. Our proof is based on a framework for analyzing optimization algorithms…

最优化与控制 · 数学 2015-05-20 Robert Nishihara , Laurent Lessard , Benjamin Recht , Andrew Packard , Michael I. Jordan

We consider a class of Riemannian optimization problems where the objective is the sum of a smooth function and a nonsmooth function, considered in the ambient space. This class of problems finds important applications in machine learning…

最优化与控制 · 数学 2024-11-27 Jiaxiang Li , Shiqian Ma , Tejes Srivastava

The alternating direction method of multipliers (ADMM) algorithm is a powerful and flexible tool for complex optimization problems of the form $\min\{f(x)+g(y) : Ax+By=c\}$. ADMM exhibits robust empirical performance across a range of…

最优化与控制 · 数学 2024-02-08 Rina Foygel Barber , Emil Y. Sidky

In this paper, we propose a new stochastic alternating direction method of multipliers (ADMM) algorithm, which incrementally approximates the full gradient in the linearized ADMM formulation. Besides having a low per-iteration complexity as…

机器学习 · 计算机科学 2013-08-19 Leon Wenliang Zhong , James T. Kwok

This paper presents a numerical solver for computing continuous trajectories in non-convex environments. Our approach relies on a customized implementation of the Alternating Direction Method of Multipliers (ADMM) built upon two key…

机器人学 · 计算机科学 2026-03-13 Lukas Pries , Jon Arrizabalaga , Zachary Manchester , Markus Ryll