中文
相关论文

相关论文: Alternating direction method of multipliers for re…

200 篇论文

The Alternating Direction Method of Multipliers (ADMM) has been proved to be effective for solving separable convex optimization subject to linear constraints. In this paper, we propose a Generalized Symmetric ADMM (GS-ADMM), which updates…

最优化与控制 · 数学 2018-12-11 Jianchao Bai , Jicheng Li , Fengmin Xu , Hongchao Zhang

In this work, we present a hardware compatible neural network training algorithm in which we used alternating direction method of multipliers (ADMM) and iterative least-square methods. The motive behind this approach was to conduct a method…

机器学习 · 计算机科学 2020-09-08 Seyedeh Niusha Alavi Foumani , Ce Guo , Wayne Luk

We propose a new stochastic dual coordinate ascent technique that can be applied to a wide range of regularized learning problems. Our method is based on Alternating Direction Multiplier Method (ADMM) to deal with complex regularization…

机器学习 · 统计学 2013-11-05 Taiji Suzuki

Quantization of the parameters of machine learning models, such as deep neural networks, requires solving constrained optimization problems, where the constraint set is formed by the Cartesian product of many simple discrete sets. For such…

最优化与控制 · 数学 2021-03-02 Tianjian Huang , Prajwal Singhania , Maziar Sanjabi , Pabitra Mitra , Meisam Razaviyayn

This paper proposes a dual Riemannian alternating direction method of multipliers (ADMM) for solving low-rank semidefinite programs with unit diagonal constraints. We recast the ADMM subproblem as a Riemannian optimization problem over the…

最优化与控制 · 数学 2025-12-05 Jie Wang , Liangbing Hu , Bican Xia

Support Vector Machines (SVM) have gathered significant acclaim as classifiers due to their successful implementation of Statistical Learning Theory. However, in the context of multiclass and multilabel settings, the reliance on…

机器学习 · 计算机科学 2023-07-19 Sambhav Jain Reshma Rastogi

Alternating direction method of multipliers (ADMM) is a popular optimization tool for the composite and constrained problems in machine learning. However, in many machine learning problems such as black-box attacks and bandit feedback, ADMM…

最优化与控制 · 数学 2019-07-31 Feihu Huang , Shangqian Gao , Songcan Chen , Heng Huang

Alternating Direction Method of Multipliers (ADMM) is a popular method for solving large-scale Machine Learning problems. Stochastic ADMM was proposed to reduce the per iteration computational complexity, which is more suitable for big data…

数值分析 · 计算机科学 2023-04-25 Chao Zhang , Zebang Shen , Hui Qian , Tengfei Zhou , Jianya Zhou , Jianying Zhou

The alternating direction method with multipliers (ADMM) has been one of most powerful and successful methods for solving various composite problems. The convergence of the conventional ADMM (i.e., 2-block) for convex objective functions…

最优化与控制 · 数学 2015-05-13 Fenghui Wang , Wenfei Cao , Zongben Xu

Recently, semidefinite programming performance estimation has been employed as a strong tool for the worst-case performance analysis of first order methods. In this paper, we derive new non-ergodic convergence rates for the alternating…

最优化与控制 · 数学 2023-05-25 Moslem Zamani , Hadi Abbaszadehpeivasti , Etienne de Klerk

This note serves two purposes. Firstly, we construct a counterexample to show that the statement on the convergence of the alternating direction method of multipliers (ADMM) for solving linearly constrained convex optimization problems in a…

最优化与控制 · 数学 2020-06-09 Liang Chen , Defeng Sun , Kim-Chuan Toh

We provide a new proof of the linear convergence of the alternating direction method of multipliers (ADMM) when one of the objective terms is strongly convex. Our proof is based on a framework for analyzing optimization algorithms…

最优化与控制 · 数学 2015-05-20 Robert Nishihara , Laurent Lessard , Benjamin Recht , Andrew Packard , Michael I. Jordan

The alternating direction method of multipliers (ADMM) is widely used for solving large-scale semidefinite programs (SDPs), yet on instances with multiple primal-dual optimal solution pairs, it often enters prolonged slow-convergence…

最优化与控制 · 数学 2026-03-04 Shucheng Kang , Heng Yang

The Support Vector Machine (SVM) is a popular classification paradigm in machine learning and has achieved great success in real applications. However, the standard SVM can not select variables automatically and therefore its solution…

统计方法学 · 统计学 2008-12-18 Hao Helen Zhang , Yufeng Liu , Yichao Wu , Ji Zhu

We investigate a class of general combinatorial graph problems, including MAX-CUT and community detection, reformulated as quadratic objectives over nonconvex constraints and solved via the alternating direction method of multipliers…

系统与控制 · 电气工程与系统科学 2022-09-09 Chuangchuang Sun

Recently, the alternating direction method of multipliers (ADMM) has found many efficient applications in various areas; and it has been shown that the convergence is not guaranteed when it is directly extended to the multiple-block case of…

最优化与控制 · 数学 2016-11-15 Min Tao , Xiaoming Yuan

In this paper, we present a semi-proximal alternating direction method of multipliers (ADMM) for solving $3$-block separable convex minimization problems with the second block in the objective being a strongly convex function and one…

最优化与控制 · 数学 2015-06-24 Min Li , Defeng Sun , Kim-Chuan Toh

The Alternating Direction Method of Multipliers (ADMM) provides a natural way of solving inverse problems with multiple partial differential equations (PDE) forward models and nonsmooth regularization. ADMM allows splitting these…

数值分析 · 数学 2021-04-29 Luke Lozenski , Umberto Villa

Saddle-point problems appear in various settings including machine learning, zero-sum stochastic games, and regression problems. We consider decomposable saddle-point problems and study an extension of the alternating direction method of…

最优化与控制 · 数学 2022-12-29 Mustafa O. Karabag , David Fridovich-Keil , Ufuk Topcu

This paper develops an adaptive proximal alternating direction method of multipliers (ADMM) for solving linearly constrained, composite optimization problems under the assumption that the smooth component of the objective is weakly convex,…

最优化与控制 · 数学 2026-05-04 Leandro Farias Maia , David H. Gutman , Renato D. C. Monteiro , Gilson N. Silva