中文
相关论文

相关论文: Bregman Alternating Direction Method of Multiplier…

200 篇论文

Online optimization has emerged as powerful tool in large scale optimization. In this pa- per, we introduce efficient online optimization algorithms based on the alternating direction method (ADM), which can solve online convex optimization…

机器学习 · 计算机科学 2013-07-11 Huahua Wang , Arindam Banerjee

Nonconvex and structured optimization problems arise in many engineering applications that demand scalable and distributed solution methods. The study of the convergence properties of these methods is in general difficult due to the…

Bayesian models provide a framework for probabilistic modelling of complex datasets. However, many of such models are computationally demanding especially in the presence of large datasets. On the other hand, in sensor network applications,…

机器学习 · 计算机科学 2015-07-06 Behnam Babagholami-Mohamadabadi , Sejong Yoon , Vladimir Pavlovic

Recently, semidefinite programming performance estimation has been employed as a strong tool for the worst-case performance analysis of first order methods. In this paper, we derive new non-ergodic convergence rates for the alternating…

最优化与控制 · 数学 2023-05-25 Moslem Zamani , Hadi Abbaszadehpeivasti , Etienne de Klerk

We consider a class of distributed optimization problem where the objective function consists of a sum of strongly convex and smooth functions and a (possibly nonsmooth) convex regularizer. A multi-agent network is assumed, where each agent…

最优化与控制 · 数学 2021-10-01 Yichuan Li , Yonghai Gong , Nikolaos M. Freris , Petros Voulgaris , Dusan Stipanovic

The alternating direction method of multipliers (ADMM) were extensively investigated in the past decades for solving separable convex optimization problems. Fewer researchers focused on exploring its convergence properties for the nonconvex…

数值分析 · 数学 2019-07-02 Jianchao Bai , Junli Liang , Ke Guo , Yang Jing

In this paper, we establish the convergence of the proximal alternating direction method of multipliers (ADMM) and block coordinate descent (BCD) for nonseparable minimization models with quadratic coupling terms. The novel convergence…

最优化与控制 · 数学 2017-03-16 Caihua Chen , Min Li , Xin Liu , Yinyu Ye

Convex quadratic programs (QPs) constitute a fundamental computational primitive across diverse domains including financial optimization, control systems, and machine learning. The alternating direction method of multipliers (ADMM) has…

最优化与控制 · 数学 2025-05-15 Xi Gao , Jinxin Xiong , Linxin Yang , Akang Wang , Weiwei Xu , Jiang Xue

Multi-agent distributed consensus optimization problems arise in many signal processing applications. Recently, the alternating direction method of multipliers (ADMM) has been used for solving this family of problems. ADMM based distributed…

系统与控制 · 计算机科学 2015-06-18 Tsung-Hui Chang , Mingyi Hong , Xiangfeng Wang

We develop two new variants of alternating direction methods of multipliers (ADMM) and two parallel primal-dual decomposition algorithms to solve a wide range class of constrained convex optimization problems. Our approach relies on a novel…

最优化与控制 · 数学 2018-06-15 Quoc Tran-Dinh , Yuzixuan Zhu

We propose new methods to speed up convergence of the Alternating Direction Method of Multipliers (ADMM), a common optimization tool in the context of large scale and distributed learning. The proposed method accelerates the speed of…

机器学习 · 计算机科学 2016-04-05 Changkyu Song , Sejong Yoon , Vladimir Pavlovic

The storage and computation requirements of Convolutional Neural Networks (CNNs) can be prohibitive for exploiting these models over low-power or embedded devices. This paper reduces the computational complexity of the CNNs by minimizing an…

神经与进化计算 · 计算机科学 2017-01-17 Farkhondeh Kiaee , Christian Gagné , Mahdieh Abbasi

We propose a new relative-error inexact version of the alternating direction method of multipliers (ADMM) for convex optimization. We prove the asymptotic convergence of our main algorithm as well as pointwise and ergodic…

最优化与控制 · 数学 2024-09-17 M. Marques Alves , M. Geremia

In this work, we propose a (linearized) Alternating Direction Method-of-Multipliers (ADMM) algorithm for minimizing a convex function subject to a nonconvex constraint. We focus on the special case where such constraint arises from the…

机器学习 · 计算机科学 2019-07-09 Fabian Latorre Gómez , Armin Eftekhari , Volkan Cevher

This paper presents optimal scaling of the alternating directions method of multipliers (ADMM) algorithm for a class of distributed quadratic programming problems. The scaling corresponds to the ADMM step-size and relaxation parameter, as…

最优化与控制 · 数学 2016-11-15 André Teixeira , Euhanna Ghadimi , Iman Shames , Henrik Sandberg , Mikael Johansson

We propose a new stochastic dual coordinate ascent technique that can be applied to a wide range of regularized learning problems. Our method is based on Alternating Direction Multiplier Method (ADMM) to deal with complex regularization…

机器学习 · 统计学 2013-11-05 Taiji Suzuki

The alternating direction method of multipliers (ADMM) has been recognized as a versatile approach for solving modern large-scale machine learning and signal processing problems efficiently. When the data size and/or the problem dimension…

分布式、并行与集群计算 · 计算机科学 2016-05-04 Tsung-Hui Chang , Wei-Cheng Liao , Mingyi Hong , Xiangfeng Wang

Assigning items to owners is a common problem found in various real-world applications, for example, audience-channel matching in marketing campaigns, borrower-lender matching in loan management, and shopper-merchant matching in e-commerce.…

数据结构与算法 · 计算机科学 2022-11-01 Jun Zhou , Feng Qi , Zhigang Hua , Daohong Jian , Ziqi Liu , Hua Wu , Xingwen Zhang , Shuang Yang

With the proliferation of distributed energy resources and the volume of data stored due to advancement in metering infrastructure, energy management in power system operation needs distributed computing. In this paper, we propose a fully…

系统与控制 · 电气工程与系统科学 2020-05-21 Shailesh Wasti , Pablo Ubiratan , Shahab Afshar , Vahid Disfani

Over the fast few years, the numerical success of the generalized alternating direction method of multipliers (GADMM) proposed by Eckstein \& Bertsekas [Math. Prog., 1992] has inspired intensive attention in analyzing its theoretical…

最优化与控制 · 数学 2022-06-09 Han Wang , Peili Li , Yunhai Xiao