中文
相关论文

相关论文: Faster Stochastic Alternating Direction Method of …

200 篇论文

Tenfold improvements in computation speed can be brought to the alternating direction method of multipliers (ADMM) for Semidefinite Programming with virtually no decrease in robustness and provable convergence simply by projecting…

最优化与控制 · 数学 2021-12-28 Nikitas Rontsis , Paul J. Goulart , Yuji Nakatsukasa

This paper investigates the collision-free control problem for multi-agent systems. For such multi-agent systems, it is the typical situation where conventional methods using either the usual centralized model predictive control (MPC), or…

多智能体系统 · 计算机科学 2024-02-07 Zilong Cheng , Jun Ma , Wenxin Wang , Zicheng Zhu , Clarence W. de Silva , Tong Heng Lee

The alternating direction method of multipliers (ADMM) is a flexible method to solve a large class of convex minimization problems. Particular features are its unconditional convergence with respect to the involved step size and its direct…

数值分析 · 数学 2017-04-21 Sören Bartels , Marijo Milicevic

In the fields of statistics, machine learning, image science, and related areas, there is an increasing demand for decentralized collection or storage of large-scale datasets, as well as distributed solution methods. To tackle this…

最优化与控制 · 数学 2024-01-17 Bowen Li , Bin Shi

Large scale, non-convex optimization problems arising in many complex networks such as the power system call for efficient and scalable distributed optimization algorithms. Existing distributed methods are usually iterative and require…

最优化与控制 · 数学 2017-10-26 Junyao Guo , Gabriela Hug , Ozan Tonguz

We study smooth stochastic optimization problems on Riemannian manifolds. Via adapting the recently proposed SPIDER algorithm \citep{fang2018spider} (a variance reduced stochastic method) to Riemannian manifold, we can achieve faster rate…

最优化与控制 · 数学 2018-12-17 Jingzhao Zhang , Hongyi Zhang , Suvrit Sra

We propose a new relative-error inexact version of the alternating direction method of multipliers (ADMM) for convex optimization. We prove the asymptotic convergence of our main algorithm as well as pointwise and ergodic…

最优化与控制 · 数学 2024-09-17 M. Marques Alves , M. Geremia

We propose a novel data-driven method to accelerate the convergence of Alternating Direction Method of Multipliers (ADMM) for solving distributed DC optimal power flow (DC-OPF) where lines are shared between independent network partitions.…

最优化与控制 · 数学 2020-09-16 David Biagioni , Peter Graf , Xiangyu Zhang , Ahmed Zamzam , Kyri Baker , Jennifer King

Semidefinite programming (SDP) is a fundamental convex optimization problem with wide-ranging applications. However, solving large-scale instances remains computationally challenging due to the high cost of solving linear systems and…

最优化与控制 · 数学 2025-12-22 Hantao Nie , Dong An , Zaiwen Wen

Alternating Direction Method of Multipliers (ADMM) is a popular algorithm for distributed learning, where a network of nodes collaboratively solve a regularized empirical risk minimization by iterative local computation associated with…

机器学习 · 计算机科学 2020-05-19 Zonghao Huang , Yanmin Gong

Alternating Direction Method of Multipliers (ADMM) has been used successfully in many conventional machine learning applications and is considered to be a useful alternative to Stochastic Gradient Descent (SGD) as a deep learning optimizer.…

最优化与控制 · 数学 2021-07-07 Junxiang Wang , Fuxun Yu , Xiang Chen , Liang Zhao

Online optimization has emerged as powerful tool in large scale optimization. In this pa- per, we introduce efficient online optimization algorithms based on the alternating direction method (ADM), which can solve online convex optimization…

机器学习 · 计算机科学 2013-07-11 Huahua Wang , Arindam Banerjee

Aiming at solving large-scale learning problems, this paper studies distributed optimization methods based on the alternating direction method of multipliers (ADMM). By formulating the learning problem as a consensus problem, the ADMM can…

分布式、并行与集群计算 · 计算机科学 2016-05-04 Tsung-Hui Chang , Mingyi Hong , Wei-Cheng Liao , Xiangfeng Wang

The objective of this paper is to design an efficient and convergent alternating direction method of multipliers (ADMM) for finding a solution of medium accuracy to conic programming problems whose constraints consist of linear equalities,…

最优化与控制 · 数学 2014-12-02 Defeng Sun , Kim-Chuan Toh , Liuqin Yang

One of the crucial issues in federated learning is how to develop efficient optimization algorithms. Most of the current ones require full device participation and/or impose strong assumptions for convergence. Different from the widely-used…

最优化与控制 · 数学 2023-09-26 Shenglong Zhou , Geoffrey Ye Li

From a dual perspective of the sparse representation model, Nam et al. proposed the cosparse analysis model. In this paper, we aim to investigate the convergence of the alternating direction method of multipliers (ADMM) for the cosparse…

最优化与控制 · 数学 2023-11-23 Zisheng Liu , Ting Zhang

The alternating direction method with multipliers (ADMM) has been one of most powerful and successful methods for solving various convex or nonconvex composite problems that arise in the fields of image & signal processing and machine…

最优化与控制 · 数学 2014-12-08 Fenghui Wang , Zongben Xu , Hong-Kun Xu

Multi-agent distributed consensus optimization problems arise in many signal processing applications. Recently, the alternating direction method of multipliers (ADMM) has been used for solving this family of problems. ADMM based distributed…

系统与控制 · 计算机科学 2015-06-18 Tsung-Hui Chang , Mingyi Hong , Xiangfeng Wang

Alternating Direction Method of Multipliers (ADMM) is a popular convex optimization algorithm, which can be employed for solving distributed consensus optimization problems. In this setting agents locally estimate the optimal solution of an…

信号处理 · 电气工程与系统科学 2019-03-27 Layla Majzoobi , Farshad Lahouti , Vahid Shah-Mansouri

In this paper we propose a corrected semi-proximal ADMM (alternating direction method of multipliers) for the general $p$-block $(p\!\ge 3)$ convex optimization problems with linear constraints, aiming to resolve the dilemma that almost all…

最优化与控制 · 数学 2015-02-12 Li Shen , Shaohua Pan