中文
相关论文

相关论文: Scalable Stochastic Alternating Direction Method o…

200 篇论文

Alternating direction method of multiplier (ADMM) is a powerful method to solve decentralized convex optimization problems. In distributed settings, each node performs computation with its local data and the local results are exchanged…

密码学与安全 · 计算机科学 2018-10-09 Xueru Zhang , Mohammad Mahdi Khalili , Mingyan Liu

This technical note is an ancillary material for our research paper (Itoh and Parente, 2019). We discuss an alternating direction method of multipliers with generalized augmented terms (ADMM-GAT) and introduce a generalized residual balance…

最优化与控制 · 数学 2019-09-19 Yuki Itoh , Mario Parente

We present an Alternating Direction Method of Multipliers (ADMM) algorithm designed to solve the Weighted Generalized Fused LASSO Signal Approximator (wFLSA). First, we show that wFLSAs can always be reformulated as a Generalized LASSO…

统计方法学 · 统计学 2024-07-26 Louis Dijkstra , Moritz Hanke , Niklas Koenen , Ronja Foraita

In this paper we propose an iterative method using alternating direction method of multipliers (ADMM) strategy to solve linear inverse problems in Hilbert spaces with general convex penalty term. When the data is given exactly, we give a…

数值分析 · 数学 2016-01-13 Yuling Jiao , Qinian Jin , Xiliang Lu , Weijie Wang

This article reports an algorithm for multi-agent distributed optimization problems with a common decision variable, local linear equality and inequality constraints and set constraints with convergence rate guarantees.…

系统与控制 · 电气工程与系统科学 2022-11-17 Vivek Khatana , Murti V. Salapaka

Linearized alternating direction method of multipliers (ADMM) as an extension of ADMM has been widely used to solve linearly constrained problems in signal processing, machine leaning, communications, and many other fields. Despite its…

最优化与控制 · 数学 2017-11-02 Qinghua Liu , Xinyue Shen , Yuantao Gu

We introduce a new algorithm to solve a regularized spatial-spectral image estimation problem. Our approach is based on the linearized alternating directions method of multipliers (LADMM), which is a variation of the popular ADMM algorithm.…

信号处理 · 电气工程与系统科学 2025-02-25 Yunsong Liu , Debdut Mandal , Congyu Liao , Kawin Setsompop , Justin P. Haldar

In this work, we present a hardware compatible neural network training algorithm in which we used alternating direction method of multipliers (ADMM) and iterative least-square methods. The motive behind this approach was to conduct a method…

机器学习 · 计算机科学 2020-09-08 Seyedeh Niusha Alavi Foumani , Ce Guo , Wayne Luk

We propose both serial and parallel proximal (linearized) alternating direction method of multipliers (ADMM) algorithms for training residual neural networks. In contrast to backpropagation-based approaches, our methods inherently mitigate…

机器学习 · 计算机科学 2025-04-01 Jintao Xu , Yifei Li , Wenxun Xing

In this paper, we propose a novel distributed algorithm for consensus optimization over networks and a robust extension tailored to deal with asynchronous agents and packet losses. Indeed, to robustly achieve dynamic consensus on the…

最优化与控制 · 数学 2025-09-04 Guido Carnevale , Nicola Bastianello , Giuseppe Notarstefano , Ruggero Carli

This work proposes a method for solving linear stochastic optimal control (SOC) problems using sum of squares and semidefinite programming. Previous work had used polynomial optimization to approximate the value function, requiring a high…

最优化与控制 · 数学 2014-09-23 Matanya B. Horowitz , Ivan Papusha , Joel W. Burdick

Stochastic gradient methods (SGMs) are the predominant approaches to train deep learning models. The adaptive versions (e.g., Adam and AMSGrad) have been extensively used in practice, partly because they achieve faster convergence than the…

最优化与控制 · 数学 2022-04-14 Yangyang Xu , Yibo Xu , Yonggui Yan , Colin Sutcher-Shepard , Leopold Grinberg , Jie Chen

In this paper, we show that for a class of linearly constrained convex composite optimization problems, an (inexact) symmetric Gauss-Seidel based majorized multi-block proximal alternating direction method of multipliers (ADMM) is…

最优化与控制 · 数学 2019-01-29 Liang Chen , Xudong Li , Defeng Sun , Kim-Chuan Toh

This paper presents centralized and distributed Alternating Direction Method of Multipliers (ADMM) frameworks for solving large-scale nonconvex optimization problems with binary decision variables subject to spanning tree or rooted…

最优化与控制 · 数学 2026-03-10 Yacine Mokhtari

By coordinating terminal smart devices or microprocessors to engage in cooperative computation to achieve systemlevel targets, distributed optimization is incrementally favored by both engineering and computer science. The well-known…

分布式、并行与集群计算 · 计算机科学 2022-08-24 Yu Yang , Xiaohong Guan , Qing-Shan Jia , Liang Yu , Bolun Xu , Costas J. Spanos

Alternating direction method of multiplier (ADMM) is a powerful method to solve decentralized convex optimization problems. In distributed settings, each node performs computation with its local data and the local results are exchanged…

机器学习 · 计算机科学 2019-10-11 Xueru Zhang , Mohammad Mahdi Khalili , Mingyan Liu

This paper studies the problem of steering large-scale multi-agent stochastic linear systems between Gaussian distributions under probabilistic collision avoidance constraints. We introduce a family of \textit{distributed covariance…

系统与控制 · 电气工程与系统科学 2026-04-07 Augustinos D. Saravanos , Isin M. Balci , Arshiya Taj Abdul , Efstathios Bakolas , Evangelos A. Theodorou

The alternating direction method of multipliers (ADMM) is a widely used method for solving many convex minimization models arising in signal and image processing. In this paper, we propose an inertial ADMM for solving a two-block separable…

最优化与控制 · 数学 2021-04-02 Yang Yang , Yuchao Tang

The alternating direction method of multipliers (ADMM) is a powerful operator splitting technique for solving structured convex optimization problems. Due to its relatively low per-iteration computational cost and ability to exploit…

最优化与控制 · 数学 2020-06-09 Michel Schubiger , Goran Banjac , John Lygeros

This paper proposes a provably convergent multiblock ADMM for nonconvex optimization with nonlinear dynamics constraints, overcoming the divergence issue in classical extensions. We consider a class of optimization problems that arise from…

最优化与控制 · 数学 2025-06-24 Bowen Li , Ya-xiang Yuan