English
Related papers

Related papers: Stochastic Alternating Direction Method of Multipl…

200 papers

This article reports an algorithm for multi-agent distributed optimization problems with a common decision variable, local linear equality and inequality constraints and set constraints with convergence rate guarantees.…

Systems and Control · Electrical Eng. & Systems 2022-11-17 Vivek Khatana , Murti V. Salapaka

In this work, we consider the distributed optimization problem in which each node has its own convex cost function and can communicate directly only with its neighbors, as determined by a directed communication topology (directed graph or…

Optimization and Control · Mathematics 2021-10-07 Wei Jiang , Themistoklis Charalambous

Stochastic alternating direction method of multipliers (ADMM), which visits only one sample or a mini-batch of samples each time, has recently been proved to achieve better performance than batch ADMM. However, most stochastic methods can…

Machine Learning · Computer Science 2015-07-21 Shen-Yi Zhao , Wu-Jun Li , Zhi-Hua Zhou

We consider a distributed reinforcement learning setting where multiple agents separately explore the environment and communicate their experiences through a central server. However, $\alpha$-fraction of agents are adversarial and can…

Machine Learning · Computer Science 2022-06-02 Yiding Chen , Xuezhou Zhang , Kaiqing Zhang , Mengdi Wang , Xiaojin Zhu

In this paper, a stochastic alternating direction method of multipliers (ADMM) is proposed for a class of nonsmooth composite and stochastic convex optimization problems in Hilbert space, motivated by optimization problems constrained by…

Optimization and Control · Mathematics 2026-05-18 Weihua Deng , Haiming Song , Hao Wang , Jinda Yang

Byzantine-robust federated learning aims at mitigating Byzantine failures during the federated training process, where malicious participants may upload arbitrary local updates to the central server to degrade the performance of the global…

Machine Learning · Computer Science 2023-02-15 Shenghui Li , Edith C. -H. Ngai , Thiemo Voigt

This paper studies a proximal alternating direction method of multipliers (ADMM) with variable metric indefinite proximal terms for linearly constrained convex optimization problems. The proximal ADMM plays an important role in many…

Optimization and Control · Mathematics 2019-07-01 Yan Gu , Nobuo Yamashita

Federated learning enables training collaborative machine learning models at scale with many participants whilst preserving the privacy of their datasets. Standard federated learning techniques are vulnerable to Byzantine failures, biased…

Machine Learning · Statistics 2019-09-12 Luis Muñoz-González , Kenneth T. Co , Emil C. Lupu

Gradient-based training in federated learning is known to be vulnerable to faulty/malicious clients, which are often modeled as Byzantine clients. To this end, previous work either makes use of auxiliary data at parameter server to verify…

Machine Learning · Computer Science 2023-05-02 Jian Xu , Shao-Lun Huang , Linqi Song , Tian Lan

The alternating direction method of multipliers (ADMM) is commonly used for distributed model fitting problems, but its performance and reliability depend strongly on user-defined penalty parameters. We study distributed ADMM methods that…

Machine Learning · Computer Science 2017-06-21 Zheng Xu , Gavin Taylor , Hao Li , Mario Figueiredo , Xiaoming Yuan , Tom Goldstein

We propose a distributed algorithm, named Distributed Alternating Direction Method of Multipliers (D-ADMM), for solving separable optimization problems in networks of interconnected nodes or agents. In a separable optimization problem there…

Optimization and Control · Mathematics 2013-04-26 João F. C. Mota , João M. F. Xavier , Pedro M. Q. Aguiar , Markus Püschel

In this paper we propose an iterative method using alternating direction method of multipliers (ADMM) strategy to solve linear inverse problems in Hilbert spaces with general convex penalty term. When the data is given exactly, we give a…

Numerical Analysis · Mathematics 2016-01-13 Yuling Jiao , Qinian Jin , Xiliang Lu , Weijie Wang

Due to the explosion in size and complexity of modern data sets and privacy concerns of data holders, it is increasingly important to be able to solve machine learning problems in distributed manners. The Alternating Direction Method of…

Networking and Internet Architecture · Computer Science 2021-04-27 Saeedeh Parsaeefard , Alberto Leon Garcia

To solve the separable convex optimization problem with linear constraints, Eckstein and Bertsekas introduced the generalized alternating direction method of multipliers (in short, GADMM), which is an efficient and simple acceleration…

Optimization and Control · Mathematics 2022-11-17 Jianwen Peng , Dexi Liu , Xueqing Zhang , Jen-Chih Yao

Distributed algorithms for multi-agent resource allocation can provide privacy and scalability over centralized algorithms in many cyber-physical systems. However, the distributed nature of these algorithms can render these systems…

Optimization and Control · Mathematics 2020-12-08 Berkay Turan , Cesar A. Uribe , Hoi-To Wai , Mahnoosh Alizadeh

We consider gradient coding in the presence of an adversary controlling so-called malicious workers trying to corrupt the computations. Previous works propose the use of MDS codes to treat the responses from malicious workers as errors and…

Information Theory · Computer Science 2024-01-08 Christoph Hofmeister , Luis Maßny , Eitan Yaakobi , Rawad Bitar

An inexact accelerated stochastic Alternating Direction Method of Multipliers (AS-ADMM) scheme is developed for solving structured separable convex optimization problems with linear constraints. The objective function is the sum of a…

Optimization and Control · Mathematics 2020-10-27 Jianchao Bai , William W. Hager , Hongchao Zhang

This paper discusses a consensus-based alternating direction method of multipliers (ADMM) approach to solve the multi-area coordinated network-constrained unit commitment (NCUC) problem in a distributed manner. Due to political and…

Optimization and Control · Mathematics 2018-01-23 Yamin Wang , Lei Wu , Jie Li

The alternating direction method of multipliers (ADMM) proposed by Glowinski and Marrocco is a benchmark algorithm for two-block separable convex optimization problems with linear equality constraints. It has been modified, specified, and…

Optimization and Control · Mathematics 2021-07-15 Bingsheng He , Shengjie Xu , Xiaoming Yuan

Federated Learning (FL) enables clients to collaboratively train a global model without sharing their private data. However, the presence of malicious (Byzantine) clients poses significant challenges to the robustness of FL, particularly…

Machine Learning · Computer Science 2026-05-26 Javad Parsa , Amir Hossein Daghestani , André M. H. Teixeira , Mikael Johansson