English
Related papers

Related papers: Distributed Newton Can Communicate Less and Resist…

200 papers

We study the problem of Byzantine fault tolerance in a distributed optimization setting, where there is a group of $N$ agents communicating with a trusted centralized coordinator. Among these agents, there is a subset of $f$ agents that may…

Optimization and Control · Mathematics 2023-12-19 Amit Dutta , Thinh T. Doan , Jeffrey H. Reed

In distributed learning systems, robustness issues may arise from two sources. On one hand, due to distributional shifts between training data and test data, the trained model could exhibit poor out-of-sample performance. On the other hand,…

Machine Learning · Computer Science 2022-11-01 Guanqiang Zhou , Ping Xu , Yue Wang , Zhi Tian

Communication between workers and the master node to collect local stochastic gradients is a key bottleneck in a large-scale federated learning system. Various recent works have proposed to compress the local stochastic gradients to…

Machine Learning · Computer Science 2024-02-06 Heng Zhu , Qing Ling

We consider minimization of a sum of convex objective functions where the components of the objective are available at different nodes of a network and nodes are allowed to only communicate with their neighbors. The use of distributed…

Optimization and Control · Mathematics 2014-12-12 Aryan Mokhtari , Qing Ling , Alejandro Ribeiro

Byzantine reliable broadcast is a fundamental problem in distributed computing, which has been studied extensively over the past decades. State-of-the-art algorithms are predominantly based on the approach to share encoded fragments of the…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-01-06 Thomas Locher

This paper considers distributed optimization problems, where each agent cooperatively minimizes the sum of local objective functions through the communication with its neighbors. The widely adopted distributed gradient method in solving…

Optimization and Control · Mathematics 2025-08-19 Yeming Xu , Ziyuan Guo , Kaihong Lu , Huanshui Zhang

Byzantine-robustness has been gaining a lot of attention due to the growth of the interest in collaborative and federated learning. However, many fruitful directions, such as the usage of variance reduction for achieving robustness and…

Machine Learning · Computer Science 2023-03-09 Eduard Gorbunov , Samuel Horváth , Peter Richtárik , Gauthier Gidel

Asynchronous distributed machine learning solutions have proven very effective so far, but always assuming perfectly functioning workers. In practice, some of the workers can however exhibit Byzantine behavior, caused by hardware failures,…

Machine Learning · Statistics 2018-07-10 Georgios Damaskinos , El Mahdi El Mhamdi , Rachid Guerraoui , Rhicheek Patra , Mahsa Taziki

We consider distributed stochastic optimization problems that are solved with master/workers computation architecture. Statistical arguments allow to exploit statistical similarity and approximate this problem by a finite-sum problem, for…

We study the problem of minimizing a sum of convex objective functions where the components of the objective are available at different nodes of a network and nodes are allowed to only communicate with their neighbors. The use of…

Optimization and Control · Mathematics 2015-04-24 Aryan Mokhtari , Qing Ling , Alejandro Ribeiro

We present two distributed algorithms for the {\em Byzantine counting problem}, which is concerned with estimating the size of a network in the presence of a large number of Byzantine nodes. In an $n$-node network ($n$ is unknown), our…

Distributed, Parallel, and Cluster Computing · Computer Science 2022-04-27 Soumyottam Chatterjee , Gopal Pandurangan , Peter Robinson

Motivated by economic dispatch and linearly-constrained resource allocation problems, this paper proposes a novel Distributed Approx-Newton algorithm that approximates the standard Newton optimization method. A main property of this…

Numerical Analysis · Computer Science 2017-03-24 Tor Anderson , Chin-Yao Chang , Sonia Martinez

Distributed algorithms provide flexibility over centralized algorithms for resource allocation problems, e.g., cyber-physical systems. However, the distributed nature of these algorithms often makes the systems susceptible to…

Optimization and Control · Mathematics 2019-09-11 Cesar A. Uribe , Hoi-To Wai , Mahnoosh Alizadeh

In this paper, we study the problem of distributed training (DT) under Byzantine attacks with communication constraints. While prior work has developed various robust aggregation rules at the server to enhance robustness to Byzantine…

Distributed, Parallel, and Cluster Computing · Computer Science 2026-04-01 Chengxi Li , Youssef Allouah , Rachid Guerraoui , Mikael Skoglund , Ming Xiao

Recent advances in distributed optimization have shown that Newton-type methods with proper communication compression mechanisms can guarantee fast local rates and low communication cost compared to first order methods. We discover that the…

Machine Learning · Computer Science 2021-11-04 Xun Qian , Rustem Islamov , Mher Safaryan , Peter Richtárik

Distributed optimization is widely used in large-scale and privacy-preserving machine learning, where each agent stores a local objective and communicates only with its neighbors in a connected network. We study decentralized second-order…

The problem of designing distributed optimization algorithms that are resilient to Byzantine adversaries has received significant attention. For the Byzantine-resilient distributed optimization problem, the goal is to (approximately)…

Optimization and Control · Mathematics 2024-12-30 Kananart Kuwaranancharoen , Shreyas Sundaram

We propose a communication- and computation-efficient distributed optimization algorithm using second-order information for solving ERM problems with a nonsmooth regularization term. Current second-order and quasi-Newton methods for this…

Optimization and Control · Mathematics 2018-05-29 Ching-pei Lee , Cong Han Lim , Stephen J. Wright

We study adversary-resilient stochastic distributed optimization, in which $m$ machines can independently compute stochastic gradients, and cooperate to jointly optimize over their local objective functions. However, an $\alpha$-fraction of…

Machine Learning · Computer Science 2021-04-05 Zeyuan Allen-Zhu , Faeze Ebrahimian , Jerry Li , Dan Alistarh

This thesis explores a particular class of distributed optimization methods for various separable resource allocation problems, which are of high interest in a wide array of multi-agent settings. A distinctly motivating application for this…

Systems and Control · Electrical Eng. & Systems 2021-03-26 Tor Anderson