English
Related papers

Related papers: Trading Communication for Computation in Byzantine…

200 papers

In distributed learning systems, robustness issues may arise from two sources. On one hand, due to distributional shifts between training data and test data, the trained model could exhibit poor out-of-sample performance. On the other hand,…

Machine Learning · Computer Science 2022-11-01 Guanqiang Zhou , Ping Xu , Yue Wang , Zhi Tian

Distributed algorithms provide flexibility over centralized algorithms for resource allocation problems, e.g., cyber-physical systems. However, the distributed nature of these algorithms often makes the systems susceptible to…

Optimization and Control · Mathematics 2019-09-11 Cesar A. Uribe , Hoi-To Wai , Mahnoosh Alizadeh

Gradient descent algorithms are widely used in machine learning. In order to deal with huge volume of data, we consider the implementation of gradient descent algorithms in a distributed computing setting where multiple workers compute the…

Distributed, Parallel, and Cluster Computing · Computer Science 2019-01-29 Haozhao Wang , Song Guo , Bin Tang , Ruixuan Li , Chengjie Li

This paper focuses on decentralized stochastic optimization in the presence of Byzantine attacks. During the optimization process, an unknown number of malfunctioning or malicious workers, termed as Byzantine workers, disobey the…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-04-13 Zhaoxian Wu , Tianyi Chen , Qing Ling

Federated learning has exhibited vulnerabilities to Byzantine attacks, where the Byzantine attackers can send arbitrary gradients to a central server to destroy the convergence and performance of the global model. A wealth of robust…

Machine Learning · Computer Science 2023-06-06 Yuchen Liu , Chen Chen , Lingjuan Lyu , Fangzhao Wu , Sai Wu , Gang Chen

Distributed model training needs to be adapted to challenges such as the straggler effect and Byzantine attacks. When coordinating the training process with multiple computing nodes, ensuring timely and reliable gradient aggregation amidst…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-12-11 Jiahe Yan , Pratik Chaudhari , Leonard Kleinrock

We consider unreliable distributed learning systems wherein the training data is kept confidential by external workers, and the learner has to interact closely with those workers to train a model. In particular, we assume that there exists…

Distributed, Parallel, and Cluster Computing · Computer Science 2019-05-10 Lili Su , Jiaming Xu

Coded computation techniques provide robustness against straggling workers in distributed computing. However, most of the existing schemes require exact provisioning of the straggling behaviour and ignore the computations carried out by…

Information Theory · Computer Science 2021-12-07 Emre Ozfatura , Sennur Ulukus , Deniz Gunduz

We study adversary-resilient stochastic distributed optimization, in which $m$ machines can independently compute stochastic gradients, and cooperate to jointly optimize over their local objective functions. However, an $\alpha$-fraction of…

Machine Learning · Computer Science 2021-04-05 Zeyuan Allen-Zhu , Faeze Ebrahimian , Jerry Li , Dan Alistarh

In a recent paper, Jaggi et al. (INFOCOM 2007), presented a distributed polynomial-time rate-optimal network-coding scheme that works in the presence of Byzantine faults. We revisit their adversarial models and augment them with three,…

Information Theory · Computer Science 2008-02-06 Leah Nutman , Michael Langberg

Within distributed learning, workers typically compute gradients on their assigned dataset chunks and send them to the parameter server (PS), which aggregates them to compute either an exact or approximate version of $\nabla L$ (gradient of…

Information Theory · Computer Science 2024-11-19 Aditya Ramamoorthy , Ruoyu Meng , Vrinda S. Girimaji

The widespread adoption of distributed learning to train a global model from local data has been hindered by the challenge posed by stragglers. Recent attempts to mitigate this issue through gradient coding have proved difficult due to the…

Networking and Internet Architecture · Computer Science 2023-07-26 Tingting Yang , Xinghan Wang , Jiahong Ning , Yang Yang

In distributed machine learning, a central node outsources computationally expensive calculations to external worker nodes. The properties of optimization procedures like stochastic gradient descent (SGD) can be leveraged to mitigate the…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-04-19 Maximilian Egger , Serge Kas Hanna , Rawad Bitar

In distributed computing systems, it is well recognized that worker nodes that are slow (called stragglers) tend to dominate the overall job execution time. Coded computation utilizes concepts from erasure coding to mitigate the effect of…

Information Theory · Computer Science 2018-09-18 Anindya B. Das , Li Tang , Aditya Ramamoorthy

In distributed optimization problems, a technique called gradient coding, which involves replicating data points, has been used to mitigate the effect of straggling machines. Recent work has studied approximate gradient coding, which…

Machine Learning · Statistics 2021-08-09 Margalit Glasgow , Mary Wootters

Asynchronous distributed machine learning solutions have proven very effective so far, but always assuming perfectly functioning workers. In practice, some of the workers can however exhibit Byzantine behavior, caused by hardware failures,…

Machine Learning · Statistics 2018-07-10 Georgios Damaskinos , El Mahdi El Mhamdi , Rachid Guerraoui , Rhicheek Patra , Mahsa Taziki

We present two distributed algorithms for the {\em Byzantine counting problem}, which is concerned with estimating the size of a network in the presence of a large number of Byzantine nodes. In an $n$-node network ($n$ is unknown), our…

Distributed, Parallel, and Cluster Computing · Computer Science 2022-04-27 Soumyottam Chatterjee , Gopal Pandurangan , Peter Robinson

Network coding achieves optimal throughput in multicast networks. However, throughput optimality \emph{relies} on the network nodes or routers to code \emph{correctly}. A Byzantine node may introduce junk packets in the network (thus…

Networking and Internet Architecture · Computer Science 2011-08-11 Raluca Ada Popa , Alessandro Chiesa , Tural Badirkhanli , Muriel Médard

We develop a distributed second order optimization algorithm that is communication-efficient as well as robust against Byzantine failures of the worker machines. We propose COMRADE (COMunication-efficient and Robust Approximate Distributed…

Machine Learning · Computer Science 2021-03-19 Avishek Ghosh , Raj Kumar Maity , Arya Mazumdar

Distributed learning is an effective approach to accelerate model training using multiple workers. However, substantial communication delays emerge between workers and a parameter server due to massive costs associated with communicating…

Machine Learning · Computer Science 2024-02-05 Chanho Park , Namyoon Lee