English
Related papers

Related papers: Interactive Byzantine-Resilient Gradient Coding fo…

200 papers

Numerous distributed applications, such as cloud computing and distributed ledgers, necessitate the system to invoke asynchronous consensus objects an unbounded number of times, where the completion of one consensus instance is followed by…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-07-28 Chryssis Georgiou , Michel Raynal , Elad M. Schiller

This paper considers the multi-agent reinforcement learning (MARL) problem for a networked (peer-to-peer) system in the presence of Byzantine agents. We build on an existing distributed $Q$-learning algorithm, and allow certain agents in…

Systems and Control · Electrical Eng. & Systems 2021-04-08 Yijing Xie , Shaoshuai Mou , Shreyas Sundaram

The alternating direction of multipliers method (ADMM) is a popular method to solve distributed consensus optimization utilizing efficient communication among various nodes in the network. However, in the presence of faulty or attacked…

Optimization and Control · Mathematics 2025-12-10 Vishnu Vijay , Kartik A. Pant , Minhyun Cho , Inseok Hwang

Gradient coding is a technique for straggler mitigation in distributed learning. In this paper we design novel gradient codes using tools from classical coding theory, namely, cyclic MDS codes, which compare favorably with existing…

Information Theory · Computer Science 2019-07-09 Netanel Raviv , Itzhak Tamo , Rashish Tandon , Alexandros G. Dimakis

This paper aims at jointly addressing two seemly conflicting issues in federated learning: differential privacy (DP) and Byzantine-robustness, which are particularly challenging when the distributed data are non-i.i.d. (independent and…

Machine Learning · Computer Science 2022-08-03 Heng Zhu , Qing Ling

There has been a growing need to provide Byzantine-resilience in distributed model training. Existing robust distributed learning algorithms focus on developing sophisticated robust aggregators at the parameter servers, but pay less…

Machine Learning · Computer Science 2021-10-12 Lingjiao Chen , Leshang Chen , Hongyi Wang , Susan Davidson , Edgar Dobriban

Federated learning is a newly emerging distributed learning framework that facilitates the collaborative training of a shared global model among distributed participants with their privacy preserved. However, federated learning systems are…

Distributed, Parallel, and Cluster Computing · Computer Science 2022-10-14 Minghui Li , Wei Wan , Jianrong Lu , Shengshan Hu , Junyu Shi , Leo Yu Zhang , Man Zhou , Yifeng Zheng

We consider distributed learning in the presence of slow and unresponsive worker nodes, referred to as stragglers. In order to mitigate the effect of stragglers, gradient coding redundantly assigns partial computations to the worker such…

Information Theory · Computer Science 2022-12-19 Luis Maßny , Christoph Hofmeister , Maximilian Egger , Rawad Bitar , Antonia Wachter-Zeh

From the perspective of hard decision fusion, we investigate Byzantine attacks in Reconfigurable Intelligent Surface (RIS)-enhanced and decode-and-forward relay-assisted Cooperative Spectrum Sensing (CSS) for mobile Cognitive Radio Networks…

Information Theory · Computer Science 2025-11-03 Gaoyuan Zhang , Gaolei Song , Boyuan Li , Zijian Li , Baofeng Ji , Ruijuan Zheng , Guoqiang Zheng , Tony Q. S. Quek

The success of machine learning (ML) has been intimately linked with the availability of large amounts of data, typically collected from heterogeneous sources and processed on vast networks of computing devices (also called {\em workers}).…

Machine Learning · Computer Science 2024-05-02 Sadegh Farhadkhani , Rachid Guerraoui , Nirupam Gupta , Rafael Pinot

Machine Learning (ML) solutions are nowadays distributed and are prone to various types of component failures, which can be encompassed in so-called Byzantine behavior. This paper introduces LiuBei, a Byzantine-resilient ML algorithm that…

Machine Learning · Computer Science 2020-07-21 El Mahdi El Mhamdi , Rachid Guerraoui , Arsany Guirguis

While the last few decades have witnessed a huge body of work devoted to inference and learning in distributed and decentralized setups, much of this work assumes a non-adversarial setting in which individual nodes---apart from occasional…

Machine Learning · Statistics 2020-06-03 Zhixiong Yang , Arpita Gang , Waheed U. Bajwa

Detection and mitigation of Byzantine behaviors in a decentralized learning setting is a daunting task, especially when the data distribution at the users is heterogeneous. As our main contribution, we propose Basil, a fast and…

Systems and Control · Electrical Eng. & Systems 2022-10-07 Ahmed Roushdy Elkordy , Saurav Prakash , A. Salman Avestimehr

Byzantine machine learning (ML) aims to ensure the resilience of distributed learning algorithms to misbehaving (or Byzantine) machines. Although this problem received significant attention, prior works often assume the data held by the…

Machine Learning · Computer Science 2023-02-06 Youssef Allouah , Sadegh Farhadkhani , Rachid Guerraoui , Nirupam Gupta , Rafael Pinot , John Stephan

Decentralized learning, which facilitates joint model training across geographically scattered agents, has gained significant attention in the field of signal and information processing in recent years. While the optimization errors of…

Machine Learning · Computer Science 2025-06-12 Haoxiang Ye , Tao Sun , Qing Ling

As the network scale increases, existing fully distributed solutions start to lag behind the real-world challenges such as (1) slow information propagation, (2) network communication failures, and (3) external adversarial attacks. In this…

Machine Learning · Computer Science 2023-07-28 Connor Mclaughlin , Matthew Ding , Denis Edogmus , Lili Su

Distributed learning has become a hot research topic due to its wide application in clusterbased large-scale learning, federated learning, edge computing and so on. Most traditional distributed learning methods typically assume no failure…

Machine Learning · Computer Science 2022-02-01 Yi-Rui Yang , Wu-Jun Li

We address a fundamental problem in Peer-to-Peer (P2P) networks, namely, constructing and maintaining dynamic P2P overlay network topologies with essential properties such as connectivity, low diameter, and high expansion, that are…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-08-18 Aayush Gupta , Gopal Pandurangan

We address the problem of distributed convex unconstrained optimization over networks characterized by asynchronous and possibly lossy communications. We analyze the case where the global cost function is the sum of locally coupled local…

Optimization and Control · Mathematics 2020-10-06 Marco Todescato , Nicoletta Bof , Guido Cavraro , Ruggero Carli , Luca Schenato

We introduce and solve the problem of Byzantine fault tolerant distributed quickest change detection in both continuous and discrete time setups. In this problem, multiple sensors sequentially observe random signals from the environment and…

Probability · Mathematics 2014-12-30 Erhan Bayraktar , Lifeng Lai