English
Related papers

Related papers: Byzantine-Resilient Zero-Order Optimization for Co…

200 papers

This paper investigates leaderless binary majority consensus protocols with low computational complexity in noisy Byzantine infrastructures. Using computer simulations, we show that explicit randomization of the consensus protocol can…

Distributed, Parallel, and Cluster Computing · Computer Science 2019-11-21 Angelo Capossele , Sebastian Mueller , Andreas Penzkofer

We study local stochastic gradient descent methods for solving federated optimization over a network of agents communicating indirectly through a centralized coordinator. We are interested in the Byzantine setting where there is a subset of…

Optimization and Control · Mathematics 2024-09-06 Amit Dutta , Thinh T. Doan

Federated Learning (FL) enables multiple clients to collaboratively train models without sharing raw data, but it is highly vulnerable to Byzantine attacks. Existing robust approaches can neutralize these threats but incur substantial…

Machine Learning · Computer Science 2026-05-28 Shiyuan Zuo , Jiashuo Li , Rongfei Fan , Han Hu , Jie Xu

In this paper, we investigate the challenging framework of Byzantine-robust training in distributed machine learning (ML) systems, focusing on enhancing both efficiency and practicality. As distributed ML systems become integral for complex…

Machine Learning · Computer Science 2024-09-04 Tehila Dahan , Kfir Y. Levy

How to achieve precise distributed optimization despite unknown attacks, especially the Byzantine attacks, is one of the critical challenges for multiagent systems. This paper addresses a distributed resilient optimization for linear…

Systems and Control · Electrical Eng. & Systems 2024-10-18 Chenhang Yan , Liping Yan , Yuezu Lv , Bolei Dong , Yuanqing Xia

This paper studies Byzantine-robust stochastic optimization over a decentralized network, where every agent periodically communicates with its neighbors to exchange local models, and then updates its own local model by stochastic gradient…

Machine Learning · Computer Science 2023-08-11 Jie Peng , Weiyu Li , Qing Ling

Traditional resilient systems operate on fully-replicated fault-tolerant clusters, which limits their scalability and performance. One way to make the step towards resilient high-performance systems that can deal with huge workloads, is by…

Databases · Computer Science 2021-08-20 Jelle Hellings , Mohammad Sadoghi

Recently emerged federated learning (FL) is an attractive distributed learning framework in which numerous wireless end-user devices can train a global model with the data remained autochthonous. Compared with the traditional machine…

Cryptography and Security · Computer Science 2022-10-10 Junyu Shi , Wei Wan , Shengshan Hu , Jianrong Lu , Leo Yu Zhang

Distributed multi-task learning provides significant advantages in multi-agent networks with heterogeneous data sources where agents aim to learn distinct but correlated models simultaneously.However, distributed algorithms for learning…

Machine Learning · Computer Science 2021-01-11 Jiani Li , Waseem Abbas , Xenofon Koutsoukos

In this paper, we investigate the problem of decentralized online resource allocation in the presence of Byzantine attacks. In this problem setting, some agents may be compromised due to external manipulations or internal failures, causing…

Optimization and Control · Mathematics 2026-05-27 Runhua Wang , Qing Ling , Hoi-To Wai , Zhi Tian

Increasingly machine learning systems are being deployed to edge servers and devices (e.g. mobile phones) and trained in a collaborative manner. Such distributed/federated/decentralized training raises a number of concerns about the…

Machine Learning · Computer Science 2020-10-20 Lie He , Sai Praneeth Karimireddy , Martin Jaggi

In this paper, a fully distributed averaging algorithm in the presence of adversarial Byzantine agents is proposed. The algorithm is based on a resilient retrieval procedure, where all non-Byzantine nodes send their own initial values and…

Multiagent Systems · Computer Science 2021-07-28 Mostafa Safi , Seyed Mehran Dibaji

Detection and mitigation of Byzantine behaviors in a decentralized learning setting is a daunting task, especially when the data distribution at the users is heterogeneous. As our main contribution, we propose Basil, a fast and…

Systems and Control · Electrical Eng. & Systems 2022-10-07 Ahmed Roushdy Elkordy , Saurav Prakash , A. Salman Avestimehr

Byzantine machine learning has garnered considerable attention in light of the unpredictable faults that can occur in large-scale distributed learning systems. The key to secure resilience against Byzantine machines in distributed learning…

Machine Learning · Computer Science 2024-04-02 Yuhao Yi , Ronghui You , Hong Liu , Changxin Liu , Yuan Wang , Jiancheng Lv

Partial participation is essential for communication-efficient federated learning at scale, yet existing Byzantine-robust methods typically assume full client participation. In the partial participation setting, a majority of the sampled…

Machine Learning · Computer Science 2026-01-30 Kaoru Otsuka , Yuki Takezawa , Makoto Yamada

Given a set of robots with arbitrary initial location and no agreement on a global coordinate system, convergence requires that all robots asymptotically approach the exact same, but unknown beforehand, location. Robots are oblivious-- they…

Distributed, Parallel, and Cluster Computing · Computer Science 2009-05-26 Zohir Bouzid , Maria Potop-Butucaru , Sébastien Tixeuil

This paper proposes a Byzantine-resilient consensus framework that simultaneously pursues two tightly coupled objectives: actively identifying Byzantine agents and guaranteeing resilient consensus among normal agents. Unlike existing…

Optimization and Control · Mathematics 2026-05-13 Rui Huang , Changxin Liu , Wen-Hua Chen , Yang Shi

In this paper, we investigate the problem of distributed learning (DL) in the presence of Byzantine attacks. For this problem, various robust bounded aggregation (RBA) rules have been proposed at the central server to mitigate the impact of…

Machine Learning · Computer Science 2026-03-18 Chengxi Li , Ming Xiao , Mikael Skoglund

We consider a distributed reinforcement learning setting where multiple agents separately explore the environment and communicate their experiences through a central server. However, $\alpha$-fraction of agents are adversarial and can…

Machine Learning · Computer Science 2022-06-02 Yiding Chen , Xuezhou Zhang , Kaiqing Zhang , Mengdi Wang , Xiaojin Zhu

Random linear network coding can be used in peer-to-peer networks to increase the efficiency of content distribution and distributed storage. However, these systems are particularly susceptible to Byzantine attacks. We quantify the impact…

Networking and Internet Architecture · Computer Science 2016-11-17 MinJi Kim , Luísa Lima , Fang Zhao , Joao Barros , Muriel Medard , Ralf Koetter , Ton Kalker , Keesook Han