English
Related papers

Related papers: Byzantine-Robust Decentralized Stochastic Optimiza…

200 papers

This paper explores an old problem, {\em Byzantine fault-tolerant Broadcast} (BB), under a new model, {\em selective broadcast model}. The new model "interpolates" between the two traditional models in the literature. In particular, it…

Distributed, Parallel, and Cluster Computing · Computer Science 2015-02-03 Lewis Tseng , Nitin Vaidya

As the network scale increases, existing fully distributed solutions start to lag behind the real-world challenges such as (1) slow information propagation, (2) network communication failures, and (3) external adversarial attacks. In this…

Machine Learning · Computer Science 2023-07-28 Connor Mclaughlin , Matthew Ding , Denis Edogmus , Lili Su

The distributed source coding problem is considered when the sensors, or encoders, are under Byzantine attack; that is, an unknown number of sensors have been reprogrammed by a malicious intruder to undermine the reconstruction at the…

Information Theory · Computer Science 2007-07-13 Oliver Kosut , Lang Tong

We study distributed optimization over networks with Byzantine agents that may send arbitrary adversarial messages. We propose \emph{Gradient Tracking with Probabilistic Edge Dropout} (GT-PD), a stochastic gradient tracking method that…

Machine Learning · Computer Science 2026-04-07 Amirhossein Dezhboro , Fateme Maleki , Arman Adibi , Erfan Amini , Jose E. Ramirez-Marquez

We propose Byzantine-robust federated learning protocols with nearly optimal statistical rates. In contrast to prior work, our proposed protocols improve the dimension dependence and achieve a tight statistical rate in terms of all the…

Machine Learning · Computer Science 2023-03-21 Banghua Zhu , Lun Wang , Qi Pang , Shuai Wang , Jiantao Jiao , Dawn Song , Michael I. Jordan

In this letter, we consider the problem of distributed Bayesian detection in the presence of data falsifying Byzantines in the network. The problem of distributed detection is formulated as a binary hypothesis test at the fusion center (FC)…

Applications · Statistics 2015-06-22 Bhavya Kailkhura , Yunghsiang S. Han , Swastik Brahma , Pramod K. Varshney

Federated Learning (FL) enables clients to collaboratively train a global model without sharing their private data. However, the presence of malicious (Byzantine) clients poses significant challenges to the robustness of FL, particularly…

Machine Learning · Computer Science 2026-05-26 Javad Parsa , Amir Hossein Daghestani , André M. H. Teixeira , Mikael Johansson

We address the challenges of Byzantine-robust training in asynchronous distributed machine learning systems, aiming to enhance efficiency amid massive parallelization and heterogeneous computing resources. Asynchronous systems, marked by…

Machine Learning · Computer Science 2025-06-05 Tehila Dahan , Kfir Y. Levy

Byzantine robustness is an essential feature of algorithms for certain distributed optimization problems, typically encountered in collaborative/federated learning. These problems are usually huge-scale, implying that communication…

Optimization and Control · Mathematics 2024-03-12 Ahmad Rammal , Kaja Gruntkowska , Nikita Fedin , Eduard Gorbunov , Peter Richtárik

The ``Pulse Synchronization'' problem can be loosely described as targeting to invoke a recurring distributed event as simultaneously as possible at the different nodes and with a frequency that is as regular as possible. This target…

Distributed, Parallel, and Cluster Computing · Computer Science 2007-05-23 Ariel Daliot , Danny Dolev

In this paper, we consider a resilient consensus problem for the multi-agent network where some of the agents are subject to Byzantine attacks and may transmit erroneous state values to their neighbors. In particular, we develop an…

Multiagent Systems · Computer Science 2023-06-07 Liwei Yuan , Hideaki Ishii

We consider the following problem: two nodes want to reliably communicate in a dynamic multihop network where some nodes have been compromised, and may have a totally arbitrary and unpredictable behavior. These nodes are called Byzantine.…

Distributed, Parallel, and Cluster Computing · Computer Science 2015-02-17 Alexandre Maurer , Sébastien Tixeuil , Xavier Défago

We propose two novel stochastic gradient descent algorithms, ByGARS and ByGARS++, for distributed machine learning in the presence of any number of Byzantine adversaries. In these algorithms, reputation scores of workers are computed using…

Machine Learning · Computer Science 2020-12-09 Jayanth Regatti , Hao Chen , Abhishek Gupta

We consider the problem of reliably broadcasting information in a multihop asynchronous network in the presence of Byzantine failures: some nodes may exhibit unpredictable malicious behavior. We focus on completely decentralized solutions.…

Data Structures and Algorithms · Computer Science 2013-12-10 Alexandre Maurer , Sébastien Tixeuil

Adversarial attacks pose a major challenge to distributed learning systems, prompting the development of numerous robust learning methods. However, most existing approaches suffer from the curse of dimensionality, i.e. the error increases…

Machine Learning · Computer Science 2025-11-19 Wenyu Liu , Tianqiang Huang , Pengfei Zhang , Zong Ke , Minghui Min , Puning Zhao

Byzantine-robust learning has emerged as a prominent fault-tolerant distributed machine learning framework. However, most techniques focus on the static setting, wherein the identity of Byzantine workers remains unchanged throughout the…

Machine Learning · Computer Science 2024-06-18 Ron Dorfman , Naseem Yehya , Kfir Y. Levy

In this paper, we study the problem of distributed multi-agent optimization over a network, where each agent possesses a local cost function that is smooth and strongly convex. The global objective is to find a common solution that…

Optimization and Control · Mathematics 2019-08-02 Shi Pu , Angelia Nedić

This paper considers a distributed optimization problem in a multi-agent system where a fraction of the agents act in an adversarial manner. Specifically, the malicious agents steer the network of agents away from the optimal solution by…

Optimization and Control · Mathematics 2022-06-07 Iyanuoluwa Emiola , Chinwendu Enyioha

We consider the problem of reliably broadcasting information in a multihop asynchronous network that is subject to Byzantine failures. Most existing approaches give conditions for perfect reliable broadcast (all correct nodes deliver the…

Distributed, Parallel, and Cluster Computing · Computer Science 2012-11-15 Alexandre Maurer , Sébastien Tixeuil

Network coding achieves optimal throughput in multicast networks. However, throughput optimality \emph{relies} on the network nodes or routers to code \emph{correctly}. A Byzantine node may introduce junk packets in the network (thus…

Networking and Internet Architecture · Computer Science 2011-08-11 Raluca Ada Popa , Alessandro Chiesa , Tural Badirkhanli , Muriel Médard