English
Related papers

Related papers: Toward Exact Convergence in Byzantine-Robust Decen…

200 papers

Network coding is an elegant technique where, instead of simply relaying the packets of information they receive, the nodes of a network are allowed to combine \emph{several} packets together for transmission and this technique can be used…

Networking and Internet Architecture · Computer Science 2013-03-12 Jen-Yeu Chen , Yi-ying Tseng

This paper addresses the problem of combining Byzantine resilience with privacy in machine learning (ML). Specifically, we study if a distributed implementation of the renowned Stochastic Gradient Descent (SGD) learning algorithm is…

Machine Learning · Computer Science 2021-06-25 Rachid Guerraoui , Nirupam Gupta , Rafaël Pinot , Sébastien Rouault , John Stephan

In this paper, we establish tight lower bounds for Byzantine-robust distributed first-order stochastic optimization methods in both strongly convex and non-convex stochastic optimization. We reveal that when the distributed nodes have…

Optimization and Control · Mathematics 2025-03-21 Qiankun Shi , Jie Peng , Kun Yuan , Xiao Wang , Qing Ling

Federated Learning (FL) emerged as a widely studied paradigm for distributed learning. Despite its many advantages, FL remains vulnerable to adversarial attacks, especially under data heterogeneity. We propose a new Byzantine-robust FL…

Machine Learning · Computer Science 2025-09-12 Sena Ergisi , Luis Maßny , Rawad Bitar

Distributed Federated Learning (DFL) enables decentralized model training across large-scale systems without a central parameter server. However, DFL faces three critical challenges: privacy leakage from honest-but-curious neighbors, slow…

Machine Learning · Computer Science 2026-02-24 Nuocheng Yang , Sihua Wang , Zhaohui Yang , Mingzhe Chen , Changchuan Yin , Kaibin Huang

Network coding increases throughput and is robust against failures and erasures. However, since it allows mixing of information within the network, a single corrupted packet generated by a Byzantine attacker can easily contaminate the…

Information Theory · Computer Science 2009-03-27 MinJi Kim , Muriel Medard , Joao Barros

In this paper, we consider the problem of distributed Bayesian detection in the presence of Byzantines in the network. It is assumed that a fraction of the nodes in the network are compromised and reprogrammed by an adversary to transmit…

Information Theory · Computer Science 2018-07-17 Bhavya Kailkhura , Yunghsiang S. Han , Swastik Brahma , Pramod K. Varshney

This paper considers a distributed optimization problem in the presence of Byzantine agents capable of introducing untrustworthy information into the communication network. A resilient distributed subgradient algorithm is proposed based on…

Optimization and Control · Mathematics 2023-03-22 Jingxuan Zhu , Yixuan Lin , Alvaro Velasquez , Ji Liu

We study the convergence problem in fully asynchronous, uni-dimensional robot networks that are prone to Byzantine (i.e. malicious) failures. In these settings, oblivious anonymous robots with arbitrary initial positions are required to…

Distributed, Parallel, and Cluster Computing · Computer Science 2009-08-05 Zohir Bouzid , Maria Potop-Butucaru , Sébastien Tixeuil

Federated Learning (FL) aims to train a collaborative model while preserving data privacy. However, the distributed nature of this approach still raises privacy and security issues, such as the exposure of sensitive data due to inference…

Machine Learning · Computer Science 2026-02-09 Adda Akram Bendoukha , Aymen Boudguiga , Nesrine Kaaniche , Renaud Sirdey , Didem Demirag , Sébastien Gambs

We propose a novel robust aggregation rule for distributed synchronous Stochastic Gradient Descent~(SGD) under a general Byzantine failure model. The attackers can arbitrarily manipulate the data transferred between the servers and the…

Distributed, Parallel, and Cluster Computing · Computer Science 2018-05-25 Cong Xie , Oluwasanmi Koyejo , Indranil Gupta

Network traffic prediction plays a crucial role in intelligent network operation. Traditional prediction methods often rely on centralized training, necessitating the transfer of vast amounts of traffic data to a central server. This…

Machine Learning · Computer Science 2025-05-27 Hui Ma , Kai Yang , Yang Jiao

This paper proposes a Byzantine-resilient consensus framework that simultaneously pursues two tightly coupled objectives: actively identifying Byzantine agents and guaranteeing resilient consensus among normal agents. Unlike existing…

Optimization and Control · Mathematics 2026-05-13 Rui Huang , Changxin Liu , Wen-Hua Chen , Yang Shi

Consensus algorithms provide strategies to solve problems in a distributed system with the added constraint that data can only be shared between adjacent computing nodes. We find these algorithms in applications for wireless and sensor…

Cryptography and Security · Computer Science 2016-11-15 Michel Toulouse , Hai Le , Cao Vien Phung , Denis Hock

In distributed learning, sign-based compression algorithms such as signSGD with majority vote provide a lightweight alternative to SGD with an additional advantage: fault tolerance (almost) for free. However, for signSGD with majority vote,…

Machine Learning · Computer Science 2025-03-12 Emanuele Mengoli , Luzius Moll , Virgilio Strozzi , El-Mahdi El-Mhamdi

The problem of distributed optimization requires a group of agents to reach agreement on a parameter that minimizes the average of their local cost functions using information received from their neighbors. While there are a variety of…

Optimization and Control · Mathematics 2024-03-05 Kananart Kuwaranancharoen , Lei Xin , Shreyas Sundaram

In this paper, we propose a zeroth-order resilient distributed online algorithm for networks under Byzantine edge attacks. We assume that both the edges attacked by Byzantine adversaries and the objective function are time-varying.…

Optimization and Control · Mathematics 2025-11-10 Yuhang Liu , Wenjun Mei

Consider a linear time-invariant (LTI) dynamical system monitored by a network of sensors, modeled as nodes of an underlying directed communication graph. We study the problem of collaboratively estimating the state of the system when…

Systems and Control · Computer Science 2018-10-09 Aritra Mitra , Shreyas Sundaram

\textit{Federated learning} (FL) is a nascent distributed learning paradigm to train a shared global model without violating users' privacy. FL has been shown to be vulnerable to various Byzantine attacks, where malicious participants could…

Cryptography and Security · Computer Science 2023-08-08 Wei Wan , Shengshan Hu , Minghui Li , Jianrong Lu , Longling Zhang , Leo Yu Zhang , Hai Jin

This paper studies distributed diffusion adaptation over clustered multi-task networks in the presence of impulsive interferences and Byzantine attacks. We develop a robust resilient diffusion least mean Geman-McClure-estimation (RDLMG)…

Machine Learning · Computer Science 2022-06-28 Tao Yu , Rodrigo C. de Lamare , Yi Yu