English
Related papers

Related papers: Byzantine-Robust Decentralized Stochastic Optimiza…

200 papers

To improve the overall efficiency and reliability of Byzantine protocols in large sparse networks, we propose a new system assumption for developing multi-scale fault-tolerant systems, with which several kinds of multi-scale Byzantine…

Distributed, Parallel, and Cluster Computing · Computer Science 2022-03-08 Shaolin Yu , Jihong Zhu , Jiali Yang , Yulong Zhan

In a recent paper, Jaggi et al. (INFOCOM 2007), presented a distributed polynomial-time rate-optimal network-coding scheme that works in the presence of Byzantine faults. We revisit their adversarial models and augment them with three,…

Information Theory · Computer Science 2008-02-06 Leah Nutman , Michael Langberg

Optimum decision fusion in the presence of malicious nodes - often referred to as Byzantines - is hindered by the necessity of exactly knowing the statistical behavior of Byzantines. By focusing on a simple, yet widely studied, set-up in…

Systems and Control · Computer Science 2015-07-03 Andrea Abrardo , Mauro Barni , Kassem Kallas , Benedetta Tondi

Numerous distributed tasks have to be handled in a setting where a fraction of nodes behaves Byzantine, that is, deviates arbitrarily from the intended protocol. Resilient, deterministic protocols rely on the detection of majorities to…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-02-10 Philipp Schneider

In this paper, we show synchronization for a group of output passive agents that communicate with each other according to an underlying communication graph to achieve a common goal. We propose a distributed event-triggered control framework…

Systems and Control · Computer Science 2017-10-02 Arash Rahnama , Panos J. Antsaklis

We consider the problem of Byzantine fault-tolerance in federated machine learning. In this problem, the system comprises multiple agents each with local data, and a trusted centralized coordinator. In fault-free setting, the agents…

Distributed, Parallel, and Cluster Computing · Computer Science 2021-08-27 Nirupam Gupta , Thinh T. Doan , Nitin Vaidya

Communication between workers and the master node to collect local stochastic gradients is a key bottleneck in a large-scale federated learning system. Various recent works have proposed to compress the local stochastic gradients to…

Machine Learning · Computer Science 2024-02-06 Heng Zhu , Qing Ling

To defend against Byzantine attacks in decentralized learning, most existing methods rely on robust aggregation rules to mitigate the influence of malicious machines. However, these strategies inherently introduce bias, leading to inexact…

Methodology · Statistics 2026-04-20 Siyuan Zhang , Chengde Qian , Xin Liu , Changliang Zou

We study Byzantine fault-tolerant distributed optimization of a sum of convex (cost) functions with real-valued scalar input/ouput. In particular, the goal is to optimize a global cost function $\frac{1}{|\mathcal{N}|}\sum_{i\in…

Distributed, Parallel, and Cluster Computing · Computer Science 2015-08-03 Lili Su , Nitin Vaidya

Byzantine reliable broadcast is a fundamental problem in distributed computing, which has been studied extensively over the past decades. State-of-the-art algorithms are predominantly based on the approach to share encoded fragments of the…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-01-06 Thomas Locher

In distributed learning systems, robustness issues may arise from two sources. On one hand, due to distributional shifts between training data and test data, the trained model could exhibit poor out-of-sample performance. On the other hand,…

Machine Learning · Computer Science 2022-11-01 Guanqiang Zhou , Ping Xu , Yue Wang , Zhi Tian

We consider a distributed reinforcement learning setting where multiple agents separately explore the environment and communicate their experiences through a central server. However, $\alpha$-fraction of agents are adversarial and can…

Machine Learning · Computer Science 2022-06-02 Yiding Chen , Xuezhou Zhang , Kaiqing Zhang , Mengdi Wang , Xiaojin Zhu

This paper considers the Byzantine fault-tolerance problem in distributed stochastic gradient descent (D-SGD) method - a popular algorithm for distributed multi-agent machine learning. In this problem, each agent samples data points…

Machine Learning · Computer Science 2021-04-20 Nirupam Gupta , Shuo Liu , Nitin H. Vaidya

Distributed learning has many computational benefits but is vulnerable to attacks from a subset of devices transmitting incorrect information. This paper investigates Byzantine-resilient algorithms in a decentralized setting, where devices…

Machine Learning · Computer Science 2025-07-04 Renaud Gaucher , Aymeric Dieuleveut , Hadrien Hendrikx

We study the problem of constrained distributed optimization in multi-agent networks when some of the computing agents may be faulty. In this problem, the system goal is to have all the non-faulty agents collectively minimize a global…

Distributed, Parallel, and Cluster Computing · Computer Science 2015-11-06 Lili Su , Nitin H. Vaidya

We analyze the impact of transient and Byzantine faults on the construction of a maximal independent set in a general network. We adapt the self-stabilizing algorithm presented by Turau `for computing such a vertex set. Our algorithm is…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-06-11 Johanne Cohen , Laurence Pilard , François Pirot , Jonas Sénizergues

Modern networks assemble an ever growing number of nodes. However, it remains difficult to increase the number of channels per node, thus the maximal degree of the network may be bounded. This is typically the case in grid topology…

Distributed, Parallel, and Cluster Computing · Computer Science 2012-10-18 Alexandre Maurer , Sébastien Tixeuil

We study the task of Byzantine gathering in a network modeled as a graph. Despite the presence of Byzantine agents, all the other (good) agents, starting from possibly different nodes and applying the same deterministic algorithm, have to…

Data Structures and Algorithms · Computer Science 2018-01-24 Sébastien Bouchard , Yoann Dieudonné , Anissa Lamani

Distributed algorithms provide flexibility over centralized algorithms for resource allocation problems, e.g., cyber-physical systems. However, the distributed nature of these algorithms often makes the systems susceptible to…

Optimization and Control · Mathematics 2019-09-11 Cesar A. Uribe , Hoi-To Wai , Mahnoosh Alizadeh

Distributed Learning often suffers from Byzantine failures, and there have been a number of works studying the problem of distributed stochastic optimization under Byzantine failures, where only a portion of workers, instead of all the…

Distributed, Parallel, and Cluster Computing · Computer Science 2021-08-17 Kaiyun Li , Xiaojun Chen , Ye Dong , Peng Zhang , Dakui Wang , Shuai Zen