English
Related papers

Related papers: DETOX: A Redundancy-based Framework for Faster and…

200 papers

We analyze the impact of transient and Byzantine faults on the construction of a maximal independent set in a general network. We adapt the self-stabilizing algorithm presented by Turau `for computing such a vertex set. Our algorithm is…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-06-11 Johanne Cohen , Laurence Pilard , François Pirot , Jonas Sénizergues

In this work, we consider the resilience of distributed algorithms based on stochastic gradient descent (SGD) in distributed learning with potentially Byzantine attackers, who could send arbitrary information to the parameter server to…

Machine Learning · Computer Science 2019-09-11 Haibo Yang , Xin Zhang , Minghong Fang , Jia Liu

Traditional resilient systems operate on fully-replicated fault-tolerant clusters, which limits their scalability and performance. One way to make the step towards resilient high-performance systems that can deal with huge workloads, is by…

Databases · Computer Science 2021-08-20 Jelle Hellings , Mohammad Sadoghi

We analyze the impact of transient and Byzantine faults on the construction of a maximal independent set in a general network. We adapt the self-stabilizing algorithm presented by Turau \cite{turau2007linear} for computing such a vertex…

Distributed, Parallel, and Cluster Computing · Computer Science 2021-11-17 Johanne Cohen , Laurence Pilard , Jonas Sénizergues

Distributed AI and IoT applications increasingly execute across heterogeneous resources spanning end devices, edge/fog infrastructure, and cloud platforms, often under different administrative domains. Fluid Computing has emerged as a…

Distributed, Parallel, and Cluster Computing · Computer Science 2026-03-13 Diego Cajaraville-Aboy , Ana Fernández-Vilas , Rebeca P. Díaz-Redondo , Manuel Fernández-Veiga , Pablo Picallo-López

We develop a distributed second order optimization algorithm that is communication-efficient as well as robust against Byzantine failures of the worker machines. We propose COMRADE (COMunication-efficient and Robust Approximate Distributed…

Machine Learning · Computer Science 2021-03-19 Avishek Ghosh , Raj Kumar Maity , Arya Mazumdar

We address a fundamental problem in Peer-to-Peer (P2P) networks, namely, constructing and maintaining dynamic P2P overlay network topologies with essential properties such as connectivity, low diameter, and high expansion, that are…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-08-18 Aayush Gupta , Gopal Pandurangan

Traditional statistical methods need to be updated to work with modern distributed data storage paradigms. A common approach is the split-and-conquer framework, which involves learning models on local machines and averaging their parameter…

Methodology · Statistics 2026-04-22 Qiong Zhang , Yan Shuo Tan , Jiahua Chen

This work considers resilient, cooperative state estimation in unreliable multi-agent networks. A network of agents aims to collaboratively estimate the value of an unknown vector parameter, while an {\em unknown} subset of agents suffer…

Systems and Control · Computer Science 2018-10-25 Lili Su , Shahin Shahrampour

We consider the problem of Byzantine fault-tolerance in the peer-to-peer (P2P) distributed gradient-descent method -- a prominent algorithm for distributed optimization in a P2P system. In this problem, the system comprises of multiple…

Distributed, Parallel, and Cluster Computing · Computer Science 2021-02-01 Nirupam Gupta , Nitin H. Vaidya

Distributed learning enables scalable model training over decentralized data, but remains hindered by Byzantine faults and high communication costs. While both challenges have been studied extensively in isolation, their interplay has…

Machine Learning · Computer Science 2025-11-04 Diksha Gupta , Antonio Honsell , Chuan Xu , Nirupam Gupta , Giovanni Neglia

This report considers the problem of resilient distributed optimization and stochastic learning in a server-based architecture. The system comprises a server and multiple agents, where each agent has its own local cost function. The agents…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-12-15 Shuo Liu , Nirupam Gupta , Nitin H. Vaidya

We consider a distributed reinforcement learning setting where multiple agents separately explore the environment and communicate their experiences through a central server. However, $\alpha$-fraction of agents are adversarial and can…

Machine Learning · Computer Science 2022-06-02 Yiding Chen , Xuezhou Zhang , Kaiqing Zhang , Mengdi Wang , Xiaojin Zhu

Federated Learning (FL) enables heterogeneous clients to collaboratively train a shared model without centralizing their raw data, offering an inherent level of privacy. However, gradients and model updates can still leak sensitive…

Machine Learning · Computer Science 2026-04-07 Rustem Islamov , Grigory Malinovsky , Alexander Gaponov , Aurelien Lucchi , Peter Richtárik , Eduard Gorbunov

Byzantine consensus is a critical component in many permissioned Blockchains and distributed ledgers. We propose a new paradigm for designing BFT protocols called DQBFT that addresses three major performance and scalability challenges that…

Distributed, Parallel, and Cluster Computing · Computer Science 2022-03-01 Balaji Arun , Binoy Ravindran

Recent advances in large-scale distributed learning algorithms have enabled communication-efficient training via SignSGD. Unfortunately, a major issue continues to plague distributed learning: namely, Byzantine failures may incur serious…

Information Theory · Computer Science 2020-10-27 Jy-yong Sohn , Dong-Jun Han , Beongjun Choi , Jaekyun Moon

Partial participation is essential for communication-efficient federated learning at scale, yet existing Byzantine-robust methods typically assume full client participation. In the partial participation setting, a majority of the sampled…

Machine Learning · Computer Science 2026-01-30 Kaoru Otsuka , Yuki Takezawa , Makoto Yamada

Federated learning (FL) enables a set of geographically distributed clients to collectively train a model through a server. Classically, the training process is synchronous, but can be made asynchronous to maintain its speed in presence of…

Machine Learning · Computer Science 2024-06-21 Bart Cox , Abele Mălan , Lydia Y. Chen , Jérémie Decouchant

In the burgeoning domain of distributed quantum computing, achieving consensus amidst adversarial settings remains a pivotal challenge. We introduce an enhancement to the Quantum Byzantine Agreement (QBA) protocol, uniquely incorporating…

Quantum Physics · Physics 2023-11-07 Matthew Prest , Kuan-Cheng Chen

Federated learning is a distributed training framework vulnerable to Byzantine attacks, particularly when over 50% of clients are malicious or when datasets are highly non-independent and identically distributed (non-IID). Additionally,…

Cryptography and Security · Computer Science 2025-08-04 Haocheng Jiang , Hua Shen , Jixin Zhang , Willy Susilo , Mingwu Zhang