English
Related papers

Related papers: Byzantine-Resilient Decentralized Stochastic Optim…

200 papers

Federated learning enables training collaborative machine learning models at scale with many participants whilst preserving the privacy of their datasets. Standard federated learning techniques are vulnerable to Byzantine failures, biased…

Machine Learning · Statistics 2019-09-12 Luis Muñoz-González , Kenneth T. Co , Emil C. Lupu

Byzantine robustness is an essential feature of algorithms for certain distributed optimization problems, typically encountered in collaborative/federated learning. These problems are usually huge-scale, implying that communication…

Optimization and Control · Mathematics 2024-03-12 Ahmad Rammal , Kaja Gruntkowska , Nikita Fedin , Eduard Gorbunov , Peter Richtárik

We investigate the impact of Byzantine attacks in distributed detection under binary hypothesis testing. It is assumed that a fraction of the transmitted sensor measurements are compromised by the injected data from a Byzantine attacker,…

Information Theory · Computer Science 2019-05-27 Yuqing Ni , Kemi Ding , Yong Yang , Ling Shi

We develop a communication-efficient distributed learning algorithm that is robust against Byzantine worker machines. We propose and analyze a distributed gradient-descent algorithm that performs a simple thresholding based on gradient…

Machine Learning · Computer Science 2021-08-17 Avishek Ghosh , Raj Kumar Maity , Swanand Kadhe , Arya Mazumdar , Kannan Ramchandran

This paper introduces a deep learning-based framework for resilient decision fusion in adversarial multi-sensor networks, providing a unified mathematical setup that encompasses diverse scenarios, including varying Byzantine node…

Machine Learning · Computer Science 2024-12-18 Kassem Kallas

This work considers resilient, cooperative state estimation in unreliable multi-agent networks. A network of agents aims to collaboratively estimate the value of an unknown vector parameter, while an {\em unknown} subset of agents suffer…

Systems and Control · Computer Science 2018-10-25 Lili Su , Shahin Shahrampour

In this paper, we propose an iterative scheme for distributed Byzantineresilient estimation of a gradient associated with a black-box model. Our algorithm is based on simultaneous perturbation, secure state estimation and two-timescale…

Artificial Intelligence · Computer Science 2022-10-03 Alexandre Reiffers-Masson , Isabel Amigo

The rapid development of artificial intelligence systems has amplified societal concerns regarding their usage, necessitating regulatory frameworks that encompass data privacy. Federated Learning (FL) is posed as potential solution to data…

Machine Learning · Computer Science 2025-03-28 Mario García-Márquez , Nuria Rodríguez-Barroso , M. Victoria Luzón , Francisco Herrera

Privacy and Byzantine resilience (BR) are two crucial requirements of modern-day distributed machine learning. The two concepts have been extensively studied individually but the question of how to combine them effectively remains…

Machine Learning · Computer Science 2023-10-06 Rachid Guerraoui , Nirupam Gupta , Rafael Pinot , Sebastien Rouault , John Stephan

Traditional statistical methods need to be updated to work with modern distributed data storage paradigms. A common approach is the split-and-conquer framework, which involves learning models on local machines and averaging their parameter…

Methodology · Statistics 2026-04-22 Qiong Zhang , Yan Shuo Tan , Jiahua Chen

Byzantine Fault Tolerance (BFT) is one of the most challenging problems in Distributed Machine Learning (DML), defined as the resilience of a fault-tolerant system in the presence of malicious components. Byzantine failures are still…

Distributed, Parallel, and Cluster Computing · Computer Science 2022-12-06 Djamila Bouhata , Hamouma Moumen , Jocelyn Ahmed Mazari , Ahcène Bounceur

Consensus algorithms provide strategies to solve problems in a distributed system with the added constraint that data can only be shared between adjacent computing nodes. We find these algorithms in applications for wireless and sensor…

Cryptography and Security · Computer Science 2016-11-15 Michel Toulouse , Hai Le , Cao Vien Phung , Denis Hock

Iterative Approximate Byzantine Consensus (IABC) is a fundamental problem of fault-tolerant distributed computing where machines seek to achieve approximate consensus to arbitrary exactness in the presence of Byzantine failures. We present…

Distributed, Parallel, and Cluster Computing · Computer Science 2022-05-06 Matthew Ding

We address a fundamental problem in Peer-to-Peer (P2P) networks, namely, constructing and maintaining dynamic P2P overlay network topologies with essential properties such as connectivity, low diameter, and high expansion, that are…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-08-18 Aayush Gupta , Gopal Pandurangan

Blockchain technology offers a decentralized and secure method for storing and authenticating data, rendering it well-suited for various applications such as digital currencies, supply chain management, and voting systems. However, the…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-04-25 Mohammad R. Shakournia , Pooya Jamshidi , Hamid Reza Faragardi , Nasser Yazdani

In this paper, we present a Byzantine fault tolerant distributed commit protocol for transactions running over untrusted networks. The traditional two-phase commit protocol is enhanced by replicating the coordinator and by running a…

Distributed, Parallel, and Cluster Computing · Computer Science 2016-11-17 Wenbing Zhao

Byzantine resilience emerged as a prominent topic within the distributed machine learning community. Essentially, the goal is to enhance distributed optimization algorithms, such as distributed SGD, in a way that guarantees convergence…

Machine Learning · Computer Science 2022-05-25 Sadegh Farhadkhani , Rachid Guerraoui , Nirupam Gupta , Rafael Pinot , John Stephan

This report considers the problem of Byzantine fault-tolerance in multi-agent collaborative optimization. In this problem, each agent has a local cost function. The goal of a collaborative optimization algorithm is to compute a minimum of…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-04-01 Nirupam Gupta , Nitin H. Vaidya

We study Byzantine-resilient distributed multi-agent reinforcement learning (MARL), where agents must collaboratively learn optimal value functions over a compromised communication network. Existing resilient MARL approaches typically…

Multiagent Systems · Computer Science 2026-04-06 Haejoon Lee , Dimitra Panagou

Recent years have witnessed a slew of coding techniques custom designed for networked storage systems. Network coding inspired regenerating codes are the most prolifically studied among these new age storage centric codes. A lot of effort…

Distributed, Parallel, and Cluster Computing · Computer Science 2011-06-14 Frédérique Oggier , Anwitaman Datta