English
Related papers

Related papers: Byzantine-Resilient Learning Beyond Gradients: Dis…

200 papers

Byzantine State Machine Replication (SMR) is a long studied topic that received increasing attention recently with the advent of blockchains as companies are trying to scale them to hundreds of nodes. Byzantine SMRs try to increase…

Cryptography and Security · Computer Science 2020-06-15 Gauthier Voron , Vincent Gramoli

This work considers resilient, cooperative state estimation in unreliable multi-agent networks. A network of agents aims to collaboratively estimate the value of an unknown vector parameter, while an {\em unknown} subset of agents suffer…

Systems and Control · Computer Science 2018-10-25 Lili Su , Shahin Shahrampour

Decentralized machine learning (DL) has been receiving an increasing interest recently due to the elimination of a single point of failure, present in Federated learning setting. Yet, it is threatened by the looming threat of Byzantine…

Cryptography and Security · Computer Science 2024-04-30 Ali Reza Ghavamipour , Benjamin Zi Hao Zhao , Oguzhan Ersoy , Fatih Turkmen

We study local stochastic gradient descent methods for solving federated optimization over a network of agents communicating indirectly through a centralized coordinator. We are interested in the Byzantine setting where there is a subset of…

Optimization and Control · Mathematics 2024-09-06 Amit Dutta , Thinh T. Doan

Federated learning enables training collaborative machine learning models at scale with many participants whilst preserving the privacy of their datasets. Standard federated learning techniques are vulnerable to Byzantine failures, biased…

Machine Learning · Statistics 2019-09-12 Luis Muñoz-González , Kenneth T. Co , Emil C. Lupu

This paper proposes a Byzantine-resilient consensus-based distributed filter (BR-CDF) wherein network agents employ partial sharing of state parameters. We characterize the performance and convergence of the BR-CDF and study the impact of a…

Signal Processing · Electrical Eng. & Systems 2023-07-27 Ashkan Moradi , Vinay Chakravarthi Gogineni , Naveen K. D. Venkategowda , Stefan Werner

We study distributed optimization in the presence of Byzantine adversaries, where both data and computation are distributed among $m$ worker machines, $t$ of which may be corrupt. The compromised nodes may collaboratively and arbitrarily…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-11-05 Deepesh Data , Linqi Song , Suhas Diggavi

This paper considers the problem of Byzantine fault-tolerance in distributed multi-agent optimization. In this problem, each agent has a local cost function, and in the fault-free case, the goal is to design a distributed algorithm that…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-05-22 Shuo Liu , Nirupam Gupta , Nitin H. Vaidya

Distributed Federated Learning (DFL) enables decentralized model training across large-scale systems without a central parameter server. However, DFL faces three critical challenges: privacy leakage from honest-but-curious neighbors, slow…

Machine Learning · Computer Science 2026-02-24 Nuocheng Yang , Sihua Wang , Zhaohui Yang , Mingzhe Chen , Changchuan Yin , Kaibin Huang

We propose three new robust aggregation rules for distributed synchronous Stochastic Gradient Descent~(SGD) under a general Byzantine failure model. The attackers can arbitrarily manipulate the data transferred between the servers and the…

Distributed, Parallel, and Cluster Computing · Computer Science 2018-03-28 Cong Xie , Oluwasanmi Koyejo , Indranil Gupta

Decentralized federated learning (DFL) enables collaborative model training without centralized trust, but it remains vulnerable to Byzantine clients that poison gradients under heterogeneous (Non-IID) data. Existing defenses face a…

Machine Learning · Computer Science 2025-12-16 Animesh Mishra

Numerous distributed tasks have to be handled in a setting where a fraction of nodes behaves Byzantine, that is, deviates arbitrarily from the intended protocol. Resilient, deterministic protocols rely on the detection of majorities to…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-02-10 Philipp Schneider

This paper deals with distributed finite-sum optimization for learning over networks in the presence of malicious Byzantine attacks. To cope with such attacks, most resilient approaches so far combine stochastic gradient descent (SGD) with…

Machine Learning · Computer Science 2023-07-19 Zhaoxian Wu , Qing Ling , Tianyi Chen , Georgios B. Giannakis

Consensus algorithms provide strategies to solve problems in a distributed system with the added constraint that data can only be shared between adjacent computing nodes. We find these algorithms in applications for wireless and sensor…

Cryptography and Security · Computer Science 2016-11-15 Michel Toulouse , Hai Le , Cao Vien Phung , Denis Hock

Federated learning (FL) is a popular distributed learning paradigm in machine learning, which enables multiple clients to collaboratively train models under the guidance of a server without exposing private client data. However, FL's…

Machine Learning · Computer Science 2026-05-01 Zehui Tang , Yuchen Liu , Feihu Huang

We present Garfield, a library to transparently make machine learning (ML) applications, initially built with popular (but fragile) frameworks, e.g., TensorFlow and PyTorch, Byzantine-resilient. Garfield relies on a novel object-oriented…

Machine Learning · Computer Science 2021-01-01 Rachid Guerraoui , Arsany Guirguis , Jérémy Max Plassmann , Anton Alexandre Ragot , Sébastien Rouault

We introduce the paradigm of validated decentralized learning for undirected networks with heterogeneous data and possible adversarial infiltration. We require (a) convergence to a global empirical loss minimizer when adversaries are…

Machine Learning · Computer Science 2024-05-14 Mayank Bakshi , Sara Ghasvarianjahromi , Yauhen Yakimenka , Allison Beemer , Oliver Kosut , Joerg Kliewer

We study a multi-agent resilient consensus problem, where some agents are of the Byzantine type and try to prevent the normal ones from reaching consensus. In our setting, normal agents communicate with each other asynchronously over…

Multiagent Systems · Computer Science 2024-03-13 Liwei Yuan , Hideaki Ishii

Decentralized Learning (DL) is a peer--to--peer learning approach that allows a group of users to jointly train a machine learning model. To ensure correctness, DL should be robust, i.e., Byzantine users must not be able to tamper with the…

Machine Learning · Computer Science 2023-03-08 Mathilde Raynal , Dario Pasquini , Carmela Troncoso

Network traffic prediction plays a crucial role in intelligent network operation. Traditional prediction methods often rely on centralized training, necessitating the transfer of vast amounts of traffic data to a central server. This…

Machine Learning · Computer Science 2025-05-27 Hui Ma , Kai Yang , Yang Jiao