English
Related papers

Related papers: A Practical and Secure Byzantine Robust Aggregator

200 papers

Randomisation is a critical tool in designing distributed systems. The common coin primitive, enabling the system members to agree on an unpredictable random number, has proven to be particularly useful. We observe, however, that it is…

Distributed, Parallel, and Cluster Computing · Computer Science 2022-05-25 Luciano Freitas , Petr Kuznetsov , Andrei Tonkikh

In this paper, we propose ByzSecAgg, an efficient secure aggregation scheme for federated learning that is resistant to Byzantine attacks and privacy leakages. Processing individual updates to manage adversarial behavior, while preserving…

Cryptography and Security · Computer Science 2025-06-09 Tayyebeh Jahani-Nezhad , Mohammad Ali Maddah-Ali , Giuseppe Caire

We explore why many recently proposed robust estimation problems are efficiently solvable, even though the underlying optimization problems are non-convex. We study the loss landscape of these robust estimation problems, and identify the…

Machine Learning · Statistics 2020-05-29 Banghua Zhu , Jiantao Jiao , Jacob Steinhardt

The alternating direction of multipliers method (ADMM) is a popular method to solve distributed consensus optimization utilizing efficient communication among various nodes in the network. However, in the presence of faulty or attacked…

Optimization and Control · Mathematics 2025-12-10 Vishnu Vijay , Kartik A. Pant , Minhyun Cho , Inseok Hwang

This paper introduces a deep learning-based framework for resilient decision fusion in adversarial multi-sensor networks, providing a unified mathematical setup that encompasses diverse scenarios, including varying Byzantine node…

Machine Learning · Computer Science 2024-12-18 Kassem Kallas

There has been a growing need to provide Byzantine-resilience in distributed model training. Existing robust distributed learning algorithms focus on developing sophisticated robust aggregators at the parameter servers, but pay less…

Machine Learning · Computer Science 2021-10-12 Lingjiao Chen , Leshang Chen , Hongyi Wang , Susan Davidson , Edgar Dobriban

Consensus is one of the most fundamental distributed computing problems. In particular, it serves as a building block in many replication based fault-tolerant systems and in particular in multiple recent blockchain solutions. Depending on…

Distributed, Parallel, and Cluster Computing · Computer Science 2019-08-08 Yehonatan Buchnik , Roy Friedman

The growth of data, the need for scalability and the complexity of models used in modern machine learning calls for distributed implementations. Yet, as of today, distributed machine learning frameworks have largely ignored the possibility…

Distributed, Parallel, and Cluster Computing · Computer Science 2017-03-14 Peva Blanchard , El Mahdi El Mhamdi , Rachid Guerraoui , Julien Stainer

This paper considers the problem of Byzantine dispersion and extends previous work along several parameters. The problem of Byzantine dispersion asks: given $n$ robots, up to $f$ of which are Byzantine, initially placed arbitrarily on an…

Distributed, Parallel, and Cluster Computing · Computer Science 2021-09-28 Anisur Rahaman Molla , Kaushik Mondal , William K. Moses

This paper proposes a Robust Gradient Classification Framework (RGCF) for Byzantine fault tolerance in distributed stochastic gradient descent. The framework consists of a pattern recognition filter which we train to be able to classify…

Machine Learning · Computer Science 2023-01-19 Shashank Reddy Chirra , Kalyan Varma Nadimpalli , Shrisha Rao

The advancement of AI models, especially those powered by deep learning, faces significant challenges in data-sensitive industries like healthcare and finance due to the distributed and private nature of data. Federated Learning (FL) and…

Cryptography and Security · Computer Science 2025-01-14 Yongming Fan , Rui Zhu , Zihao Wang , Chenghong Wang , Haixu Tang , Ye Dong , Hyunghoon Cho , Lucila Ohno-Machado

We introduce the paradigm of validated decentralized learning for undirected networks with heterogeneous data and possible adversarial infiltration. We require (a) convergence to a global empirical loss minimizer when adversaries are…

Machine Learning · Computer Science 2024-05-14 Mayank Bakshi , Sara Ghasvarianjahromi , Yauhen Yakimenka , Allison Beemer , Oliver Kosut , Joerg Kliewer

We study the problem of Byzantine fault tolerance in a distributed optimization setting, where there is a group of $N$ agents communicating with a trusted centralized coordinator. Among these agents, there is a subset of $f$ agents that may…

Optimization and Control · Mathematics 2023-12-19 Amit Dutta , Thinh T. Doan , Jeffrey H. Reed

We propose a novel robust aggregation rule for distributed synchronous Stochastic Gradient Descent~(SGD) under a general Byzantine failure model. The attackers can arbitrarily manipulate the data transferred between the servers and the…

Distributed, Parallel, and Cluster Computing · Computer Science 2018-05-25 Cong Xie , Oluwasanmi Koyejo , Indranil Gupta

This paper investigates the problem of resilient control for multi-agent systems in the presence of Byzantine adversaries via an active secure neighbor selection framework. A pre-discriminative graph is first constructed to characterize the…

Systems and Control · Electrical Eng. & Systems 2025-11-26 Jinming Gao , Yijing Wang , Wentao Zhang , Rui Zhao , Yang Shi , Zhiqiang Zuo

In federated learning, multiple client devices jointly learn a machine learning model: each client device maintains a local model for its local training dataset, while a master device maintains a global model via aggregating the local…

Cryptography and Security · Computer Science 2021-11-23 Minghong Fang , Xiaoyu Cao , Jinyuan Jia , Neil Zhenqiang Gong

In decentralized machine learning, different devices communicate in a peer-to-peer manner to collaboratively learn from each other's data. Such approaches are vulnerable to misbehaving (or Byzantine) devices. We introduce F-RG, a general…

Optimization and Control · Mathematics 2025-06-12 Renaud Gaucher , Aymeric Dieuleveut , Hadrien Hendrikx

In many applications, data is collected in batches, some of which are corrupt or even adversarial. Recent work derived optimal robust algorithms for estimating discrete distributions in this setting. We consider a general framework of…

Machine Learning · Statistics 2020-02-26 Ayush Jain , Alon Orlitsky

Federated learning is a distributed training framework vulnerable to Byzantine attacks, particularly when over 50% of clients are malicious or when datasets are highly non-independent and identically distributed (non-IID). Additionally,…

Cryptography and Security · Computer Science 2025-08-04 Haocheng Jiang , Hua Shen , Jixin Zhang , Willy Susilo , Mingwu Zhang

Federated learning, as a distributed learning that conducts the training on the local devices without accessing to the training data, is vulnerable to Byzatine poisoning adversarial attacks. We argue that the federated learning model has to…

Machine Learning · Computer Science 2022-09-20 Nuria Rodríguez-Barroso , Eugenio Martínez-Cámara , M. Victoria Luzón , Francisco Herrera