English
Related papers

Related papers: Byzantine-Resilient Multi-Agent Distributed Exact …

200 papers

Recently, decentralized learning has emerged as a popular peer-to-peer signal and information processing paradigm that enables model training across geographically distributed agents in a scalable manner, without the presence of any central…

Machine Learning · Computer Science 2024-07-12 Haoxiang Ye , Qing Ling

Distributed model training is vulnerable to byzantine system failures and adversarial compute nodes, i.e., nodes that use malicious updates to corrupt the global model stored at a parameter server (PS). To guarantee some form of robustness,…

Machine Learning · Statistics 2018-06-25 Lingjiao Chen , Hongyi Wang , Zachary Charles , Dimitris Papailiopoulos

In this paper, we study secure distributed optimization against arbitrary gradient attack in multi-agent networks. In distributed optimization, there is no central server to coordinate local updates, and each agent can only communicate with…

Optimization and Control · Mathematics 2022-10-31 Shuhua Yu , Soummya Kar

Optimization is instrumental for improving operations of large-scale socio-technical infrastructures of Smart Cities, for instance, energy and traffic systems. In particular, understanding the performance of multi-agent discrete-choice…

Multiagent Systems · Computer Science 2025-06-06 Amal Aldawsari , Evangelos Pournaras

Byzantine machine learning (ML) aims to ensure the resilience of distributed learning algorithms to misbehaving (or Byzantine) machines. Although this problem received significant attention, prior works often assume the data held by the…

Machine Learning · Computer Science 2023-02-06 Youssef Allouah , Sadegh Farhadkhani , Rachid Guerraoui , Nirupam Gupta , Rafael Pinot , John Stephan

Byzantine agreement is a fundamental problem in fault-tolerant distributed computing that has been studied intensively for the last four decades. Much of the research has focused on a static Byzantine adversary, where the adversary is…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-06-06 Fabien Dufoulon , Gopal Pandurangan

Finding optimal adversarial attack strategies is an important topic in reinforcement learning and the Markov decision process. Previous studies usually assume one all-knowing coordinator (attacker) for whom attacking different recipient…

Machine Learning · Computer Science 2024-03-05 Ziqing Lu , Guanlin Liu , Lifeng Lai , Weiyu Xu

In this work, we consider the resilience of distributed algorithms based on stochastic gradient descent (SGD) in distributed learning with potentially Byzantine attackers, who could send arbitrary information to the parameter server to…

Machine Learning · Computer Science 2019-09-11 Haibo Yang , Xin Zhang , Minghong Fang , Jia Liu

We study stochastic gradient descent (SGD) with local iterations in the presence of malicious/Byzantine clients, motivated by the federated learning. The clients, instead of communicating with the central server in every iteration, maintain…

Machine Learning · Statistics 2020-08-18 Deepesh Data , Suhas Diggavi

Distributed model training needs to be adapted to challenges such as the straggler effect and Byzantine attacks. When coordinating the training process with multiple computing nodes, ensuring timely and reliable gradient aggregation amidst…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-12-11 Jiahe Yan , Pratik Chaudhari , Leonard Kleinrock

Communication between workers and the master node to collect local stochastic gradients is a key bottleneck in a large-scale federated learning system. Various recent works have proposed to compress the local stochastic gradients to…

Machine Learning · Computer Science 2024-02-06 Heng Zhu , Qing Ling

We investigate the impact of Byzantine attacks in distributed detection under binary hypothesis testing. It is assumed that a fraction of the transmitted sensor measurements are compromised by the injected data from a Byzantine attacker,…

Information Theory · Computer Science 2019-05-27 Yuqing Ni , Kemi Ding , Yong Yang , Ling Shi

In this paper, we consider the problem of distributed Bayesian detection in the presence of Byzantines in the network. It is assumed that a fraction of the nodes in the network are compromised and reprogrammed by an adversary to transmit…

Information Theory · Computer Science 2018-07-17 Bhavya Kailkhura , Yunghsiang S. Han , Swastik Brahma , Pramod K. Varshney

Given a set of robots with arbitrary initial location and no agreement on a global coordinate system, convergence requires that all robots asymptotically approach the exact same, but unknown beforehand, location. Robots are oblivious-- they…

Distributed, Parallel, and Cluster Computing · Computer Science 2009-05-26 Zohir Bouzid , Maria Potop-Butucaru , Sébastien Tixeuil

We propose two novel stochastic gradient descent algorithms, ByGARS and ByGARS++, for distributed machine learning in the presence of any number of Byzantine adversaries. In these algorithms, reputation scores of workers are computed using…

Machine Learning · Computer Science 2020-12-09 Jayanth Regatti , Hao Chen , Abhishek Gupta

This paper presents a distributed optimization scheme over a network of agents in the presence of cost uncertainties and over switching communication topologies. Inspired by recent advances in distributed convex optimization, we propose a…

Optimization and Control · Mathematics 2016-11-15 Saghar Hosseini , Airlie Chapman , Mehran Mesbahi

Federated recommendation systems can provide good performance without collecting users' private data, making them attractive. However, they are susceptible to low-cost poisoning attacks that can degrade their performance. In this paper, we…

Machine Learning · Computer Science 2020-06-16 Chen Chen , Jingfeng Zhang , Anthony K. H. Tung , Mohan Kankanhalli , Gang Chen

This paper addresses a resilient exponential distributed convex optimization problem for a heterogeneous linear multi-agent system under Denial-of-Service (DoS) attacks over random digraphs. The random digraphs are caused by unreliable…

Optimization and Control · Mathematics 2021-05-07 Zhi Feng , Guoqiang Hu

Consider a set of vectors in $\mathbb{R}^n$, partitioned into two classes: normal vectors and malicious vectors. The number of malicious vectors is bounded but their identities are unknown. The paper provides a way for achieving a resilient…

Optimization and Control · Mathematics 2018-07-11 Xuan Wang , Shaoshuai Mou , Shreyas Sundaram

This paper studies the Byzantine Agreement problem where the nodes have access to a predictor that flags nodes for suspicion of faulty (Byzantine) behavior. We focus on algorithmic resilience -- the maximum number of faulty nodes an…

Distributed, Parallel, and Cluster Computing · Computer Science 2026-05-20 Julien Dallot , Darya Melnyk , Tijana Milentijevic , Stefan Schmid , Patrik Welters