English
Related papers

Related papers: Byzantine Failures Harm the Generalization of Robu…

200 papers

In this paper, we study the problem of distributed training (DT) under Byzantine attacks with communication constraints. While prior work has developed various robust aggregation rules at the server to enhance robustness to Byzantine…

Distributed, Parallel, and Cluster Computing · Computer Science 2026-04-01 Chengxi Li , Youssef Allouah , Rachid Guerraoui , Mikael Skoglund , Ming Xiao

We study how to efficiently diffuse updates to a large distributed system of data replicas, some of which may exhibit arbitrary (Byzantine) failures. We assume that strictly fewer than $t$ replicas fail, and that each update is initially…

Distributed, Parallel, and Cluster Computing · Computer Science 2007-05-23 Dahlia Malkhi , Yishay Mansour , Michael Reiter

Causal ordering in an asynchronous system has many applications in distributed computing, including in replicated databases and real-time collaborative software. Previous work in the area focused on ordering point-to-point messages in a…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-07-01 Anshuman Misra , Ajay Kshemkalyani

Federated learning (FL) is an emerging distributed learning paradigm without sharing participating clients' private data. However, existing works show that FL is vulnerable to both Byzantine (security) attacks and data reconstruction…

Cryptography and Security · Computer Science 2024-07-30 Chenfei Nie , Qiang Li , Yuxin Yang , Yuede Ji , Binghui Wang

While state-of-the-art diffusion models (DMs) excel in image generation, concerns regarding their security persist. Earlier research highlighted DMs' vulnerability to data poisoning attacks, but these studies placed stricter requirements…

Machine Learning · Computer Science 2024-06-18 Zhuoshi Pan , Yuguang Yao , Gaowen Liu , Bingquan Shen , H. Vicky Zhao , Ramana Rao Kompella , Sijia Liu

We study a framework for modeling distributed network systems assisted by a reliable and powerful cloud service. Our framework aims at capturing hybrid systems based on a point to point message passing network of machines, with the…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-09-29 John Augustine , Jeffin Biju , Shachar Meir , David Peleg , Srikkanth Ramachandran , Aishwarya Thiruvengadam

This paper proposes a Byzantine-resilient consensus-based distributed filter (BR-CDF) wherein network agents employ partial sharing of state parameters. We characterize the performance and convergence of the BR-CDF and study the impact of a…

Signal Processing · Electrical Eng. & Systems 2023-07-27 Ashkan Moradi , Vinay Chakravarthi Gogineni , Naveen K. D. Venkategowda , Stefan Werner

The privacy concern exists when the central server has the copies of datasets. Hence, there is a paradigm shift for the learning networks to change from centralized in-cloud learning to distributed \mbox{on-device} learning. Benefit from…

Machine Learning · Computer Science 2019-06-04 Yanjie Dong , Julian Cheng , Md. Jahangir Hossain , Victor C. M. Leung

This paper investigates the problem of decentralized resource allocation in the presence of Byzantine attacks. Such attacks occur when an unknown number of malicious agents send random or carefully crafted messages to their neighbors,…

Optimization and Control · Mathematics 2024-09-10 Runhua Wang , Qing Ling , Zhi Tian

Machine learning has begun to play a central role in many applications. A multitude of these applications typically also involve datasets that are distributed across multiple computing devices/machines due to either design constraints…

Machine Learning · Statistics 2022-06-16 Cheng Fang , Zhixiong Yang , Waheed U. Bajwa

We study a setting where a group of agents, each receiving partially informative private signals, seek to collaboratively learn the true underlying state of the world (from a finite set of hypotheses) that generates their joint observation…

Systems and Control · Electrical Eng. & Systems 2019-07-09 Aritra Mitra , John A. Richards , Shreyas Sundaram

Distributed algorithms for multi-agent resource allocation can provide privacy and scalability over centralized algorithms in many cyber-physical systems. However, the distributed nature of these algorithms can render these systems…

Optimization and Control · Mathematics 2020-12-08 Berkay Turan , Cesar A. Uribe , Hoi-To Wai , Mahnoosh Alizadeh

Distributed learning has become a necessity for training ever-growing models by sharing calculation among several devices. However, some of the devices can be faulty, deliberately or not, preventing the proper convergence. As a matter of…

Machine Learning · Computer Science 2022-02-08 Jason Akoun , Sebastien Meyer

Conformal prediction has shown impressive capacity in constructing statistically rigorous prediction sets for machine learning models with exchangeable data samples. The siloed datasets, coupled with the escalating privacy concerns related…

Machine Learning · Computer Science 2024-06-05 Mintong Kang , Zhen Lin , Jimeng Sun , Cao Xiao , Bo Li

In this paper, we consider the Byzantine-robust stochastic optimization problem defined over decentralized static and time-varying networks, where the agents collaboratively minimize the summation of expectations of stochastic local cost…

Optimization and Control · Mathematics 2020-12-21 Jie Peng , Weiyu Li , Qing Ling

This work considers resilient, cooperative state estimation in unreliable multi-agent networks. A network of agents aims to collaboratively estimate the value of an unknown vector parameter, while an {\em unknown} subset of agents suffer…

Systems and Control · Computer Science 2018-10-25 Lili Su , Shahin Shahrampour

The problem of distributed optimization requires a group of networked agents to compute a parameter that minimizes the average of their local cost functions. While there are a variety of distributed optimization algorithms that can solve…

Multiagent Systems · Computer Science 2024-09-24 Kananart Kuwaranancharoen , Lei Xin , Shreyas Sundaram

Federated learning (FL) is an emerging paradigm for distributed training of large-scale deep neural networks in which participants' data remains on their own devices with only model updates being shared with a central server. However, the…

Machine Learning · Computer Science 2020-08-13 Vale Tolpegin , Stacey Truex , Mehmet Emre Gursoy , Ling Liu

We consider availability data poisoning attacks, where an adversary aims to degrade the overall test accuracy of a machine learning model by crafting small perturbations to its training data. Existing poisoning strategies can achieve the…

Cryptography and Security · Computer Science 2024-06-07 Yiyong Liu , Michael Backes , Xiao Zhang

Due to its distributed nature, federated learning is vulnerable to poisoning attacks, in which malicious clients poison the training process via manipulating their local training data and/or local model updates sent to the cloud server,…

Cryptography and Security · Computer Science 2022-10-05 Xiaoyu Cao , Zaixi Zhang , Jinyuan Jia , Neil Zhenqiang Gong