English
Related papers

Related papers: Resilient Federated Learning under Byzantine Attac…

200 papers

We study local stochastic gradient descent methods for solving federated optimization over a network of agents communicating indirectly through a centralized coordinator. We are interested in the Byzantine setting where there is a subset of…

Optimization and Control · Mathematics 2024-09-06 Amit Dutta , Thinh T. Doan

We consider the problem of Byzantine fault-tolerance in federated machine learning. In this problem, the system comprises multiple agents each with local data, and a trusted centralized coordinator. In fault-free setting, the agents…

Distributed, Parallel, and Cluster Computing · Computer Science 2021-08-27 Nirupam Gupta , Thinh T. Doan , Nitin Vaidya

This paper studies the distributed multi-agent resilient optimization problem under the f-total Byzantine attacks. Compared with the previous work on Byzantineresilient multi-agent exact optimization problems, we do not require the…

Optimization and Control · Mathematics 2023-03-29 Yang Zhai , Zhi-Wei Liu , Dong Yue , Songlin Hu , Xiangpeng Xie

The problem of distributed optimization requires a group of agents to reach agreement on a parameter that minimizes the average of their local cost functions using information received from their neighbors. While there are a variety of…

Optimization and Control · Mathematics 2024-03-05 Kananart Kuwaranancharoen , Lei Xin , Shreyas Sundaram

This paper considers the problem of Byzantine fault-tolerance in distributed multi-agent optimization. In this problem, each agent has a local cost function, and in the fault-free case, the goal is to design a distributed algorithm that…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-05-22 Shuo Liu , Nirupam Gupta , Nitin H. Vaidya

Both Byzantine resilience and communication efficiency have attracted tremendous attention recently for their significance in edge federated learning. However, most existing algorithms may fail when dealing with real-world irregular data…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-03-21 Youming Tao , Sijia Cui , Wenlu Xu , Haofei Yin , Dongxiao Yu , Weifa Liang , Xiuzhen Cheng

In Federated Reinforcement Learning (FRL), agents aim to collaboratively learn a common task, while each agent is acting in its local environment without exchanging raw trajectories. Existing approaches for FRL either (a) do not provide any…

Machine Learning · Computer Science 2024-01-09 Philip Jordan , Florian Grötschla , Flint Xiaofeng Fan , Roger Wattenhofer

This paper considers the problem of Byzantine fault tolerance in distributed linear regression in a multi-agent system. However, the proposed algorithms are given for a more general class of distributed optimization problems, of which…

Machine Learning · Computer Science 2019-04-05 Nirupam Gupta , Nitin H. Vaidya

We consider the problem of Byzantine fault-tolerance in the peer-to-peer (P2P) distributed gradient-descent method -- a prominent algorithm for distributed optimization in a P2P system. In this problem, the system comprises of multiple…

Distributed, Parallel, and Cluster Computing · Computer Science 2021-02-01 Nirupam Gupta , Nitin H. Vaidya

This paper considers the problem of Byzantine fault-tolerance in multi-agent decentralized optimization. In this problem, each agent has a local cost function. The goal of a decentralized optimization algorithm is to allow the agents to…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-10-01 Nirupam Gupta , Thinh T. Doan , Nitin H. Vaidya

We consider the federated learning problem where data on workers are not independent and identically distributed (i.i.d.). During the learning process, an unknown number of Byzantine workers may send malicious messages to the central node,…

Machine Learning · Computer Science 2021-08-31 Jie Peng , Zhaoxian Wu , Qing Ling , Tianyi Chen

In this paper, we propose a first-order distributed optimization algorithm that is provably robust to Byzantine failures-arbitrary and potentially adversarial behavior, where all the participating agents are prone to failure. We model each…

Optimization and Control · Mathematics 2022-07-27 Berkay Turan , Cesar A. Uribe , Hoi-To Wai , Mahnoosh Alizadeh

We study adversary-resilient stochastic distributed optimization, in which $m$ machines can independently compute stochastic gradients, and cooperate to jointly optimize over their local objective functions. However, an $\alpha$-fraction of…

Machine Learning · Computer Science 2021-04-05 Zeyuan Allen-Zhu , Faeze Ebrahimian , Jerry Li , Dan Alistarh

This paper considers a distributed optimization problem in the presence of Byzantine agents capable of introducing untrustworthy information into the communication network. A resilient distributed subgradient algorithm is proposed based on…

Optimization and Control · Mathematics 2023-03-22 Jingxuan Zhu , Yixuan Lin , Alvaro Velasquez , Ji Liu

The problem of designing distributed optimization algorithms that are resilient to Byzantine adversaries has received significant attention. For the Byzantine-resilient distributed optimization problem, the goal is to (approximately)…

Optimization and Control · Mathematics 2024-12-30 Kananart Kuwaranancharoen , Shreyas Sundaram

Distributed multi-task learning provides significant advantages in multi-agent networks with heterogeneous data sources where agents aim to learn distinct but correlated models simultaneously.However, distributed algorithms for learning…

Machine Learning · Computer Science 2021-01-11 Jiani Li , Waseem Abbas , Xenofon Koutsoukos

We consider the problem of distributed statistical machine learning in adversarial settings, where some unknown and time-varying subset of working machines may be compromised and behave arbitrarily to prevent an accurate model from being…

Distributed, Parallel, and Cluster Computing · Computer Science 2017-10-24 Yudong Chen , Lili Su , Jiaming Xu

In this report, we study the problem of Byzantine fault-tolerant distributed set intersection and the importance of redundancy in solving this problem. Specifically, consider a distributed system with $n$ agents, each of which has a local…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-02-15 Shuo Liu , Nitin H. Vaidya

We study robust distributed learning that involves minimizing a non-convex loss function with saddle points. We consider the Byzantine setting where some worker machines have abnormal or even arbitrary and adversarial behavior. In this…

Machine Learning · Computer Science 2020-07-30 Dong Yin , Yudong Chen , Kannan Ramchandran , Peter Bartlett

This paper considers the Byzantine fault-tolerance problem in distributed stochastic gradient descent (D-SGD) method - a popular algorithm for distributed multi-agent machine learning. In this problem, each agent samples data points…

Machine Learning · Computer Science 2021-04-20 Nirupam Gupta , Shuo Liu , Nitin H. Vaidya
‹ Prev 1 2 3 10 Next ›