English
Related papers

Related papers: Utilizing Redundancy in Cost Functions for Resilie…

200 papers

This report considers the problem of resilient distributed optimization and stochastic learning in a server-based architecture. The system comprises a server and multiple agents, where each agent has its own local cost function. The agents…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-12-15 Shuo Liu , Nirupam Gupta , Nitin H. Vaidya

This paper considers the problem of asynchronous distributed multi-agent optimization on server-based system architecture. In this problem, each agent has a local cost, and the goal for the agents is to collectively find a minimum of their…

Distributed, Parallel, and Cluster Computing · Computer Science 2021-06-09 Shuo Liu , Nirupam Gupta , Nitin H. Vaidya

This paper considers the problem of Byzantine fault-tolerance in distributed multi-agent optimization. In this problem, each agent has a local cost function, and in the fault-free case, the goal is to design a distributed algorithm that…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-05-22 Shuo Liu , Nirupam Gupta , Nitin H. Vaidya

This report considers the problem of Byzantine fault-tolerance in multi-agent collaborative optimization. In this problem, each agent has a local cost function. The goal of a collaborative optimization algorithm is to compute a minimum of…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-04-01 Nirupam Gupta , Nitin H. Vaidya

This paper considers the problem of Byzantine fault-tolerance in multi-agent decentralized optimization. In this problem, each agent has a local cost function. The goal of a decentralized optimization algorithm is to allow the agents to…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-10-01 Nirupam Gupta , Thinh T. Doan , Nitin H. Vaidya

This paper considers the problem of Byzantine fault tolerance in distributed linear regression in a multi-agent system. However, the proposed algorithms are given for a more general class of distributed optimization problems, of which…

Machine Learning · Computer Science 2019-04-05 Nirupam Gupta , Nitin H. Vaidya

This paper considers a distributed optimization problem in the presence of Byzantine agents capable of introducing untrustworthy information into the communication network. A resilient distributed subgradient algorithm is proposed based on…

Optimization and Control · Mathematics 2023-03-22 Jingxuan Zhu , Yixuan Lin , Alvaro Velasquez , Ji Liu

This paper studies the distributed multi-agent resilient optimization problem under the f-total Byzantine attacks. Compared with the previous work on Byzantineresilient multi-agent exact optimization problems, we do not require the…

Optimization and Control · Mathematics 2023-03-29 Yang Zhai , Zhi-Wei Liu , Dong Yue , Songlin Hu , Xiangpeng Xie

Distributed Learning often suffers from Byzantine failures, and there have been a number of works studying the problem of distributed stochastic optimization under Byzantine failures, where only a portion of workers, instead of all the…

Distributed, Parallel, and Cluster Computing · Computer Science 2021-08-17 Kaiyun Li , Xiaojun Chen , Ye Dong , Peng Zhang , Dakui Wang , Shuai Zen

We study local stochastic gradient descent methods for solving federated optimization over a network of agents communicating indirectly through a centralized coordinator. We are interested in the Byzantine setting where there is a subset of…

Optimization and Control · Mathematics 2024-09-06 Amit Dutta , Thinh T. Doan

In this paper, we propose a first-order distributed optimization algorithm that is provably robust to Byzantine failures-arbitrary and potentially adversarial behavior, where all the participating agents are prone to failure. We model each…

Optimization and Control · Mathematics 2022-07-27 Berkay Turan , Cesar A. Uribe , Hoi-To Wai , Mahnoosh Alizadeh

The problem of distributed optimization requires a group of agents to reach agreement on a parameter that minimizes the average of their local cost functions using information received from their neighbors. While there are a variety of…

Optimization and Control · Mathematics 2024-03-05 Kananart Kuwaranancharoen , Lei Xin , Shreyas Sundaram

We study the problem of Byzantine fault tolerance in a distributed optimization setting, where there is a group of $N$ agents communicating with a trusted centralized coordinator. Among these agents, there is a subset of $f$ agents that may…

Optimization and Control · Mathematics 2023-12-19 Amit Dutta , Thinh T. Doan , Jeffrey H. Reed

The problem of designing distributed optimization algorithms that are resilient to Byzantine adversaries has received significant attention. For the Byzantine-resilient distributed optimization problem, the goal is to (approximately)…

Optimization and Control · Mathematics 2024-12-30 Kananart Kuwaranancharoen , Shreyas Sundaram

Standard federated learning algorithms are vulnerable to adversarial nodes, a.k.a. Byzantine failures. To solve this issue, robust distributed learning algorithms have been developed, which typically replace parameter averaging by robust…

Machine Learning · Computer Science 2026-02-04 Renaud Gaucher , Aymeric Dieuleveut , Hadrien Hendrikx

Distributed multi-task learning provides significant advantages in multi-agent networks with heterogeneous data sources where agents aim to learn distinct but correlated models simultaneously.However, distributed algorithms for learning…

Machine Learning · Computer Science 2021-01-11 Jiani Li , Waseem Abbas , Xenofon Koutsoukos

This report considers the problem of Byzantine fault-tolerance in synchronous parallelized learning that is founded on the parallelized stochastic gradient descent (parallelized-SGD) algorithm. The system comprises a master, and $n$…

Distributed, Parallel, and Cluster Computing · Computer Science 2019-12-23 Nirupam Gupta , Nitin H. Vaidya

This paper considers the Byzantine fault-tolerance problem in distributed stochastic gradient descent (D-SGD) method - a popular algorithm for distributed multi-agent machine learning. In this problem, each agent samples data points…

Machine Learning · Computer Science 2021-04-20 Nirupam Gupta , Shuo Liu , Nitin H. Vaidya

We study stochastic gradient descent (SGD) with local iterations in the presence of malicious/Byzantine clients, motivated by the federated learning. The clients, instead of communicating with the central server in every iteration, maintain…

Machine Learning · Statistics 2020-08-18 Deepesh Data , Suhas Diggavi

We consider the problem of Byzantine fault-tolerance in federated machine learning. In this problem, the system comprises multiple agents each with local data, and a trusted centralized coordinator. In fault-free setting, the agents…

Distributed, Parallel, and Cluster Computing · Computer Science 2021-08-27 Nirupam Gupta , Thinh T. Doan , Nitin Vaidya
‹ Prev 1 2 3 10 Next ›