English
Related papers

Related papers: Byzantine Multi-Agent Optimization: Part I

200 papers

Exact Byzantine consensus problem requires that non-faulty processes reach agreement on a decision (or output) that is in the convex hull of the inputs at the non-faulty processes. It is well-known that exact consensus is impossible in an…

Distributed, Parallel, and Cluster Computing · Computer Science 2016-02-01 Zhuolun Xiang , Nitin H. Vaidya

We study distributed multi-agent large-scale optimization problems, wherein the cost function is composed of a smooth possibly nonconvex sum-utility plus a DC (Difference-of-Convex) regularizer. We consider the scenario where the dimension…

Distributed, Parallel, and Cluster Computing · Computer Science 2018-05-29 Ivano Notarnicola , Ying Sun , Gesualdo Scutari , Giuseppe Notarstefano

Optimum decision fusion in the presence of malicious nodes - often referred to as Byzantines - is hindered by the necessity of exactly knowing the statistical behavior of Byzantines. By focusing on a simple, yet widely studied, set-up in…

Systems and Control · Computer Science 2015-07-03 Andrea Abrardo , Mauro Barni , Kassem Kallas , Benedetta Tondi

During the past two decades, multi-agent optimization problems have drawn increased attention from the research community. When multiple objective functions are present among agents, many works optimize the sum of these objective functions.…

Multiagent Systems · Computer Science 2020-10-13 M. J. Blondin , M. T. Hale

Much of the past work on asynchronous approximate Byzantine consensus has assumed scalar inputs at the nodes [4, 8]. Recent work has yielded approximate Byzantine consensus algorithms for the case when the input at each node is a…

Distributed, Parallel, and Cluster Computing · Computer Science 2013-07-10 Lewis Tseng , Nitin Vaidya

This paper presents a resilient distributed algorithm for solving a system of linear algebraic equations over a multi-agent network in the presence of Byzantine agents capable of arbitrarily introducing untrustworthy information in…

Systems and Control · Electrical Eng. & Systems 2023-04-04 Jingxuan Zhu , Alvaro Velasquez , Ji Liu

This paper focuses on decentralized stochastic optimization in the presence of Byzantine attacks. During the optimization process, an unknown number of malfunctioning or malicious workers, termed as Byzantine workers, disobey the…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-04-13 Zhaoxian Wu , Tianyi Chen , Qing Ling

Both Byzantine resilience and communication efficiency have attracted tremendous attention recently for their significance in edge federated learning. However, most existing algorithms may fail when dealing with real-world irregular data…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-03-21 Youming Tao , Sijia Cui , Wenlu Xu , Haofei Yin , Dongxiao Yu , Weifa Liang , Xiuzhen Cheng

This work studies multi-agent sharing optimization problems with the objective function being the sum of smooth local functions plus a convex (possibly non-smooth) function coupling all agents. This scenario arises in many machine learning…

Optimization and Control · Mathematics 2020-06-17 Sulaiman A. Alghunaim , Ming Yan , Ali H. Sayed

In this paper we prove lower and matching upper bounds for the number of servers required to implement a regular shared register that tolerates unsynchronized Mobile Byzantine failures. We consider the strongest model of Mobile Byzantine…

Distributed, Parallel, and Cluster Computing · Computer Science 2017-07-18 Silvia Bonomi , Antonella Del Pozzo , Maria Potop-Butucaru , Sébastien Tixeuil

Since the mid-1980s it has been known that Byzantine Agreement can be solved with probability 1 asynchronously, even against an omniscient, computationally unbounded adversary that can adaptively \emph{corrupt} up to $f<n/3$ parties.…

Distributed, Parallel, and Cluster Computing · Computer Science 2022-07-01 Shang-En Huang , Seth Pettie , Leqi Zhu

We study the task of Byzantine gathering in a network modeled as a graph. Despite the presence of Byzantine agents, all the other (good) agents, starting from possibly different nodes and applying the same deterministic algorithm, have to…

Data Structures and Algorithms · Computer Science 2018-01-24 Sébastien Bouchard , Yoann Dieudonné , Anissa Lamani

In this paper, a fully distributed averaging algorithm in the presence of adversarial Byzantine agents is proposed. The algorithm is based on a resilient retrieval procedure, where all non-Byzantine nodes send their own initial values and…

Multiagent Systems · Computer Science 2021-07-28 Mostafa Safi , Seyed Mehran Dibaji

We address the problem of multiple local optima commonly arising in optimization problems for multi-agent systems, where objective functions are nonlinear and nonconvex. For the class of coverage control problems, we propose a systematic…

Optimization and Control · Mathematics 2014-09-09 Xinmiao Sun , Christos G. Cassandras , Kagan Gokbayrak

Adversarial attacks during training can strongly influence the performance of multi-agent reinforcement learning algorithms. It is, thus, highly desirable to augment existing algorithms such that the impact of adversarial attacks on…

Machine Learning · Computer Science 2021-11-19 Martin Figura , Yixuan Lin , Ji Liu , Vijay Gupta

Distributed Learning often suffers from Byzantine failures, and there have been a number of works studying the problem of distributed stochastic optimization under Byzantine failures, where only a portion of workers, instead of all the…

Distributed, Parallel, and Cluster Computing · Computer Science 2021-08-17 Kaiyun Li , Xiaojun Chen , Ye Dong , Peng Zhang , Dakui Wang , Shuai Zen

In this paper, we focus on solving a distributed convex optimization problem in a network, where each agent has its own convex cost function and the goal is to minimize the sum of the agents' cost functions while obeying the network…

Optimization and Control · Mathematics 2019-08-02 Shi Pu , Wei Shi , Jinming Xu , Angelia Nedić

We address the challenges of Byzantine-robust training in asynchronous distributed machine learning systems, aiming to enhance efficiency amid massive parallelization and heterogeneous computing resources. Asynchronous systems, marked by…

Machine Learning · Computer Science 2025-06-05 Tehila Dahan , Kfir Y. Levy

In this paper, we study the problem of distributed multi-agent optimization over a network, where each agent possesses a local cost function that is smooth and strongly convex. The global objective is to find a common solution that…

Optimization and Control · Mathematics 2019-08-02 Shi Pu , Angelia Nedić

In distributed learning systems, robustness issues may arise from two sources. On one hand, due to distributional shifts between training data and test data, the trained model could exhibit poor out-of-sample performance. On the other hand,…

Machine Learning · Computer Science 2022-11-01 Guanqiang Zhou , Ping Xu , Yue Wang , Zhi Tian