English
Related papers

Related papers: A Resilient Distributed Algorithm for Solving Line…

200 papers

Byzantine resilience emerged as a prominent topic within the distributed machine learning community. Essentially, the goal is to enhance distributed optimization algorithms, such as distributed SGD, in a way that guarantees convergence…

Machine Learning · Computer Science 2022-05-25 Sadegh Farhadkhani , Rachid Guerraoui , Nirupam Gupta , Rafael Pinot , John Stephan

We study a setting where a group of agents, each receiving partially informative private signals, seek to collaboratively learn the true underlying state of the world (from a finite set of hypotheses) that generates their joint observation…

Systems and Control · Electrical Eng. & Systems 2019-07-09 Aritra Mitra , John A. Richards , Shreyas Sundaram

Distributed algorithms for multi-agent resource allocation can provide privacy and scalability over centralized algorithms in many cyber-physical systems. However, the distributed nature of these algorithms can render these systems…

Optimization and Control · Mathematics 2020-12-08 Berkay Turan , Cesar A. Uribe , Hoi-To Wai , Mahnoosh Alizadeh

There has been a growing need to provide Byzantine-resilience in distributed model training. Existing robust distributed learning algorithms focus on developing sophisticated robust aggregators at the parameter servers, but pay less…

Machine Learning · Computer Science 2021-10-12 Lingjiao Chen , Leshang Chen , Hongyi Wang , Susan Davidson , Edgar Dobriban

In this paper, we show synchronization for a group of output passive agents that communicate with each other according to an underlying communication graph to achieve a common goal. We propose a distributed event-triggered control framework…

Systems and Control · Computer Science 2017-10-02 Arash Rahnama , Panos J. Antsaklis

In this paper, we study the problem of finding the least square solutions of over-determined linear algebraic equations over networks in a distributed manner. Each node has access to one of the linear equations and holds a dynamic state. We…

Optimization and Control · Mathematics 2019-09-10 Tao Yang , Jemin George , Jiahu Qin , Xinlei Yi , Junfeng Wu

In Byzantine robust distributed or federated learning, a central server wants to train a machine learning model over data distributed across multiple workers. However, a fraction of these workers may deviate from the prescribed algorithm…

Machine Learning · Computer Science 2023-11-23 Sai Praneeth Karimireddy , Lie He , Martin Jaggi

This paper focuses on decentralized stochastic optimization in the presence of Byzantine attacks. During the optimization process, an unknown number of malfunctioning or malicious workers, termed as Byzantine workers, disobey the…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-04-13 Zhaoxian Wu , Tianyi Chen , Qing Ling

While the last few decades have witnessed a huge body of work devoted to inference and learning in distributed and decentralized setups, much of this work assumes a non-adversarial setting in which individual nodes---apart from occasional…

Machine Learning · Statistics 2020-06-03 Zhixiong Yang , Arpita Gang , Waheed U. Bajwa

In this paper, we consider the resilient multi-dimensional consensus and distributed optimization problems of multi-agent systems (MASs) in the presence of both agent-based and denial-of-service (DoS) attacks. The considered agent-based…

Systems and Control · Electrical Eng. & Systems 2026-03-19 Hongjian Chen , Changyun Wen , Xiaolei Li

Distributed optimization with open collaboration is a popular field since it provides an opportunity for small groups/companies/universities, and individuals to jointly solve huge-scale problems. However, standard optimization algorithms…

Optimization and Control · Mathematics 2023-03-09 Nikita Fedin , Eduard Gorbunov

In this paper, we study a linear bandit optimization problem in a federated setting where a large collection of distributed agents collaboratively learn a common linear bandit model. Standard federated learning algorithms applied to this…

Machine Learning · Computer Science 2022-04-05 Ali Jadbabaie , Haochuan Li , Jian Qian , Yi Tian

We study the gathering problem to make multiple agents initially scattered in arbitrary networks gather at a single node. There exist $k$ agents with unique identifiers (IDs) in the network, and $f$ of them are weakly Byzantine agents,…

Distributed, Parallel, and Cluster Computing · Computer Science 2022-05-31 Jion Hirose , Junya Nakamura , Fukuhito Ooshita , Michiko Inoue

We present a class of iterative fully distributed fixed point methods to solve a system of linear equations, such that each agent in the network holds one of the equations of the system. Under a generic directed, strongly connected network,…

Numerical Analysis · Mathematics 2020-01-16 Dusan Jakovetic , Natasa Krejic , Natasa Krklec Jerinkic , Greta Malaspina , Alessandra Micheletti

In this paper, we consider a resilient consensus problem for the multi-agent network where some of the agents are subject to Byzantine attacks and may transmit erroneous state values to their neighbors. In particular, we develop an…

Multiagent Systems · Computer Science 2023-06-07 Liwei Yuan , Hideaki Ishii

Byzantine reliable broadcast is a fundamental problem in distributed computing, which has been studied extensively over the past decades. State-of-the-art algorithms are predominantly based on the approach to share encoded fragments of the…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-01-06 Thomas Locher

We consider the federated learning problem where data on workers are not independent and identically distributed (i.i.d.). During the learning process, an unknown number of Byzantine workers may send malicious messages to the central node,…

Machine Learning · Computer Science 2021-08-31 Jie Peng , Zhaoxian Wu , Qing Ling , Tianyi Chen

This paper addresses a resilient exponential distributed convex optimization problem for a heterogeneous linear multi-agent system under Denial-of-Service (DoS) attacks over random digraphs. The random digraphs are caused by unreliable…

Optimization and Control · Mathematics 2021-05-07 Zhi Feng , Guoqiang Hu

This paper proposes a novel approach to resilient distributed optimization with quadratic costs in a networked control system (e.g., wireless sensor network, power grid, robotic team) prone to external attacks (e.g., hacking, power outage)…

Systems and Control · Electrical Eng. & Systems 2025-02-11 Luca Ballotta , Giacomo Como , Jeff S. Shamma , Luca Schenato

We consider the problem of Byzantine fault-tolerance in the peer-to-peer (P2P) distributed gradient-descent method -- a prominent algorithm for distributed optimization in a P2P system. In this problem, the system comprises of multiple…

Distributed, Parallel, and Cluster Computing · Computer Science 2021-02-01 Nirupam Gupta , Nitin H. Vaidya