English
Related papers

Related papers: A Resilient Distributed Algorithm for Solving Line…

200 papers

Byzantine machine learning (ML) aims to ensure the resilience of distributed learning algorithms to misbehaving (or Byzantine) machines. Although this problem received significant attention, prior works often assume the data held by the…

Machine Learning · Computer Science 2023-02-06 Youssef Allouah , Sadegh Farhadkhani , Rachid Guerraoui , Nirupam Gupta , Rafael Pinot , John Stephan

Decentralized stochastic gradient algorithms efficiently solve large-scale finite-sum optimization problems when all agents in the network are reliable. However, most of these algorithms are not resilient to adverse conditions, such as…

Optimization and Control · Mathematics 2025-06-24 Jinhui Hu , Guo Chen , Huaqing Li , Xiaoyu Guo , Liang Ran , Tingwen Huang

We describe an approach to modelling a Byzantine tolerant distributed algorithm as a family of related finite state machines, generated from a single meta-model. Various artefacts are generated from each state machine, including diagrams…

Distributed, Parallel, and Cluster Computing · Computer Science 2010-06-18 Graham Kirby , Alan Dearle , Stuart Norcross

Machine Learning (ML) solutions are nowadays distributed and are prone to various types of component failures, which can be encompassed in so-called Byzantine behavior. This paper introduces LiuBei, a Byzantine-resilient ML algorithm that…

Machine Learning · Computer Science 2020-07-21 El Mahdi El Mhamdi , Rachid Guerraoui , Arsany Guirguis

This papers studies multi-agent (convex and \emph{nonconvex}) optimization over static digraphs. We propose a general distributed \emph{asynchronous} algorithmic framework whereby i) agents can update their local variables as well as…

Optimization and Control · Mathematics 2019-09-12 Ye Tian , Ying Sun , Gesualdo Scutari

This paper presents a simple and efficient reliable broadcast algorithm for asynchronous message-passing systems made up of $n$ processes, among which up to $t<n/5$ may behave arbitrarily (Byzantine processes). This algorithm requires two…

Distributed, Parallel, and Cluster Computing · Computer Science 2021-09-29 Damien Imbs , Michel Raynal

The recent advances in sensor technologies and smart devices enable the collaborative collection of a sheer volume of data from multiple information sources. As a promising tool to efficiently extract useful information from such big data,…

Machine Learning · Computer Science 2019-03-08 Richeng Jin , Xiaofan He , Huaiyu Dai

As the network scale increases, existing fully distributed solutions start to lag behind the real-world challenges such as (1) slow information propagation, (2) network communication failures, and (3) external adversarial attacks. In this…

Machine Learning · Computer Science 2023-07-28 Connor Mclaughlin , Matthew Ding , Denis Edogmus , Lili Su

We study the task of Byzantine gathering in a network modeled as a graph. Despite the presence of Byzantine agents, all the other (good) agents, starting from possibly different nodes and applying the same deterministic algorithm, have to…

Data Structures and Algorithms · Computer Science 2018-01-24 Sébastien Bouchard , Yoann Dieudonné , Anissa Lamani

Byzantine-robust distributed optimization relies on robust aggregation rules to mitigate the influence of malicious Byzantine workers. Despite the proliferation of such rules, a unified convergence analysis framework that accommodates…

Optimization and Control · Mathematics 2026-04-14 Boyuan Ruan , Xiaoyu Wang , Ya-Feng Liu

Adversarial attacks attempt to disrupt the training, retraining and utilizing of artificial intelligence and machine learning models in large-scale distributed machine learning systems. This causes security risks on its prediction outcome.…

Cryptography and Security · Computer Science 2021-09-07 Yusen Wu , Hao Chen , Xin Wang , Chao Liu , Phuong Nguyen , Yelena Yesha

Byzantine robustness has received significant attention recently given its importance for distributed and federated learning. In spite of this, we identify severe flaws in existing algorithms even when the data across the participants is…

Machine Learning · Computer Science 2021-06-30 Sai Praneeth Karimireddy , Lie He , Martin Jaggi

Byzantine reliable broadcast is a fundamental primitive in distributed systems that allows a set of processes to agree on a message broadcast by a dedicated process, even when some of them are malicious (Byzantine). It guarantees that no…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-10-01 Veronika Anikina , João Paulo Bezerra , Petr Kuznetsov , Liron Schiff , Stefan Schmid

In this paper, we propose a distributed algorithm for the minimum dominating set problem. For some especial networks, we prove theoretically that the achieved answer by our proposed algorithm is a constant approximation factor of the exact…

Distributed, Parallel, and Cluster Computing · Computer Science 2021-01-05 Sharareh Alipour , Ehsan Futuhi , Shayan Karimi

Numerous distributed applications, such as cloud computing and distributed ledgers, necessitate the system to invoke asynchronous consensus objects an unbounded number of times, where the completion of one consensus instance is followed by…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-07-28 Chryssis Georgiou , Michel Raynal , Elad M. Schiller

To improve the resilience of distributed training to worst-case, or Byzantine node failures, several recent approaches have replaced gradient averaging with robust aggregation methods. Such techniques can have high computational costs,…

Machine Learning · Computer Science 2020-03-10 Shashank Rajput , Hongyi Wang , Zachary Charles , Dimitris Papailiopoulos

The cooperative bandit problem is a multi-agent decision problem involving a group of agents that interact simultaneously with a multi-armed bandit, while communicating over a network with delays. The central idea in this problem is to…

Machine Learning · Statistics 2022-05-31 Abhimanyu Dubey , Alex Pentland

This paper is mainly devoted to the distributed second-order multi-agent optimization problem with unbalanced and directed networks. To deal with this problem, a new distributed algorithm is proposed based on the local neighbor information…

Systems and Control · Electrical Eng. & Systems 2020-05-05 Lipo Mo , Haokun Hu , Yongguang Yu , Guojian Ren

This paper studies distributed diffusion adaptation over clustered multi-task networks in the presence of impulsive interferences and Byzantine attacks. We develop a robust resilient diffusion least mean Geman-McClure-estimation (RDLMG)…

Machine Learning · Computer Science 2022-06-28 Tao Yu , Rodrigo C. de Lamare , Yi Yu

We provide a unifying framework for distributed convex optimization over time-varying networks, in the presence of constraints and uncertainty, features that are typically treated separately in the literature. We adopt a proximal…

Optimization and Control · Mathematics 2017-05-24 Kostas Margellos , Alessandro Falsone , Simone Garatti , Maria Prandini