English
Related papers

Related papers: Design and Analysis of Robust Resilient Diffusion …

200 papers

Byzantine-robust distributed learning (BRDL), in which computing devices are likely to behave abnormally due to accidental failures or malicious attacks, has recently become a hot research topic. However, even in the independent and…

Machine Learning · Computer Science 2023-05-24 Yi-Rui Yang , Chang-Wei Shi , Wu-Jun Li

In large-scale distributed learning, security issues have become increasingly important. Particularly in a decentralized environment, some computing units may behave abnormally, or even exhibit Byzantine failures -- arbitrary and…

Machine Learning · Computer Science 2021-02-26 Dong Yin , Yudong Chen , Kannan Ramchandran , Peter Bartlett

Distributed learning has many computational benefits but is vulnerable to attacks from a subset of devices transmitting incorrect information. This paper investigates Byzantine-resilient algorithms in a decentralized setting, where devices…

Machine Learning · Computer Science 2025-07-04 Renaud Gaucher , Aymeric Dieuleveut , Hadrien Hendrikx

In this paper, we propose a first-order distributed optimization algorithm that is provably robust to Byzantine failures-arbitrary and potentially adversarial behavior, where all the participating agents are prone to failure. We model each…

Optimization and Control · Mathematics 2022-07-27 Berkay Turan , Cesar A. Uribe , Hoi-To Wai , Mahnoosh Alizadeh

Distributed estimation over networks draws much attraction in recent years. In many situations, due to imperfect information communication among nodes, the performance of traditional diffusion adaptive algorithms such as the diffusion LMS…

Information Theory · Computer Science 2018-02-15 Yicong He , Fei Wang , Shiyuan Wang , Pengju Ren , Badong Chen

The alternating direction of multipliers method (ADMM) is a popular method to solve distributed consensus optimization utilizing efficient communication among various nodes in the network. However, in the presence of faulty or attacked…

Optimization and Control · Mathematics 2025-12-10 Vishnu Vijay , Kartik A. Pant , Minhyun Cho , Inseok Hwang

In this paper, we consider the resilient multi-dimensional consensus and distributed optimization problems of multi-agent systems (MASs) in the presence of both agent-based and denial-of-service (DoS) attacks. The considered agent-based…

Systems and Control · Electrical Eng. & Systems 2026-03-19 Hongjian Chen , Changyun Wen , Xiaolei Li

In recent years, the multitask diffusion least mean square (MD-LMS) algorithm has been extensively applied in the distributed parameter estimation and target tracking of multitask network. However, its performance is mainly limited by two…

Signal Processing · Electrical Eng. & Systems 2022-10-21 Wenjing Xu , Haiquan Zhao , Shaohui Lv

This paper develops an efficient distributed inference algorithm, which is robust against a moderate fraction of Byzantine nodes, namely arbitrary and possibly adversarial machines in a distributed learning system. In robust statistics, the…

Machine Learning · Statistics 2021-03-05 Jiyuan Tu , Weidong Liu , Xiaojun Mao , Xi Chen

Distributed machine learning algorithms enable learning of models from datasets that are distributed over a network without gathering the data at a centralized location. While efficient distributed algorithms have been developed under the…

Machine Learning · Computer Science 2020-07-07 Zhixiong Yang , Waheed U. Bajwa

Consensus algorithms provide strategies to solve problems in a distributed system with the added constraint that data can only be shared between adjacent computing nodes. We find these algorithms in applications for wireless and sensor…

Cryptography and Security · Computer Science 2016-11-15 Michel Toulouse , Hai Le , Cao Vien Phung , Denis Hock

This paper studies the problem of cooperative control of heterogeneous multi-agent systems (MASs) against Byzantine attacks. The agent affected by Byzantine attacks sends different wrong values to all neighbors while applying wrong input…

Systems and Control · Electrical Eng. & Systems 2023-03-28 Xin Gong , Yiwen Liang , Yukang Cui , Shi Liang , Tingwen Huang

This work develops a robust diffusion recursive least squares algorithm to mitigate the performance degradation often experienced in networks of agents in the presence of impulsive noise. This algorithm minimizes an exponentially weighted…

Information Theory · Computer Science 2019-02-20 Y. Yu , R. C. de Lamare , Y. Zakharov

Consider a set of vectors in $\mathbb{R}^n$, partitioned into two classes: normal vectors and malicious vectors. The number of malicious vectors is bounded but their identities are unknown. The paper provides a way for achieving a resilient…

Optimization and Control · Mathematics 2018-07-11 Xuan Wang , Shaoshuai Mou , Shreyas Sundaram

This paper investigates the problem of decentralized resource allocation in the presence of Byzantine attacks. Such attacks occur when an unknown number of malicious agents send random or carefully crafted messages to their neighbors,…

Optimization and Control · Mathematics 2024-09-10 Runhua Wang , Qing Ling , Zhi Tian

In this paper, we investigate the challenging framework of Byzantine-robust training in distributed machine learning (ML) systems, focusing on enhancing both efficiency and practicality. As distributed ML systems become integral for complex…

Machine Learning · Computer Science 2024-09-04 Tehila Dahan , Kfir Y. Levy

In this work, we consider the resilience of distributed algorithms based on stochastic gradient descent (SGD) in distributed learning with potentially Byzantine attackers, who could send arbitrary information to the parameter server to…

Machine Learning · Computer Science 2019-09-11 Haibo Yang , Xin Zhang , Minghong Fang , Jia Liu

Byzantine machine learning has garnered considerable attention in light of the unpredictable faults that can occur in large-scale distributed learning systems. The key to secure resilience against Byzantine machines in distributed learning…

Machine Learning · Computer Science 2024-04-02 Yuhao Yi , Ronghui You , Hong Liu , Changxin Liu , Yuan Wang , Jiancheng Lv

This paper considers the problem of detection in distributed networks in the presence of data falsification (Byzantine) attacks. Detection approaches considered in the paper are based on fully distributed consensus algorithms, where all of…

Systems and Control · Computer Science 2017-09-29 Bhavya Kailkhura , Swastik Brahma , Pramod K. Varshney

While the last few decades have witnessed a huge body of work devoted to inference and learning in distributed and decentralized setups, much of this work assumes a non-adversarial setting in which individual nodes---apart from occasional…

Machine Learning · Statistics 2020-06-03 Zhixiong Yang , Arpita Gang , Waheed U. Bajwa