English
Related papers

Related papers: A Resilient Convex Combination for consensus-based…

200 papers

Distributed learning has emerged as a leading paradigm for training large machine learning models. However, in real-world scenarios, participants may be unreliable or malicious, posing a significant challenge to the integrity and accuracy…

Machine Learning · Computer Science 2024-06-10 Grigory Malinovsky , Peter Richtárik , Samuel Horváth , Eduard Gorbunov

In a recent paper, Jaggi et al. (INFOCOM 2007), presented a distributed polynomial-time rate-optimal network-coding scheme that works in the presence of Byzantine faults. We revisit their adversarial models and augment them with three,…

Information Theory · Computer Science 2008-02-06 Leah Nutman , Michael Langberg

In this paper, we study resilient distributed diffusion for multi-task estimation in the presence of adversaries where networked agents must estimate distinct but correlated states of interest by processing streaming data. We show that in…

Multiagent Systems · Computer Science 2020-03-25 Jiani Li , Waseem Abbas , Xenofon Koutsoukos

In this paper, a class of convex feasibility problems (CFPs) are studied for multi-agent systems through local interactions. The objective is to search a feasible solution to the convex inequalities with some set constraints in a…

Systems and Control · Computer Science 2016-12-16 Kaihong Lu , Gangshan Jing , Long Wang

In many applications, data is collected in batches, some of which are corrupt or even adversarial. Recent work derived optimal robust algorithms for estimating discrete distributions in this setting. We consider a general framework of…

Machine Learning · Statistics 2020-02-26 Ayush Jain , Alon Orlitsky

We study the problem of resilient average consensus for multi-agent systems with misbehaving nodes. To protect consensus valuefrom being influenced by misbehaving nodes, we address this problem by detecting misbehaviors, mitigating the…

Systems and Control · Electrical Eng. & Systems 2022-02-23 Wenzhe Zheng , Zhiyu He , Jianping He , Chengcheng Zhao , Chongrong Fang

We propose a scalable robust learning algorithm combining kernel smoothing and robust optimization. Our method is motivated by the convex analysis perspective of distributionally robust optimization based on probability metrics, such as the…

Machine Learning · Computer Science 2022-02-22 Jia-Jie Zhu , Christina Kouridi , Yassine Nemmour , Bernhard Schölkopf

We develop a communication-efficient distributed learning algorithm that is robust against Byzantine worker machines. We propose and analyze a distributed gradient-descent algorithm that performs a simple thresholding based on gradient…

Machine Learning · Computer Science 2021-08-17 Avishek Ghosh , Raj Kumar Maity , Swanand Kadhe , Arya Mazumdar , Kannan Ramchandran

Many existing deep learning models are vulnerable to adversarial examples that are imperceptible to humans. To address this issue, various methods have been proposed to design network architectures that are robust to one particular type of…

Machine Learning · Computer Science 2021-01-19 Jia Liu , Yaochu Jin

This paper concerns the consensus and formation of a network of mobile autonomous agents in adversarial settings where a group of malicious (compromised) agents are subject to deception attacks. In addition, the communication network is…

Multiagent Systems · Computer Science 2024-10-08 Rayan Bahrami , Hamidreza Jafarnejadsani

Training of large scale models on distributed clusters is a critical component of the machine learning pipeline. However, this training can easily be made to fail if some workers behave in an adversarial (Byzantine) fashion whereby they…

Machine Learning · Computer Science 2021-03-05 Konstantinos Konstantinidis , Aditya Ramamoorthy

In a poisoning attack, an adversary with control over a small fraction of the training data attempts to select that data in a way that induces a corrupted model that misbehaves in favor of the adversary. We consider poisoning attacks…

Machine Learning · Computer Science 2021-04-22 Fnu Suya , Saeed Mahloujifar , Anshuman Suri , David Evans , Yuan Tian

We propose a Byzantine-resilient federated conformal prediction (FCP) method that leverages partial model sharing, where only a subset of model parameters is exchanged each round. Unlike existing robust FCP approaches that primarily harden…

Machine Learning · Computer Science 2026-05-13 Ehsan Lari , Reza Arablouei , Stefan Werner

We propose a novel relaxation of the classic asynchronous network model, called the random asynchronous model, which removes adversarial message scheduling while preserving unbounded message delays and Byzantine faults. Instead of an…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-05-27 George Danezis , Jovan Komatovic , Lefteris Kokoris-Kogias , Alberto Sonnino , Igor Zablotchi

This paper studies distributed online convex optimization with time-varying coupled constraints, motivated by distributed online control in network systems. Most prior work assumes a separability condition: the global objective and coupled…

Optimization and Control · Mathematics 2026-02-18 Zhaoye Pan , Haozhe Lei , Fan Zuo , Zilin Bian , Tao Li

The standard model of online prediction deals with serial processing of inputs by a single processor. However, in large-scale online prediction problems, where inputs arrive at a high rate, an increasingly common necessity is to distribute…

Machine Learning · Computer Science 2010-12-08 Ofer Dekel , Ran Gilad-Bachrach , Ohad Shamir , Lin Xiao

Distributed learning has become a promising computational parallelism paradigm that enables a wide scope of intelligent applications from the Internet of Things (IoT) to autonomous driving and the healthcare industry. This paper studies…

Signal Processing · Electrical Eng. & Systems 2024-10-28 Yuhan Yang , Youlong Wu , Yuning Jiang , Yuanming Shi

Recent advancements in machine learning have improved performance while also increasing computational demands. While federated and distributed setups address these issues, their structures remain vulnerable to malicious influences. In this…

In this paper, we study the problem of resilient consensus for a multi-agent network where some of the nodes might be adversarial, attempting to prevent consensus by transmitting faulty values. Our approach is based on that of the so-called…

Multiagent Systems · Computer Science 2022-01-11 Liwei Yuan , Hideaki Ishii

As the network scale increases, existing fully distributed solutions start to lag behind the real-world challenges such as (1) slow information propagation, (2) network communication failures, and (3) external adversarial attacks. In this…

Machine Learning · Computer Science 2023-07-28 Connor Mclaughlin , Matthew Ding , Denis Edogmus , Lili Su