English
Related papers

Related papers: Partial Model Sharing Improves Byzantine Resilienc…

200 papers

Distributed peer-to-peer (P2P) energy trading mandates an escalating coupling between the physical power network and communication network, necessitating high-frequency sharing of real-time data among prosumers. However, this data-sharing…

Systems and Control · Electrical Eng. & Systems 2025-05-28 Junhong Liu , Qinfei Long , Rong-Peng Liu , Wenjie Liu , Yunhe Hou

Federated Learning (FL) paradigms enable large numbers of clients to collaboratively train Machine Learning models on private data. However, due to their multi-party nature, traditional FL schemes are left vulnerable to Byzantine attacks…

Machine Learning · Computer Science 2024-10-31 Atharv Deshmukh

Sybil attacks, in which a large number of adversary-controlled nodes join a network, are a concern for many peer-to-peer database systems, necessitating expensive countermeasures such as proof-of-work. However, there is a category of…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-12-02 Martin Kleppmann , Heidi Howard

We present a partially personalized formulation of Federated Learning (FL) that strikes a balance between the flexibility of personalization and cooperativeness of global training. In our framework, we split the variables into global…

Machine Learning · Computer Science 2023-05-30 Konstantin Mishchenko , Rustem Islamov , Eduard Gorbunov , Samuel Horváth

We consider a simple, yet widely studied, set-up in which a Fusion Center (FC) is asked to make a binary decision about a sequence of system states by relying on the possibly corrupted decisions provided by byzantine nodes, i.e. nodes which…

Systems and Control · Computer Science 2017-02-28 Andrea Abrardo , Mauro Barni , Kassem Kallas , Benedetta Tondi

Recent Byzantine fault-tolerant (BFT) state machine replication (SMR) protocols increasingly focus on scalability to meet the requirements of distributed ledger technology (DLT). Validating the performance of scalable BFT protocol…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-10-02 Christian Berger , Sadok Ben Toumia , Hans P. Reiser

Conformal Prediction (CP) is a popular uncertainty quantification method that provides distribution-free, statistically valid prediction sets, assuming that training and test data are exchangeable. In such a case, CP's prediction sets are…

Logic in Computer Science · Computer Science 2024-11-19 Linus Jeary , Tom Kuipers , Mehran Hosseini , Nicola Paoletti

Byzantine machine learning (ML) aims to ensure the resilience of distributed learning algorithms to misbehaving (or Byzantine) machines. Although this problem received significant attention, prior works often assume the data held by the…

Machine Learning · Computer Science 2023-02-06 Youssef Allouah , Sadegh Farhadkhani , Rachid Guerraoui , Nirupam Gupta , Rafael Pinot , John Stephan

We revisit Byzantine robust distributed estimation for high-dimensional sparse linear models. By combining local $\ell_1$-regularized robust estimation with robust aggregation at the server, the framework applies to pseudo-Huber regression,…

Machine Learning · Computer Science 2026-05-14 Yuxuan Wang , Lixin Zhang , Kangqiang Li

Standard federated learning algorithms are vulnerable to adversarial nodes, a.k.a. Byzantine failures. To solve this issue, robust distributed learning algorithms have been developed, which typically replace parameter averaging by robust…

Machine Learning · Computer Science 2026-02-04 Renaud Gaucher , Aymeric Dieuleveut , Hadrien Hendrikx

Multi-armed bandits (MAB) is a sequential decision-making model in which the learner controls the trade-off between exploration and exploitation to maximize its cumulative reward. Federated multi-armed bandits (FMAB) is an emerging…

Machine Learning · Computer Science 2025-02-18 Artun Saday , İlker Demirel , Yiğit Yıldırım , Cem Tekin

This paper introduces a deterministic Byzantine consensus algorithm that relies on a new weak coordinator. As opposed to previous algorithms that cannot terminate in the presence of a faulty or slow coordinator, our algorithm can terminate…

Distributed, Parallel, and Cluster Computing · Computer Science 2018-07-26 Tyler Crain , Vincent Gramoli , Mikel Larrea , Michel Raynal

We consider a distributed reinforcement learning setting where multiple agents separately explore the environment and communicate their experiences through a central server. However, $\alpha$-fraction of agents are adversarial and can…

Machine Learning · Computer Science 2022-06-02 Yiding Chen , Xuezhou Zhang , Kaiqing Zhang , Mengdi Wang , Xiaojin Zhu

We study distributed optimization in the presence of Byzantine adversaries, where both data and computation are distributed among $m$ worker machines, $t$ of which may be corrupt. The compromised nodes may collaboratively and arbitrarily…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-11-05 Deepesh Data , Linqi Song , Suhas Diggavi

As the network scale increases, existing fully distributed solutions start to lag behind the real-world challenges such as (1) slow information propagation, (2) network communication failures, and (3) external adversarial attacks. In this…

Machine Learning · Computer Science 2023-07-28 Connor Mclaughlin , Matthew Ding , Denis Edogmus , Lili Su

Decentralized learning has gained great popularity to improve learning efficiency and preserve data privacy. Each computing node makes equal contribution to collaboratively learn a Deep Learning model. The elimination of centralized…

Machine Learning · Computer Science 2021-10-22 Shangwei Guo , Tianwei Zhang , Han Yu , Xiaofei Xie , Lei Ma , Tao Xiang , Yang Liu

Conformal Prediction (CP) is a widely used technique for quantifying uncertainty in machine learning models. In its standard form, CP offers probabilistic guarantees on the coverage of the true label, but it is agnostic to sensitive…

Machine Learning · Computer Science 2025-09-30 Anutam Srinivasan , Aditya T. Vadlamani , Amin Meghrazi , Srinivasan Parthasarathy

We propose a novel robust aggregation rule for distributed synchronous Stochastic Gradient Descent~(SGD) under a general Byzantine failure model. The attackers can arbitrarily manipulate the data transferred between the servers and the…

Distributed, Parallel, and Cluster Computing · Computer Science 2018-05-25 Cong Xie , Oluwasanmi Koyejo , Indranil Gupta

Distributed algorithms provide flexibility over centralized algorithms for resource allocation problems, e.g., cyber-physical systems. However, the distributed nature of these algorithms often makes the systems susceptible to…

Optimization and Control · Mathematics 2019-09-11 Cesar A. Uribe , Hoi-To Wai , Mahnoosh Alizadeh

As the scale of federated learning (FL) systems expands, their inherent performance limitations like communication overhead, Byzantine vulnerability, and privacy leakage have become increasingly critical. This paper considers a personalized…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-07-08 Muhang Lan , Song Xiao , Wenyi Zhang