English
Related papers

Related papers: Byzantine-Robust Online and Offline Distributed Re…

200 papers

Federated learning (FL) enables multiple clients to collaboratively train machine learning models without revealing their private training data. In conventional FL, the system follows the server-assisted architecture (server-assisted FL),…

Cryptography and Security · Computer Science 2024-07-16 Minghong Fang , Zifan Zhang , Hairi , Prashant Khanduri , Jia Liu , Songtao Lu , Yuchen Liu , Neil Gong

This paper studies the problem of distributed stochastic optimization in an adversarial setting where, out of the $m$ machines which allegedly compute stochastic gradients every iteration, an $\alpha$-fraction are Byzantine, and can behave…

Machine Learning · Computer Science 2018-03-26 Dan Alistarh , Zeyuan Allen-Zhu , Jerry Li

In this paper, we study the challenging task of Byzantine-robust decentralized training on arbitrary communication graphs. Unlike federated learning where workers communicate through a server, workers in the decentralized environment can…

Machine Learning · Computer Science 2023-04-21 Lie He , Sai Praneeth Karimireddy , Martin Jaggi

We investigate the impact of Byzantine attacks in distributed detection under binary hypothesis testing. It is assumed that a fraction of the transmitted sensor measurements are compromised by the injected data from a Byzantine attacker,…

Information Theory · Computer Science 2019-05-27 Yuqing Ni , Kemi Ding , Yong Yang , Ling Shi

Conformal prediction has shown impressive capacity in constructing statistically rigorous prediction sets for machine learning models with exchangeable data samples. The siloed datasets, coupled with the escalating privacy concerns related…

Machine Learning · Computer Science 2024-06-05 Mintong Kang , Zhen Lin , Jimeng Sun , Cao Xiao , Bo Li

Evidence-based or data-driven dynamic treatment regimes are essential for personalized medicine, which can benefit from offline reinforcement learning (RL). Although massive healthcare data are available across medical institutions, they…

Machine Learning · Statistics 2024-01-30 Doudou Zhou , Yufeng Zhang , Aaron Sonabend-W , Zhaoran Wang , Junwei Lu , Tianxi Cai

Recently, decentralized learning has emerged as a popular peer-to-peer signal and information processing paradigm that enables model training across geographically distributed agents in a scalable manner, without the presence of any central…

Machine Learning · Computer Science 2024-07-12 Haoxiang Ye , Qing Ling

Byzantine Fault Tolerance (BFT) is one of the most challenging problems in Distributed Machine Learning (DML), defined as the resilience of a fault-tolerant system in the presence of malicious components. Byzantine failures are still…

Distributed, Parallel, and Cluster Computing · Computer Science 2022-12-06 Djamila Bouhata , Hamouma Moumen , Jocelyn Ahmed Mazari , Ahcène Bounceur

We study how to efficiently diffuse updates to a large distributed system of data replicas, some of which may exhibit arbitrary (Byzantine) failures. We assume that strictly fewer than $t$ replicas fail, and that each update is initially…

Distributed, Parallel, and Cluster Computing · Computer Science 2007-05-23 Dahlia Malkhi , Yishay Mansour , Michael Reiter

Modern distributed systems face growing security threats, as attackers continuously enhance their skills and vulnerabilities span across the entire system stack, from hardware to the application layer. In the system design phase, fault…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-11-07 Silvia Bonomi , Giovanni Farina , Roy Friedman , Eviatar B. Procaccia , Sebastien Tixeuil

We study a multi-agent resilient consensus problem, where some agents are of the Byzantine type and try to prevent the normal ones from reaching consensus. In our setting, normal agents communicate with each other asynchronously over…

Multiagent Systems · Computer Science 2024-03-13 Liwei Yuan , Hideaki Ishii

Distributed Federated Learning (DFL) enables decentralized model training across large-scale systems without a central parameter server. However, DFL faces three critical challenges: privacy leakage from honest-but-curious neighbors, slow…

Machine Learning · Computer Science 2026-02-24 Nuocheng Yang , Sihua Wang , Zhaohui Yang , Mingzhe Chen , Changchuan Yin , Kaibin Huang

This paper proposes a novel approach to resilient distributed optimization with quadratic costs in a networked control system (e.g., wireless sensor network, power grid, robotic team) prone to external attacks (e.g., hacking, power outage)…

Systems and Control · Electrical Eng. & Systems 2025-02-11 Luca Ballotta , Giacomo Como , Jeff S. Shamma , Luca Schenato

Self-stabilization is a versatile approach to fault-tolerance since it permits a distributed system to recover from any transient fault that arbitrarily corrupts the contents of all memories in the system. Byzantine tolerance is an…

Distributed, Parallel, and Cluster Computing · Computer Science 2011-02-11 Swan Dubois , Toshimitsu Masuzawa , Sébastien Tixeuil

In this paper, we focus on the question of the extent to which online learning can benefit from distributed computing. We focus on the setting in which $N$ agents online-learn cooperatively, where each agent only has access to its own data.…

Machine Learning · Computer Science 2019-08-17 Hua Ouyang , Alexander Gray

Offline or batch reinforcement learning seeks to learn a near-optimal policy using history data without active exploration of the environment. To counter the insufficient coverage and sample scarcity of many offline datasets, the principle…

Machine Learning · Computer Science 2022-06-14 Laixi Shi , Gen Li , Yuting Wei , Yuxin Chen , Yuejie Chi

This work focuses on the problem of distributed optimization in multi-agent cyberphysical systems, where a legitimate agent's iterates are influenced both by the values it receives from potentially malicious neighboring agents, and by its…

Robotics · Computer Science 2025-01-16 Michal Yemini , Angelia Nedić , Andrea J. Goldsmith , Stephanie Gil

To defend against Byzantine attacks in decentralized learning, most existing methods rely on robust aggregation rules to mitigate the influence of malicious machines. However, these strategies inherently introduce bias, leading to inexact…

Methodology · Statistics 2026-04-20 Siyuan Zhang , Chengde Qian , Xin Liu , Changliang Zou

Byzantine reliable broadcast is a fundamental primitive in distributed systems that allows a set of processes to agree on a message broadcast by a dedicated process, even when some of them are malicious (Byzantine). It guarantees that no…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-10-01 Veronika Anikina , João Paulo Bezerra , Petr Kuznetsov , Liron Schiff , Stefan Schmid

This paper addresses the problem of non-Bayesian learning over multi-agent networks, where agents repeatedly collect partially informative observations about an unknown state of the world, and try to collaboratively learn the true state. We…

Distributed, Parallel, and Cluster Computing · Computer Science 2016-06-30 Lili Su , Nitin H. Vaidya