English
Related papers

Related papers: Byzantine Distributed Function Computation

200 papers

Distributed learning has emerged as a leading paradigm for training large machine learning models. However, in real-world scenarios, participants may be unreliable or malicious, posing a significant challenge to the integrity and accuracy…

Machine Learning · Computer Science 2024-06-10 Grigory Malinovsky , Peter Richtárik , Samuel Horváth , Eduard Gorbunov

The cooperative bandit problem is a multi-agent decision problem involving a group of agents that interact simultaneously with a multi-armed bandit, while communicating over a network with delays. The central idea in this problem is to…

Machine Learning · Statistics 2022-05-31 Abhimanyu Dubey , Alex Pentland

Recent advances in large-scale distributed learning algorithms have enabled communication-efficient training via SignSGD. Unfortunately, a major issue continues to plague distributed learning: namely, Byzantine failures may incur serious…

Information Theory · Computer Science 2020-10-27 Jy-yong Sohn , Dong-Jun Han , Beongjun Choi , Jaekyun Moon

We investigate the impact of Byzantine attacks in distributed detection under binary hypothesis testing. It is assumed that a fraction of the transmitted sensor measurements are compromised by the injected data from a Byzantine attacker,…

Information Theory · Computer Science 2019-05-27 Yuqing Ni , Kemi Ding , Yong Yang , Ling Shi

Distributed learning has become a necessity for training ever-growing models by sharing calculation among several devices. However, some of the devices can be faulty, deliberately or not, preventing the proper convergence. As a matter of…

Machine Learning · Computer Science 2022-02-08 Jason Akoun , Sebastien Meyer

The multi-user linearly-separable distributed computing problem is considered here, in which $N$ servers help to compute the real-valued functions requested by $K$ users, where each function can be written as a linear combination of up to…

Information Theory · Computer Science 2023-01-10 Ali Khalesi , Sajad Daei , Marios Kountouris , Petros Elia

Adversarial attacks during training can strongly influence the performance of multi-agent reinforcement learning algorithms. It is, thus, highly desirable to augment existing algorithms such that the impact of adversarial attacks on…

Machine Learning · Computer Science 2021-11-19 Martin Figura , Yixuan Lin , Ji Liu , Vijay Gupta

Byzantine fault tolerance (BFT) has been extensively studied in distributed trustless systems to guarantee system's functioning when up to 1/3 Byzantine processes exist. Despite a plethora of previous work in BFT systems, they are mainly…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-02-11 Quan Nguyen , Andre Cronje

In this paper, a fully distributed averaging algorithm in the presence of adversarial Byzantine agents is proposed. The algorithm is based on a resilient retrieval procedure, where all non-Byzantine nodes send their own initial values and…

Multiagent Systems · Computer Science 2021-07-28 Mostafa Safi , Seyed Mehran Dibaji

This paper studies distributed online learning under Byzantine attacks. The performance of an online learning algorithm is often characterized by (adversarial) regret, which evaluates the quality of one-step-ahead decision-making when an…

Machine Learning · Computer Science 2023-12-06 Xingrong Dong , Zhaoxian Wu , Qing Ling , Zhi Tian

Byzantine reliable broadcast is a fundamental problem in distributed computing, which has been studied extensively over the past decades. State-of-the-art algorithms are predominantly based on the approach to share encoded fragments of the…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-01-06 Thomas Locher

Many areas of deep learning benefit from using increasingly larger neural networks trained on public data, as is the case for pre-trained models for NLP and computer vision. Training such models requires a lot of computational resources…

Machine Learning · Computer Science 2023-01-03 Eduard Gorbunov , Alexander Borzunov , Michael Diskin , Max Ryabinin

We study the problem of Byzantine fault tolerance in a distributed optimization setting, where there is a group of $N$ agents communicating with a trusted centralized coordinator. Among these agents, there is a subset of $f$ agents that may…

Optimization and Control · Mathematics 2023-12-19 Amit Dutta , Thinh T. Doan , Jeffrey H. Reed

In this work, we consider the distributed stochastic optimization problem of minimizing a non-convex function $f(x) = \mathbb{E}_{\xi \sim \mathcal{D}} f(x; \xi)$ in an adversarial setting, where the individual functions $f(x; \xi)$ can…

Optimization and Control · Mathematics 2019-12-11 Prashant Khanduri , Saikiran Bulusu , Pranay Sharma , Pramod K. Varshney

Distributed learning has become a promising computational parallelism paradigm that enables a wide scope of intelligent applications from the Internet of Things (IoT) to autonomous driving and the healthcare industry. This paper studies…

Signal Processing · Electrical Eng. & Systems 2024-10-28 Yuhan Yang , Youlong Wu , Yuning Jiang , Yuanming Shi

We propose a model for deterministic distributed function computation by a network of identical and anonymous nodes. In this model, each node has bounded computation and storage capabilities that do not grow with the network size.…

Optimization and Control · Mathematics 2011-06-28 Julien M. Hendrickx , Alex Olshevsky , John N. Tsitsiklis

We propose a model for deterministic distributed function computation by a network of identical and anonymous nodes, with bounded computation and storage capabilities that do not scale with the network size. Our goal is to characterize the…

Distributed, Parallel, and Cluster Computing · Computer Science 2009-07-28 Julien M. Hendrickx , Alex Olshevsky , John N. Tsitsiklis

Numerous distributed tasks have to be handled in a setting where a fraction of nodes behaves Byzantine, that is, deviates arbitrarily from the intended protocol. Resilient, deterministic protocols rely on the detection of majorities to…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-02-10 Philipp Schneider

We consider a distributed function computation problem in which parties observing noisy versions of a remote source facilitate the computation of a function of their observations at a fusion center through public communication. The…

Information Theory · Computer Science 2022-03-30 Onur Günlü , Matthieu Bloch , Rafael F. Schaefer

Numerous distributed applications, such as cloud computing and distributed ledgers, necessitate the system to invoke asynchronous consensus objects an unbounded number of times, where the completion of one consensus instance is followed by…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-07-28 Chryssis Georgiou , Michel Raynal , Elad M. Schiller