中文
相关论文

相关论文: Adaptive Verifiable Coded Computing: Towards Fast,…

200 篇论文

Motivated, in part, by the rise of permissionless systems such as Bitcoin where arbitrary nodes (whose identities are not known apriori) can join and leave at will, we extend established research in scalable Byzantine agreement to a more…

分布式、并行与集群计算 · 计算机科学 2019-07-26 John Augustine , Valerie King , Anisur R. Molla , Gopal Pandurangan , Jared Saia

Computationally intensive distributed and parallel computing is often bottlenecked by a small set of slow workers known as stragglers. In this paper, we utilize the emerging idea of "coded computation" to design a novel…

信息论 · 计算机科学 2017-06-06 Yaoqing Yang , Pulkit Grover , Soummya Kar

In large-scale distributed computing clusters, such as Amazon EC2, there are several types of "system noise" that can result in major degradation of performance: bottlenecks due to limited communication bandwidth, latency due to straggler…

分布式、并行与集群计算 · 计算机科学 2019-06-21 Amirhossein Reisizadeh , Saurav Prakash , Ramtin Pedarsani , Amir Salman Avestimehr

This paper introduces REDC, a comprehensive strategy for offloading computational tasks within mobile Edge Networks (EN) to Distributed Computing (DC) after Rateless Encoding (RE). Despite the efficiency, reliability, and scalability…

分布式、并行与集群计算 · 计算机科学 2024-09-24 Zhongfu Guo , Xinsheng Ji , Wei You , Yu Zhao , Bai Yi , Lingwei Wang

We study distributed stochastic gradient descent (SGD) in the master-worker architecture under Byzantine attacks. We consider the heterogeneous data model, where different workers may have different local datasets, and we do not make any…

机器学习 · 统计学 2020-05-19 Deepesh Data , Suhas Diggavi

Vehicular cloud computing (VCC) is proposed to effectively utilize and share the computing and storage resources on vehicles. However, due to the mobility of vehicles, the network topology, the wireless channel states and the available…

信息论 · 计算机科学 2018-04-04 Yuxuan Sun , Xueying Guo , Sheng Zhou , Zhiyuan Jiang , Xin Liu , Zhisheng Niu

Conventional coded computing frameworks are predominantly tailored for structured computations, such as matrix multiplication and polynomial evaluation. Such tasks allow the reuse of tools and techniques from algebraic coding theory to…

分布式、并行与集群计算 · 计算机科学 2025-02-13 Parsa Moradi , Hanzaleh Akbarinodehi , Mohammad Ali Maddah-Ali

Distributed machine learning algorithms enable learning of models from datasets that are distributed over a network without gathering the data at a centralized location. While efficient distributed algorithms have been developed under the…

机器学习 · 计算机科学 2020-07-07 Zhixiong Yang , Waheed U. Bajwa

We study the problem of computing matrix chain multiplications in a distributed computing cluster. In such systems, performance is often limited by the straggler problem, where the slowest worker dominates the overall computation latency.…

信息论 · 计算机科学 2026-01-14 Jesús Gómez-Vilardebò

In large-scale distributed learning, security issues have become increasingly important. Particularly in a decentralized environment, some computing units may behave abnormally, or even exhibit Byzantine failures -- arbitrary and…

机器学习 · 计算机科学 2021-02-26 Dong Yin , Yudong Chen , Kannan Ramchandran , Peter Bartlett

The current BigData era routinely requires the processing of large scale data on massive distributed computing clusters. Such large scale clusters often suffer from the problem of "stragglers", which are defined as slow or failed nodes. The…

信息论 · 计算机科学 2020-02-11 Aditya Ramamoorthy , Anindya Bijoy Das , Li Tang

Federated learning systems that jointly preserve Byzantine robustness and privacy have remained an open problem. Robust aggregation, the standard defense for Byzantine attacks, generally requires server access to individual updates or…

密码学与安全 · 计算机科学 2021-10-07 Raj Kiriti Velicheti , Derek Xia , Oluwasanmi Koyejo

Coded computing is an effective technique to mitigate "stragglers" in large-scale and distributed matrix multiplication. In particular, univariate polynomial codes have been shown to be effective in straggler mitigation by making the…

信息论 · 计算机科学 2021-08-19 Burak Hasircioglu , Jesus Gomez-Vilardebo , Deniz Gunduz

Distributed Learning often suffers from Byzantine failures, and there have been a number of works studying the problem of distributed stochastic optimization under Byzantine failures, where only a portion of workers, instead of all the…

分布式、并行与集群计算 · 计算机科学 2021-08-17 Kaiyun Li , Xiaojun Chen , Ye Dong , Peng Zhang , Dakui Wang , Shuai Zen

Recent years have witnessed a slew of coding techniques custom designed for networked storage systems. Network coding inspired regenerating codes are the most prolifically studied among these new age storage centric codes. A lot of effort…

分布式、并行与集群计算 · 计算机科学 2011-06-14 Frédérique Oggier , Anwitaman Datta

State-of-the-art machine learning models are routinely trained on large-scale distributed clusters. Crucially, such systems can be compromised when some of the computing devices exhibit abnormal (Byzantine) behavior and return arbitrary…

机器学习 · 计算机科学 2022-01-25 Konstantinos Konstantinidis , Aditya Ramamoorthy

This paper introduces a new way to incorporate verifiable secret sharing (VSS) schemes into Byzantine Fault Tolerance (BFT) protocols. This technique extends the threshold guarantee of classical Byzantine Fault Tolerant algorithms to…

密码学与安全 · 计算机科学 2018-12-27 Soumya Basu , Alin Tomescu , Ittai Abraham , Dahlia Malkhi , Michael K. Reiter , Emin Gün Sirer

Existing approaches to distributed matrix computations involve allocating coded combinations of submatrices to worker nodes, to build resilience to stragglers and/or enhance privacy. In this study, we consider the challenge of preserving…

信息论 · 计算机科学 2023-08-09 Anindya Bijoy Das , Aditya Ramamoorthy , David J. Love , Christopher G. Brinton

Jointly addressing Byzantine attacks and privacy leakage in distributed machine learning (DML) has become an important issue. A common strategy involves integrating Byzantine-resilient aggregation rules with differential privacy mechanisms.…

机器学习 · 计算机科学 2025-06-19 Bing Liu , Chengcheng Zhao , Li Chai , Peng Cheng , Yaonan Wang

Edge computing has recently emerged as a promising paradigm to boost the performance of distributed learning by leveraging the distributed resources at edge nodes. Architecturally, the introduction of edge nodes adds an additional…

网络与互联网体系结构 · 计算机科学 2024-06-18 Weiheng Tang , Jingyi Li , Lin Chen , Xu Chen