中文
相关论文

相关论文: Straggler Resilient Serverless Computing Based on …

200 篇论文

Within distributed learning, workers typically compute gradients on their assigned dataset chunks and send them to the parameter server (PS), which aggregates them to compute either an exact or approximate version of $\nabla L$ (gradient of…

信息论 · 计算机科学 2024-11-19 Aditya Ramamoorthy , Ruoyu Meng , Vrinda S. Girimaji

Distributed matrix multiplication is widely used in several scientific domains. It is well recognized that computation times on distributed clusters are often dominated by the slowest workers (called stragglers). Recent work has…

分布式、并行与集群计算 · 计算机科学 2018-11-08 Li Tang , Konstantinos Konstantinidis , Aditya Ramamoorthy

Coded computing is an effective technique to mitigate "stragglers" in large-scale and distributed matrix multiplication. In particular, univariate polynomial codes have been shown to be effective in straggler mitigation by making the…

信息论 · 计算机科学 2021-08-19 Burak Hasircioglu , Jesus Gomez-Vilardebo , Deniz Gunduz

The long-haul communication systems can offer ultra high-speed data transfer rates but suffer from burst errors. The high-rate and high-performance staircase codes provide an efficient way for long-haul transmission. The staircase coding…

信息论 · 计算机科学 2018-05-28 Bowen Feng , Jian Jiao , Liu Zhou , Shaohua Wu , Bin Cao , Qinyu Zhang

Cloud computing offers on-demand, scalable computing and storage, and has become an essential resource for the analyses of big biomedical data. The usual approach to cloud computing requires users to reserve and provision virtual servers.…

定量方法 · 定量生物学 2018-08-01 Dimitar Kumanov , Ling-Hong Hung , Wes Lloyd , Ka Yee Yeung

Serverless computing -- an emerging cloud-native paradigm for the deployment of applications and services -- represents an evolution in cloud application development, programming models, abstractions, and platforms. It promises a real…

分布式、并行与集群计算 · 计算机科学 2019-06-10 Paul Castro , Vatche Ishakian , Vinod Muthusamy , Aleksander Slominski

The promise of ultimate elasticity and operational simplicity of serverless computing has recently lead to an explosion of research in this area. In the context of data analytics, the concept sounds appealing, but due to the limitations of…

数据库 · 计算机科学 2020-05-11 Ingo Müller , Renato Marroquín , Gustavo Alonso

In this paper, we consider a large network containing many regions such that each region is equipped with a worker with some data processing and communication capability. For such a network, some workers may become stragglers due to the…

系统与控制 · 电气工程与系统科学 2022-04-14 Elie Atallah , Nazanin Rahnavard , Qiyu Sun

Polar codes represent one of the major recent breakthroughs in coding theory and, because of their attractive features, they have been selected for the incoming 5G standard. As such, a lot of attention has been devoted to the development of…

信息论 · 计算机科学 2017-08-31 Seyyed Ali Hashemi , Marco Mondelli , S. Hamed Hassani , Rudiger Urbanke , Warren J. Gross

We construct a channel coding scheme to achieve the capacity of any discrete memoryless channel based solely on the techniques of polar coding. In particular, we show how source polarization and randomness extraction via polarization can be…

信息论 · 计算机科学 2016-01-22 David Sutter , Joseph M. Renes , Frédéric Dupuis , Renato Renner

Cloud computing refers to maximizing efficiency by sharing computational and storage resources, while data-parallel systems exploit the resources available in the cloud to perform parallel transformations over large amounts of data. In the…

数据库 · 计算机科学 2018-07-10 Matteo Interlandi , Letizia Tanca

Serverless computing offers attractive scalability, elasticity and cost-effectiveness. However, constraints on memory, CPU and function runtime have hindered its adoption for data-intensive applications and machine learning (ML) workloads.…

分布式、并行与集群计算 · 计算机科学 2024-03-25 Joe Oakley , Hakan Ferhatosmanoglu

Serverless computing is an emerging cloud paradigm with serverless functions at its core. While serverless environments enable software developers to focus on developing applications without the need to actively manage the underlying…

密码学与安全 · 计算机科学 2024-08-06 Danielle Lavi , Oleg Brodt , Dudu Mimran , Yuval Elovici , Asaf Shabtai

We consider the problem of massive matrix multiplication, which underlies many data analytic applications, in a large-scale distributed system comprising a group of worker nodes. We target the stragglers' delay performance bottleneck, which…

信息论 · 计算机科学 2020-04-10 Qian Yu , Mohammad Ali Maddah-Ali , A. Salman Avestimehr

Recent works recognized lidars as an inherently streaming data source and showed that the end-to-end latency of lidar perception models can be reduced significantly by operating on wedge-shaped point cloud sectors rather then the full point…

计算机视觉与模式识别 · 计算机科学 2022-03-25 Qi Chen , Sourabh Vora , Oscar Beijbom

Several researchers have proposed solutions for secure data outsourcing on the public clouds based on encryption, secret-sharing, and trusted hardware. Existing approaches, however, exhibit many limitations including high computational…

数据库 · 计算机科学 2018-12-06 Sharad Mehrotra , Kerim Yasin Oktay , Shantanu Sharma

Coded distributed computing framework enables large-scale machine learning (ML) models to be trained efficiently in a distributed manner, while mitigating the straggler effect. In this work, we consider a multi-task assignment problem in a…

信息论 · 计算机科学 2019-05-21 Yuxuan Sun , Junlin Zhao , Sheng Zhou , Deniz Gündüz

In large-scale distributed computing clusters, such as Amazon EC2, there are several types of "system noise" that can result in major degradation of performance: bottlenecks due to limited communication bandwidth, latency due to straggler…

分布式、并行与集群计算 · 计算机科学 2019-06-21 Amirhossein Reisizadeh , Saurav Prakash , Ramtin Pedarsani , Amir Salman Avestimehr

Federated unlearning has emerged as a promising paradigm to erase the client-level data effect without affecting the performance of collaborative learning models. However, the federated unlearning process often introduces extensive storage…

机器学习 · 计算机科学 2024-01-30 Yijing Lin , Zhipeng Gao , Hongyang Du , Dusit Niyato , Gui Gui , Shuguang Cui , Jinke Ren

Runtime performance variability at the servers has been a major issue, hindering the predictable and scalable performance in modern distributed systems. Executing requests or jobs redundantly over multiple servers has been shown to be…

性能 · 计算机科学 2019-10-10 Mehmet Fatih Aktas , Emina Soljanin