中文
相关论文

相关论文: Straggler Resilient Serverless Computing Based on …

200 篇论文

Coded distributed computing has been considered as a promising technique which makes large-scale systems robust to the "straggler" workers. Yet, practical system models for distributed computing have not been available that reflect the…

信息论 · 计算机科学 2019-01-17 Muah Kim , Jy-yong Sohn , Jaekyun Moon

In distributed machine learning, a central node outsources computationally expensive calculations to external worker nodes. The properties of optimization procedures like stochastic gradient descent (SGD) can be leveraged to mitigate the…

分布式、并行与集群计算 · 计算机科学 2023-04-19 Maximilian Egger , Serge Kas Hanna , Rawad Bitar

Coded elastic computing, introduced by Yang et al. in 2018, is a technique designed to mitigate the impact of elasticity in cloud computing systems, where machines can be preempted or be added during computing rounds. This approach utilizes…

信息论 · 计算机科学 2025-02-03 Xi Zhong , Samuel Lu , Joerg Kliewer , Mingyue Ji

Serverless computing has emerged as a new paradigm for running short-lived computations in the cloud. Due to its ability to handle IoT workloads, there has been considerable interest in running serverless functions at the edge. However, the…

分布式、并行与集群计算 · 计算机科学 2021-05-03 Bin Wang , Ahmed Ali-Eldin , Prashant Shenoy

Distributed implementations of gradient-based methods, wherein a server distributes gradient computations across worker machines, need to overcome two limitations: delays caused by slow running machines called 'stragglers', and…

信息论 · 计算机科学 2020-05-15 Swanand Kadhe , O. Ozan Koyluoglu , Kannan Ramchandran

Distributed computing has become a common approach for large-scale computation of tasks due to benefits such as high reliability, scalability, computation speed, and costeffectiveness. However, distributed computing faces critical issues…

分布式、并行与集群计算 · 计算机科学 2020-08-21 Jer Shyuan Ng , Wei Yang Bryan Lim , Nguyen Cong Luong , Zehui Xiong , Alia Asheralieva , Dusit Niyato , Cyril Leung , Chunyan Miao

Serverless computing provides just-in-time infrastructure provisioning with rapid elasticity and a finely-grained pricing model. As full control of resource allocation is in the hands of the cloud provider and applications only consume…

分布式、并行与集群计算 · 计算机科学 2025-10-10 Natalie Carl , Tobias Pfandzelter , David Bermbach

Serverless computing has attracted a broad range of applications due to its ease of use and resource elasticity. However, developing serverless applications often poses a dilemma -- relying on general-purpose serverless platforms can fall…

分布式、并行与集群计算 · 计算机科学 2025-07-17 Minchen Yu , Yinghao Ren , Jiamu Zhao , Jiaqi Li

We consider distributed learning in the presence of slow and unresponsive worker nodes, referred to as stragglers. In order to mitigate the effect of stragglers, gradient coding redundantly assigns partial computations to the worker such…

信息论 · 计算机科学 2022-12-19 Luis Maßny , Christoph Hofmeister , Maximilian Egger , Rawad Bitar , Antonia Wachter-Zeh

This paper introduces REDC, a comprehensive strategy for offloading computational tasks within mobile Edge Networks (EN) to Distributed Computing (DC) after Rateless Encoding (RE). Despite the efficiency, reliability, and scalability…

分布式、并行与集群计算 · 计算机科学 2024-09-24 Zhongfu Guo , Xinsheng Ji , Wei You , Yu Zhao , Bai Yi , Lingwei Wang

We consider the distributed computing problem of multiplying a set of vectors with a matrix. For this scenario, Li et al. recently presented a unified coding framework and showed a fundamental tradeoff between computational delay and…

信息论 · 计算机科学 2017-09-19 Albin Severinson , Alexandre Graell i Amat , Eirik Rosnes

Elasticity is offered by cloud service providers to exploit under-utilized computing resources. The low-cost elastic nodes can leave and join any time during the computation cycle. The possibility of elastic events occurring together with…

分布式、并行与集群计算 · 计算机科学 2022-06-24 Shahrzad Kiani , Tharindu Adikari , Stark C. Draper

Serverless computing is transforming cloud application development, but the performance-cost trade-offs of control plane designs remain poorly understood due to a lack of open, cross-platform benchmarks and detailed system analyses. In this…

分布式、并行与集群计算 · 计算机科学 2025-09-04 Leonid Kondrashov , Boxi Zhou , Hancheng Wang , Dmitrii Ustiugov

Slow working nodes, known as stragglers, can greatly reduce the speed of distributed computation. Coded matrix multiplication is a recently introduced technique that enables straggler-resistant distributed multiplication of large matrices.…

信息论 · 计算机科学 2019-07-23 Shahrzad Kiani , Nuwan Ferdinand , Stark C. Draper

Slow running or straggler tasks can significantly reduce computation speed in distributed computation. Recently, coding-theory-inspired approaches have been applied to mitigate the effect of straggling, through embedding redundancy in…

机器学习 · 统计学 2018-01-24 Can Karakus , Yifan Sun , Suhas Diggavi , Wotao Yin

We consider the setting of a Master server, M, who possesses confidential data (e.g., personal, genomic or medical data) and wants to run intensive computations on it, as part of a machine learning algorithm for example. The Master wants to…

信息论 · 计算机科学 2026-01-01 Rawad Bitar , Parimal Parag , Salim El Rouayheb

Serverless computing is increasingly being used for parallel computing, which have traditionally been implemented as stateful applications. Executing complex, burst-parallel, directed acyclic graph (DAG) jobs poses a major challenge for…

分布式、并行与集群计算 · 计算机科学 2020-10-15 Benjamin Carver , Jingyuan Zhang , Ao Wang , Ali Anwar , Panruo Wu , Yue Cheng

Recently, serverless computing has gained recognition as a leading cloud computing method. Providing a solution that does not require direct server and infrastructure management, this technology has addressed many traditional model problems…

分布式、并行与集群计算 · 计算机科学 2025-01-20 Mohsen Ghorbian , Mostafa Ghobaei-Arani

Distributed computation is a framework used to break down a complex computational task into smaller tasks and distributing them among computational nodes. Erasure correction codes have recently been introduced and have become a popular…

信息论 · 计算机科学 2021-08-17 Royee Yosibash , Ram Zamir

A rateless coding scheme transmits incrementally more and more coded bits over an unknown channel until all the information bits are decoded reliably by the receiver. We propose a new rateless coding scheme based on polar codes, and we show…

信息论 · 计算机科学 2015-08-14 Bin Li , David Tse , Kai Chen , Hui Shen