中文
相关论文

相关论文: Straggler Resilient Serverless Computing Based on …

200 篇论文

Gradient descent (GD) methods are commonly employed in machine learning problems to optimize the parameters of the model in an iterative fashion. For problems with massive datasets, computations are distributed to many parallel computing…

信息论 · 计算机科学 2019-03-06 Emre Ozfatura , Deniz Gunduz , Sennur Ulukus

The increasing use of hardware processing accelerators tailored for specific applications, such as the Vision Processing Unit (VPU) for image recognition, further increases developers' configuration, development, and management overhead.…

分布式、并行与集群计算 · 计算机科学 2022-08-08 Sebastian Werner , Trever Schirmer

Conventional coded computing frameworks are predominantly tailored for structured computations, such as matrix multiplication and polynomial evaluation. Such tasks allow the reuse of tools and techniques from algebraic coding theory to…

分布式、并行与集群计算 · 计算机科学 2025-02-13 Parsa Moradi , Hanzaleh Akbarinodehi , Mohammad Ali Maddah-Ali

Gradient-based distributed learning in Parameter Server (PS) computing architectures is subject to random delays due to straggling worker nodes, as well as to possible communication bottlenecks between PS and workers. Solutions have been…

信息论 · 计算机科学 2020-04-09 Jingjing Zhang , Osvaldo Simeone

Serverless computing platforms currently rely on basic pricing schemes that are static and do not reflect customer feedback. This leads to significant inefficiencies from a total utility perspective. As one of the fastest-growing cloud…

分布式、并行与集群计算 · 计算机科学 2022-01-26 Vipul Gupta , Soham Phade , Thomas Courtade , Kannan Ramchandran

Deploying Convolutional Neural Networks (CNNs) on resource-constrained devices necessitates efficient management of computational resources, often via distributed environments susceptible to latency from straggler nodes. This paper…

分布式、并行与集群计算 · 计算机科学 2025-09-09 Shuo Tan , Rui Liu , Xuesong Han , XianLei Long , Kai Wan , Linqi Song , Yong Li

Polar codes are a class of linear block codes that provably achieves channel capacity. They have been selected as a coding scheme for the control channel of enhanced mobile broadband (eMBB) scenario for $5^{\text{th}}$ generation wireless…

硬件体系结构 · 计算机科学 2020-06-04 Furkan Ercan , Thibaud Tonnellier , Carlo Condo , Warren J. Gross

Building on the previous work of Lee et al. and Ferdinand et al. on coded computation, we propose a sequential approximation framework for solving optimization problems in a distributed manner. In a distributed computation system, latency…

信息论 · 计算机科学 2017-10-26 Jingge Zhu , Ye Pu , Vipul Gupta , Claire Tomlin , Kannan Ramchandran

Placement delivery arrays for distributed computing (Comp-PDAs) have recently been proposed as a framework to construct universal computing schemes for MapReduce-like systems. In this work, we extend this concept to systems with straggling…

信息论 · 计算机科学 2020-04-28 Qifa Yan , Michèle Wigger , Sheng Yang , Xiaohu Tang

We consider a generalization of the gradient coding framework where a dataset is divided across $n$ workers and each worker transmits to a master node one or more linear combinations of the gradients over its assigned data subsets. Unlike…

信息论 · 计算机科学 2022-05-03 Sahasrajit Sarmasarkar , V. Lalitha , Nikhil Karamchandani

Elasticity is one important feature in modern cloud computing systems and can result in computation failure or significantly increase computing time. Such elasticity means that virtual machines over the cloud can be preempted under a short…

分布式、并行与集群计算 · 计算机科学 2021-07-26 Mingyue Ji , Xiang Zhang , Kai Wan

Long polar codes can achieve the capacity of arbitrary binary-input discrete memoryless channels under a low complexity successive cancelation (SC) decoding algorithm. But for polar codes with short and moderate code length, the decoding…

信息论 · 计算机科学 2016-11-18 Jun Lin , Chenrong Xiong , Zhiyuan Yan

Resistive memories are considered a promising memory technology enabling high storage densities with in-memory computing capabilities. However, the readout reliability of resistive memories is impaired due to the inevitable existence of…

信息论 · 计算机科学 2019-04-22 Marwen Zorgui , Mohammed E. Fouda , Zhiying Wang , Ahmed M. Eltawil , Fadi Kurdahi

Serverless computing is an emerging cloud computing paradigm that has been applied to various domains, including machine learning, scientific computing, video processing, etc. To develop serverless computing-based software applications…

软件工程 · 计算机科学 2022-07-28 Jinfeng Wen , Zhenpeng Chen , Xuanzhe Liu

Coded computing has demonstrated promising results in addressing straggler resiliency in distributed computing systems. However, most coded computing schemes are designed for exact computation, requiring the number of responding servers to…

分布式、并行与集群计算 · 计算机科学 2026-03-26 Parsa Moradi , Mohammad Ali Maddah-Ali

Aggregated HPC resources have rigid allocation systems and programming models which struggle to adapt to diverse and changing workloads. Consequently, HPC systems fail to efficiently use the large pools of unused memory and increase the…

分布式、并行与集群计算 · 计算机科学 2024-07-29 Marcin Copik , Marcin Chrapek , Larissa Schmid , Alexandru Calotoiu , Torsten Hoefler

Serverless computing is an emerging cloud paradigm that offers an elastic and scalable allocation of computing resources with pay-as-you-go billing. In the Function-as-a-Service (FaaS) programming model, applications comprise short-lived…

分布式、并行与集群计算 · 计算机科学 2023-11-23 Wei Qiu , Marcin Copik , Yun Wang , Alexandru Calotoiu , Torsten Hoefler

Gradient coding schemes effectively mitigate full stragglers in distributed learning by introducing identical redundancy in coded local partial derivatives corresponding to all model parameters. However, they are no longer effective for…

信息论 · 计算机科学 2023-04-26 Qi Wang , Ying Cui , Chenglin Li , Junni Zou , Hongkai Xiong

Research on polar codes has been constantly gaining attention over the last decade, by academia and industry alike, thanks to their capacity-achieving error-correction performance and low-complexity decoding algorithms. Recently, they have…

信息论 · 计算机科学 2020-06-25 Carlo Condo , Valerio Bioglio , Ingmar Land

Nowadays polar codes are becoming one of the most favorable capacity achieving error correction codes for their low encoding and decoding complexity. However, due to the large code length required by practical applications, the few existing…

硬件体系结构 · 计算机科学 2011-11-04 Chuan Zhang , Bo Yuan , Keshab K. Parhi