English
Related papers

Related papers: Straggler Resilient Serverless Computing Based on …

200 papers

We consider the problem of training a least-squares regression model on a large dataset using gradient descent. The computation is carried out on a distributed system consisting of a master node and multiple worker nodes. Such distributed…

Information Theory · Computer Science 2018-05-28 Songze Li , Seyed Mohammadreza Mousavi Kalan , Qian Yu , Mahdi Soltanolkotabi , A. Salman Avestimehr

Serverless computing promises convenient abstractions for developing and deploying functions that execute in response to events. In such Function-as-a-Service (FaaS) platforms, scheduling is an integral task, but current scheduling…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-07-08 Saman Akbari , Manfred Hauswirth

Serverless computing is a widely adopted cloud execution model composed of Function-as-a-Service (FaaS) and Backend-as-a-Service (BaaS) offerings. The increased level of abstraction makes vendor lock-in inherent to serverless computing,…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-03-29 Haidong Zhao , Zakaria Benomar , Tobias Pfandzelter , Nikolaos Georgantas

The event-driven and elastic nature of serverless runtimes makes them a very efficient and cost-effective alternative for scaling up computations. So far, they have mostly been used for stateless, data parallel and ephemeral computations.…

Distributed, Parallel, and Cluster Computing · Computer Science 2019-01-11 Arda Aytekin , Mikael Johansson

Distributed computing platforms typically assume the availability of reliable and dedicated connections among the processors. This work considers an alternative scenario, relevant for wireless data centers and federated learning, in which…

Information Theory · Computer Science 2019-01-17 Sukjong Ha , Jingjing Zhang , Osvaldo Simeone , Joonhyuk Kang

We study the problem of computing matrix chain multiplications in a distributed computing cluster. In such systems, performance is often limited by the straggler problem, where the slowest worker dominates the overall computation latency.…

Information Theory · Computer Science 2026-01-14 Jesús Gómez-Vilardebò

Serverless computing has emerged as a new compelling paradigm for the deployment of applications and services. It represents an evolution of cloud programming models, abstractions, and platforms, and is a testament to the maturity and wide…

Distributed, Parallel, and Cluster Computing · Computer Science 2017-06-13 Ioana Baldini , Paul Castro , Kerry Chang , Perry Cheng , Stephen Fink , Vatche Ishakian , Nick Mitchell , Vinod Muthusamy , Rodric Rabbah , Aleksander Slominski , Philippe Suter

Serverless Computing is a virtualisation-related paradigm that promises to simplify application management and to solve the last challenges in the field: scale down and easy to use. The implied cost reduction, coupled with a simplified…

Cryptography and Security · Computer Science 2022-01-28 Eduard Marin , Diego Perino , Roberto Di Pietro

Serverless computing enables developers to deploy code without managing infrastructure, but suffers from cold start overhead when initializing new function instances. Existing solutions such as "keep-alive" or "pre-warming" are costly and…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-10-31 Saman Akbari , Manfred Hauswirth

Distributed gradient descent (DGD) is an efficient way of implementing gradient descent (GD), especially for large data sets, by dividing the computation tasks into smaller subtasks and assigning to different computing servers (CSs) to be…

Information Theory · Computer Science 2018-11-29 Emre Ozfatura , Deniz Gunduz , Sennur Ulukus

Serverless computing is an approach to cloud computing that allows programmers to run serverless functions in response to external events. Serverless functions are priced at sub-second granularity, support transparent elasticity, and…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-08-05 Emily Herbert , Arjun Guha

The development of cloud infrastructures inspires the emergence of cloud-native computing. As the most promising architecture for deploying microservices, serverless computing has recently attracted more and more attention in both industry…

Distributed, Parallel, and Cluster Computing · Computer Science 2022-01-04 Zijun Li , Linsong Guo , Jiagan Cheng , Quan Chen , Bingsheng He , Minyi Guo

Serverless computing with cloud functions is quickly gaining adoption, but constrains programmers with its limited support for state management. We introduce a shared file system for cloud functions. It offers familiar POSIX semantics while…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-09-22 Johann Schleier-Smith , Leonhard Holz , Nathan Pemberton , Joseph M. Hellerstein

Distributed implementations of gradient-based methods, wherein a server distributes gradient computations across worker machines, suffer from slow running machines, called 'stragglers'. Gradient coding is a coding-theoretic framework to…

Information Theory · Computer Science 2019-05-01 Swanand Kadhe , O. Ozan Koyluoglu , Kannan Ramchandran

Increasing popularity of the serverless computing approach has led to the emergence of new cloud infrastructures working in Container-as-a-Service (CaaS) model like AWS Fargate, Google Cloud Run, or Azure Container Instances. They introduce…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-10-23 Krzysztof Burkat , Maciej Pawlik , Bartosz Balis , Maciej Malawski , Karan Vahi , Mats Rynge , Rafael Ferreira da Silva , Ewa Deelman

This paper explores resource allocation in serverless cloud computing platforms and proposes an optimization approach for autoscaling systems. Serverless computing relieves users from resource management tasks, enabling focus on application…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-10-31 Harold Ship , Evgeny Shindin , Chen Wang , Diana Arroyo , Asser Tantawi

Serverless edge computing adopts an event-based paradigm that provides back-end services on an as-used basis, resulting in efficient resource utilization. To improve the end-to-end latency and revenue, service providers need to optimize the…

Networking and Internet Architecture · Computer Science 2023-10-09 Chen Chen , Manuel Herrera , Ge Zheng , Liqiao Xia , Zhengyang Ling , Jiangtao Wang

Computationally intensive distributed and parallel computing is often bottlenecked by a small set of slow workers known as stragglers. In this paper, we utilize the emerging idea of "coded computation" to design a novel…

Information Theory · Computer Science 2017-06-06 Yaoqing Yang , Pulkit Grover , Soummya Kar

Performance of distributed optimization and learning systems is bottlenecked by "straggler" nodes and slow communication links, which significantly delay computation. We propose a distributed optimization framework where the dataset is…

Machine Learning · Statistics 2018-03-15 Can Karakus , Yifan Sun , Suhas Diggavi , Wotao Yin

Inspired by a new coded computation algorithm for invertible functions, we propose Coded-InvNet a new approach to design resilient prediction serving systems that can gracefully handle stragglers or node failures. Coded-InvNet leverages…

Machine Learning · Computer Science 2021-06-28 Tuan Dinh , Kangwook Lee