English
Related papers

Related papers: Faasm: Lightweight Isolation for Efficient Statefu…

200 papers

Serverless computing promises convenient abstractions for developing and deploying functions that execute in response to events. In such Function-as-a-Service (FaaS) platforms, scheduling is an integral task, but current scheduling…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-07-08 Saman Akbari , Manfred Hauswirth

FaaS (Function-as-a-Service) revolutionized cloud computing by replacing persistent virtual machines with dynamically allocated resources. This shift trades locality and statefulness for a pay-as-you-go model more suited to variable and…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-05-02 Marcin Copik , Alexandru Calotoiu , Pengyu Zhou , Konstantin Taranov , Torsten Hoefler

Directory-based protocols have been the de facto solution for maintaining cache coherence in shared-memory parallel systems comprising multi/many cores, where each store instruction is eagerly made globally visible by invalidating the…

Hardware Architecture · Computer Science 2012-10-09 Daofu Liu , Yunji Chen , Qi Guo , Tianshi Chen , Ling Li , Qunfeng Dong , Weiwu Hu

Nowadays simulations can produce petabytes of data to be stored in parallel filesystems or large-scale databases. This data is accessed over the course of decades often by thousands of analysts and scientists. However, storing these volumes…

Distributed, Parallel, and Cluster Computing · Computer Science 2019-02-11 Salvatore Di Girolamo , Pirmin Schmid , Thomas Schulthess , Torsten Hoefler

Serverless computing has seen rapid adoption due to its high scalability and flexible, pay-as-you-go billing model. In serverless, developers structure their services as a collection of functions, sporadically invoked by various events like…

Distributed, Parallel, and Cluster Computing · Computer Science 2021-02-09 Dmitrii Ustiugov , Plamen Petrov , Marios Kogias , Edouard Bugnion , Boris Grot

AI deployment increasingly resembles a pipeline of data transformation, fine-tuning, and agent interactions rather than a monolithic LLM job; recent examples include RLHF/RLAIF training and agentic workflows. To cope with this shift, we…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-11-03 Junyi Shen , Noppanat Wadlom , Lingfeng Zhou , Dequan Wang , Xu Miao , Lei Fang , Yao Lu

Recent Serverless workloads tend to be largescaled/CPU-memory intensive, such as DL, graph applications, that require dynamic memory-to-compute resources provisioning. Meanwhile, recent solutions seek to design page management strategies…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-09-26 Yuze Li , Shunyu Yao

Federated Learning (FL) is emerging as a promising technology to build machine learning models in a decentralized, privacy-preserving fashion. Indeed, FL enables local training on user devices, avoiding user data to be transferred to…

Machine Learning · Computer Science 2020-11-19 Nicolas Kourtellis , Kleomenis Katevas , Diego Perino

Serverless Function-as-a-Service (FaaS) is a popular cloud paradigm to quickly and cheaply implement complex applications. Because the function instances cloud providers start to execute user code run on shared infrastructure, their…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-10-27 Trever Schirmer , Natalie Carl , Nils Höller , Tobias Pfandzelter , David Bermbach

Serverless computing that runs functions with auto-scaling is a popular task execution pattern in the cloud-native era. By connecting serverless functions into workflows, tenants can achieve complex functionality. Prior researches adopt the…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-05-01 Zijun Li , Chuhao Xu , Quan Chen , Jieru Zhao , Chen Chen , Minyi Guo

Federated learning (FL) is one of the popular distributed machine learning (ML) solutions but incurs significant communication and computation costs at edge devices. Federated split learning (FSL) can train sub-models in parallel and reduce…

Machine Learning · Computer Science 2025-07-22 Yujia Mu , Cong Shen

Federated Learning (FL) enables end-user devices to collaboratively train ML models without sharing raw data, thereby preserving data privacy. In FL, a central parameter server coordinates the learning process by iteratively aggregating the…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-05-30 Akash Dhasade , Anne-Marie Kermarrec , Erick Lavoie , Johan Pouwelse , Rishi Sharma , Martijn de Vos

Increasing popularity of the serverless computing approach has led to the emergence of new cloud infrastructures working in Container-as-a-Service (CaaS) model like AWS Fargate, Google Cloud Run, or Azure Container Instances. They introduce…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-10-23 Krzysztof Burkat , Maciej Pawlik , Bartosz Balis , Maciej Malawski , Karan Vahi , Mats Rynge , Rafael Ferreira da Silva , Ewa Deelman

Client-side metadata caching has long been considered an effective method for accelerating metadata operations in distributed file systems (DFSs). However, we have found that client-side state (e.g., caching) is not only ineffective but…

Distributed, Parallel, and Cluster Computing · Computer Science 2026-01-09 Jingwei Xu , Junbin Kang , Mingkai Dong , Mingyu Liu , Lu Zhang , Shaohong Guo , Ziyan Qiu , Mingzhen You , Ziyi Tian , Anqi Yu , Tianhong Ding , Xinwei Hu , Haibo Chen

Serverless functions are a cloud computing paradigm where the provider takes care of resource management tasks such as resource provisioning, deployment, and auto-scaling. The only resource management task that developers are still in…

Distributed, Parallel, and Cluster Computing · Computer Science 2021-06-08 Simon Eismann , Long Bui , Johannes Grohmann , Cristina L. Abad , Nikolas Herbst , Samuel Kounev

The traditional framework of federated learning (FL) requires each client to re-train their models in every iteration, making it infeasible for resource-constrained mobile devices to train deep-learning (DL) models. Split learning (SL)…

Machine Learning · Computer Science 2023-03-21 Manas Wadhwa , Gagan Raj Gupta , Ashutosh Sahu , Rahul Saini , Vidhi Mittal

Supervised fine-tuning (SFT) is a pivotal approach to adapting large language models (LLMs) for downstream tasks; however, performance often suffers from the ``seesaw phenomenon'', where indiscriminate parameter updates yield progress on…

Computation and Language · Computer Science 2025-09-22 Yao Wang , Di Liang , Minlong Peng

Data processing systems are increasingly deployed in the cloud. While monolithic systems run fully on virtual servers, recent systems embrace cloud infrastructure and utilize the disaggregation of compute and storage to scale them…

Databases · Computer Science 2025-01-15 Thomas Bodner , Theo Radig , David Justen , Daniel Ritter , Tilmann Rabl

Federated Learning (FL) is an approach for privacy-preserving Machine Learning (ML), enabling model training across multiple clients without centralized data collection. With an aggregator server coordinating training, aggregating model…

Machine Learning · Computer Science 2025-03-04 Ahmad Faraz Khan , Samuel Fountain , Ahmed M. Abdelmoniem , Ali R. Butt , Ali Anwar

In an overloaded FaaS cluster, individual worker nodes strain under lengthening queues of requests. Although the cluster might be eventually horizontally-scaled, adding a new node takes dozens of seconds. As serving applications are tuned…

Distributed, Parallel, and Cluster Computing · Computer Science 2022-11-01 Paweł Żuk , Bartłomiej Przybylski , Krzysztof Rzadca