English
Related papers

Related papers: An Elastic Ephemeral Datastore using Cheap, Transi…

200 papers

Elasticity is a key property of cloud computing. However, elasticity is offered today at the granularity of virtual machines, which take tens of seconds to start. This is insufficient to react to load spikes and sudden failures in latency…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-07-02 Michael Wawrzoniak , Rodrigo Bruno , Ana Klimovic , Gustavo Alonso

Cloud platforms have emerged as a prominent environment to execute high performance computing (HPC) applications providing on-demand resources as well as scalability. They usually offer different classes of Virtual Machines (VMs) which…

Distributed, Parallel, and Cluster Computing · Computer Science 2018-10-25 Luan Teylo , Lúcia Maria de A. Drummond , Luciana Arantes , Pierre Sens

Due to the massive size of the neural network models and training datasets used in machine learning today, it is imperative to distribute stochastic gradient descent (SGD) by splitting up tasks such as gradient evaluation across multiple…

Machine Learning · Computer Science 2020-03-13 Xiaoxi Zhang , Jianyu Wang , Gauri Joshi , Carlee Joe-Wong

Large batch jobs such as Deep Learning, HPC and Spark require far more computational resources and higher cost than conventional online service. Like the processing of other time series data, these jobs possess a variety of characteristics…

Machine Learning · Computer Science 2020-10-13 Peng Gao

AI batch jobs such as model training, inference pipelines, and data analytics require substantial GPU resources and often need to finish before a deadline. Spot instances offer 3-10x lower cost than on-demand instances, but their…

Distributed, Parallel, and Cluster Computing · Computer Science 2026-01-13 Zhifei Li , Tian Xia , Ziming Mao , Zihan Zhou , Ethan J. Jackson , Jamison Kerney , Zhanghao Wu , Pratik Mishra , Yi Xu , Yifan Qiao , Scott Shenker , Ion Stoica

As foundation models grow in size, fine-tuning them becomes increasingly expensive. While GPU spot instances offer a low-cost alternative to on-demand resources, their volatile prices and availability make deadline-aware scheduling…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-12-25 Linggao Kong , Yuedong Xu , Lei Jiao , Chuan Xu

Cloud computing delivers value to users by facilitating their access to computing capacity in periods when their need arises. An approach is to provide both on-demand and spot services on shared servers. The former allows users to access…

Performance · Computer Science 2019-09-04 Xiaohu Wu , Francesco De Pellegrini , Guanyu Gao , Giuliano Casale

Cloud service platforms increasingly rely on elastic infrastructures to support dynamic workloads. Spot instances provide discounted computing resources but introduce uncertainty due to dynamic pricing, resource availability, and…

Distributed, Parallel, and Cluster Computing · Computer Science 2026-05-22 Javier Fabra , Enrique Molina-Giménez , Pedro García-López

Cloud resource management is often modeled by two-dimensional bin packing with a set of items that correspond to tasks having fixed CPU and memory requirements. However, applications running in clouds are much more flexible: modern…

Distributed, Parallel, and Cluster Computing · Computer Science 2022-11-01 Bartłomiej Przybylski , Paweł Żuk , Krzysztof Rzadca

Cloud spot markets rent VMs for a variable price that is typically much lower than the price of on-demand VMs, which makes them attractive for a wide range of large-scale applications. However, applications that run on spot VMs suffer from…

Networking and Internet Architecture · Computer Science 2018-09-11 Supreeth Shastri , David Irwin

Often corporations need tools to improve their decision making in a competitive market. In general, these tools are based on data warehouse platforms to mange and analyze large amounts of data. However, several of these corporations do not…

Databases · Computer Science 2011-08-04 Eduardo Cunha de Almeida

Continual learning from streaming data sources becomes more and more popular due to the increasing number of online tools and systems. Dealing with dynamic and everlasting problems poses new challenges for which traditional batch-based…

Machine Learning · Computer Science 2020-09-22 Łukasz Korycki , Bartosz Krawczyk

In business process landscapes, a common challenge is to provide the necessary computational resources to enact the single process steps. One well-known approach to solve this issue in a cost-efficient way is to use the notion of…

Distributed, Parallel, and Cluster Computing · Computer Science 2022-09-15 Gerta Sheganaku , Stefan Schulte , Philipp Waibel , Ingo Weber

Centralized cloud computing with 100+ milliseconds network latencies cannot meet the tens of milliseconds to sub-millisecond response times required for emerging 5G applications like autonomous driving, smart manufacturing, tactile…

Distributed, Parallel, and Cluster Computing · Computer Science 2021-09-06 Kunal Rao , Giuseppe Coviello , Wang-Pin Hsiung , Srimat Chakradhar

Microservices architecture, known for its agility and efficiency, is an ideal framework for cloud-based software development and deployment. When integrated with containerization and orchestration systems, resource management becomes more…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-02-10 Dasith Edirisinghe , Kavinda Rajapakse , Pasindu Abeysinghe , Sunimal Rathnayake

Autoscaling is a hallmark of cloud computing as it allows flexible just-in-time allocation and release of computational resources in response to dynamic and often unpredictable workloads. This is especially important for web applications…

Distributed, Parallel, and Cluster Computing · Computer Science 2016-02-09 Nikolay Grozev , Rajkumar Buyya

Federated learning (FL) is a distributed machine learning (ML) approach that allows multiple clients to collaboratively train ML models without exchanging original training data, offering a solution that is particularly valuable in…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-09-15 Aditya Sinha , Zilinghan Li , Tingkai Liu , Volodymyr Kindratenko , Kibaek Kim , Ravi Madduri

Content-delivery applications can achieve scalability and reduce wide-area network traffic using geographically distributed caches. However, each deployed cache has an associated cost, and under time-varying request rates (e.g., a daily…

Networking and Internet Architecture · Computer Science 2021-12-30 Niklas Carlsson , Derek Eager

This paper presents the idea and the concepts behind the vision of an Ephemeral Cloud/Edge Continuum, a cloud/edge computing landscape that enables the exploitation of a widely distributed, dynamic, and context-aware set of resources. The…

Distributed, Parallel, and Cluster Computing · Computer Science 2021-07-16 Emanuele Carlini , Patrizio Dazzi , Luca Ferrucci , Matteo Mordacchini

We study the problem of optimizing data storage and access costs on the cloud while ensuring that the desired performance or latency is unaffected. We first propose an optimizer that optimizes the data placement tier (on the cloud) and the…