English

Benchmarking Different Application Types across Heterogeneous Cloud Compute Services

Distributed, Parallel, and Cluster Computing 2025-01-13 v1

Abstract

Infrastructure as a Service (IaaS) clouds have become the predominant underlying infrastructure for the operation of modern and smart technology. IaaS clouds have proven to be useful for multiple reasons such as reduced costs, increased speed and efficiency, and better reliability and scalability. Compute services offered by such clouds are heterogeneous -- they offer a set of architecturally diverse machines that fit efficiently executing different workloads. However, there has been little study to shed light on the performance of popular application types on these heterogeneous compute servers across different clouds. Such a study can help organizations to optimally (in terms of cost, latency, throughput, consumed energy, carbon footprint, etc.) employ cloud compute services. At HPCC lab, we have focused on such benchmarks in different research projects and, in this report, we curate those benchmarks in a single document to help other researchers in the community using them. Specifically, we introduce our benchmarks datasets for three application types in three different domains, namely: Deep Neural Networks (DNN) Inference for industrial applications, Machine Learning (ML) Inference for assistive technology applications, and video transcoding for multimedia use cases.

Keywords

Cite

@article{arxiv.2501.06128,
  title  = {Benchmarking Different Application Types across Heterogeneous Cloud Compute Services},
  author = {Nivedhitha Duggi and Masoud Rafiei and Mohsen Amini Salehi},
  journal= {arXiv preprint arXiv:2501.06128},
  year   = {2025}
}

Comments

Technical Report. arXiv admin note: text overlap with arXiv:2011.11711 by other authors

R2 v1 2026-06-28T21:02:52.148Z