English
Related papers

Related papers: Characterizing Data Analysis Workloads in Data Cen…

200 papers

The precise estimation of resource usage is a complex and challenging issue due to the high variability and dimensionality of heterogeneous service types and dynamic workloads. Over the last few years, the prediction of resource usage and…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-02-07 Deepika Saxena , Jitendra Kumar , Ashutosh Kumar Singh , Stefan Schmid

Hyperscalars run services across a large fleet of servers, serving billions of users worldwide. These services, however, behave differently than commonly available benchmark suites, resulting in server architectures that are not optimized…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-05-03 Suyash Mahar , Hao Wang , Wei Shu , Abhishek Dhanotia

Data processing units (DPUs, SoC-based SmartNICs) are emerging data center hardware that provide opportunities to address cloud data processing challenges. Their onboard compute, memory, network, and auxiliary storage can be leveraged to…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-04-09 Jiasheng Hu , Chihan Cui , Anna Li , Raahil Vora , Yuanfan Chen , Philip A. Bernstein , Jialin Li , Qizhen Zhang

Large-scale cloud data centers have gained popularity due to their high availability, rapid elasticity, scalability, and low cost. However, current data centers continue to have high failure rates due to the lack of proper resource…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-12-10 Faisal Haque Bappy , Tariqul Islam , Tarannum Shaila Zaman , Raiful Hasan , Carlos Caicedo

The complexity and diversity of big data and AI workloads make understanding them difficult and challenging. This paper proposes a new approach to modelling and characterizing big data and AI workloads. We consider each big data and AI…

Distributed, Parallel, and Cluster Computing · Computer Science 2018-08-28 Wanling Gao , Jianfeng Zhan , Lei Wang , Chunjie Luo , Daoyi Zheng , Fei Tang , Biwei Xie , Chen Zheng , Xu Wen , Xiwen He , Hainan Ye , Rui Ren

Specialized accelerators dominate AI workloads, but CPUs remain critical for orchestrating these accelerators and running datacenter services. As a result, CPU performance increasingly shapes end-to-end system efficiency, making it…

Hardware Architecture · Computer Science 2026-05-08 Ruihao Li , Andrew Jacob , Neeraja J. Yadwadkar , Lizy K. John

Cloud service providers commonly use standard benchmarks like TPC-H and TPC-DS to evaluate and optimize cloud data analytics systems. However, these benchmarks rely on fixed query patterns and fail to capture the real execution statistics…

Smart databases are adopting artificial intelligence (AI) technologies to achieve {\em instance optimality}, and in the future, databases will come with prepackaged AI models within their core components. The reason is that every database…

Databases · Computer Science 2021-05-27 Debjyoti Paul , Jie Cao , Feifei Li , Vivek Srikumar

The complexity and diversity of big data and AI workloads make understanding them difficult and challenging. This paper proposes a new approach to characterizing big data and AI workloads. We consider each big data and AI workload as a…

Distributed, Parallel, and Cluster Computing · Computer Science 2018-05-07 Wanling Gao , Jianfeng Zhan , Lei Wang , Chunjie Luo , Daoyi Zheng , Fei Tang , Biwei Xie , Chen Zheng , Qiang Yang

Big data benchmarking is particularly important and provides applicable yardsticks for evaluating booming big data systems. However, wide coverage and great complexity of big data computing impose big challenges on big data benchmarking.…

Databases · Computer Science 2015-05-27 Wanling Gao , Chunjie Luo , Jianfeng Zhan , Hainan Ye , Xiwen He , Lei Wang , Yuqing Zhu , Xinhui Tian

Autoscaling has become a baseline expectation for cloud-native big data processing, and the design space has expanded beyond rule-based heuristics to include learned controllers and, most recently, large language model (LLM) agents. Yet…

Information Retrieval · Computer Science 2026-05-13 Venkata Krishna Prasanth Budigi , Siri Chandana Sirigiri

In the recent past, characterizing workloads has been attempted to gain a foothold in the emerging serverless cloud market, especially in the large production cloud clusters of Google, AWS, and so forth. While analyzing and characterizing…

Distributed, Parallel, and Cluster Computing · Computer Science 2022-05-25 Thomas van Loo , Anshul Jindal , Shajulin Benedict , Mohak Chadha , Michael Gerndt

The design and construction of high performance computing (HPC) systems relies on exhaustive performance analysis and benchmarking. Traditionally this activity has been geared exclusively towards simulation scientists, who, unsurprisingly,…

Performance · Computer Science 2018-11-07 Drew Schmidt , Junqi Yin , Michael Matheson , Bronson Messer , Mallikarjun Shankar

Data warehouse architectural choices and optimization techniques are critical to decision support query performance. To facilitate these choices, the performance of the designed data warehouse must be assessed, usually with benchmarks.…

Databases · Computer Science 2017-01-03 Jérôme Darmont , Fadila Bentayeb , Omar Boussaïd

For the first time, this paper systematically identifies three categories of throughput oriented workloads in data centers: services, data processing applications, and interactive real-time applications, whose targets are to increase the…

Distributed, Parallel, and Cluster Computing · Computer Science 2016-11-18 Jianfeng Zhan , Lixin Zhang , Ninghui Sun , Lei Wang , Zhen Jia , Chunjie Luo

In this work, we present a new benchmarking suite with new real-life inspired skewed workloads to test the performance of concurrent index data structures. We started this project to prepare workloads specifically for self-adjusting data…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-05-19 Vitaly Aksenov , Dmitry Ivanov , Ravil Galiev

Artificial intelligence (AI) and Machine learning (ML) workloads are an increasingly larger share of the compute workloads in traditional High-Performance Computing (HPC) centers and commercial cloud systems. This has led to changes in…

Instance-optimized components have made their way into production systems. To some extent, this adoption is due to the characteristics of customer workloads, which can be individually leveraged during the model training phase. However,…

Databases · Computer Science 2025-06-17 Skander Krid , Mihail Stoian , Andreas Kipf

The prevalence of scientific workflows with high computational demands calls for their execution on various distributed computing platforms, including large-scale leadership-class high-performance computing (HPC) clusters. To handle the…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-02-10 Tainã Coleman , Henri Casanova , Ketan Maheshwari , Loïc Pottier , Sean R. Wilkinson , Justin Wozniak , Frédéric Suter , Mallikarjun Shankar , Rafael Ferreira da Silva

Performance evaluation is a key issue for designers and users of Database Management Systems (DBMSs). Performance is generally assessed with software benchmarks that help, e.g., test architectural choices, compare different technologies or…

Databases · Computer Science 2017-01-30 Jérôme Darmont