English
Related papers

Related papers: Characterizing Data Analysis Workloads in Data Cen…

200 papers

Cloud block storage systems support diverse types of applications in modern cloud services. Characterizing their I/O activities is critical for guiding better system designs and optimizations. In this paper, we present an in-depth…

Distributed, Parallel, and Cluster Computing · Computer Science 2022-11-22 Jinhong Li , Qiuping Wang , Patrick P. C. Lee , Chao Shi

Dataset Condensation is a newly emerging technique aiming at learning a tiny dataset that captures the rich information encoded in the original dataset. As the size of datasets contemporary machine learning models rely on becomes…

Machine Learning · Computer Science 2022-10-18 Justin Cui , Ruochen Wang , Si Si , Cho-Jui Hsieh

Performance benchmarking is a common practice in software engineering, particularly when building large-scale, distributed, and data-intensive systems. While cloud environments offer several advantages for running benchmarks, it is often…

Software Engineering · Computer Science 2025-04-17 Sören Henning , Adriano Vogel , Esteban Perez-Wohlfeil , Otmar Ertl , Rick Rabiser

This article raises an important and challenging workload characterization issue: can we uncover each critical component across the stacks contributing what percentages to any specific bottleneck? The typical critical components include…

Performance · Computer Science 2023-02-28 Lei Wang , Kaiyong Yang , Chenxi Wang , Wanling Gao , Chunjie Luo , Fan Zhang , Zhongxin Ge , Li Zhang , Guoxin Kang , Jianfeng Zhan

Cloud data analytics has become an integral part of enterprise business operations for data-driven insight discovery. Performance modeling of cloud data analytics is crucial for performance tuning and other critical operations in the cloud.…

Distributed, Parallel, and Cluster Computing · Computer Science 2021-01-21 Khaled Zaouk , Fei Song , Chenghao Lyu , Yanlei Diao

Workspace learning requires AI agents to identify, reason over, exploit, and update explicit and implicit dependencies among heterogeneous files in a worker's workspace, enabling them to complete both routine and advanced tasks effectively.…

We present in this paper a new benchmark for evaluating the performances of data warehouses. Benchmarking is useful either to system users for comparing the performances of different systems, or to system engineers for testing the effect of…

Databases · Computer Science 2007-05-23 Jérôme Darmont , Fadila Bentayeb , Omar Boussaïd

Modern GPU datacenters are critical for delivering Deep Learning (DL) models and services in both the research community and industry. When operating a datacenter, optimization of resource scheduling and management can bring significant…

Distributed, Parallel, and Cluster Computing · Computer Science 2021-09-07 Qinghao Hu , Peng Sun , Shengen Yan , Yonggang Wen , Tianwei Zhang

Cloud data centers face increasing pressure to reduce operational energy consumption as big data workloads continue to grow in scale and complexity. This paper presents a workload aware and energy efficient scheduling framework that…

Distributed, Parallel, and Cluster Computing · Computer Science 2026-01-21 Milan Parikh , Aniket Abhishek Soni , Sneja Mitinbhai Shah , Ayush Raj Jha

Cloud systems have rapidly expanded worldwide in the last decade, shifting computational tasks to cloud servers where clients submit their requests. Among cloud workloads, latency-critical applications -- characterized by high-percentile…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-05-07 Zhilin Li , Lucia Pons , Salvador Petit , Julio Sahuquillo , Julio Pons

Consider the situation where a data analyst wishes to carry out an analysis on a given dataset. It is widely recognized that most of the analyst's time will be taken up with \emph{data engineering} tasks such as acquiring, understanding,…

At present there are a number of barriers to creating an energy efficient workload scheduler for a Private Cloud based data center. Firstly, the relationship between different workloads and power consumption must be investigated. Secondly,…

Distributed, Parallel, and Cluster Computing · Computer Science 2011-05-16 James W. Smith , Ian Sommerville

In recent years, with the trend of applying deep learning (DL) in high performance scientific computing, the unique characteristics of emerging DL workloads in HPC raise great challenges in designing, implementing HPC AI systems. The…

In warehouse-scale cloud datacenters, co-locating online services and offline batch jobs is an efficient approach to improving datacenter utilization. To better facilitate the understanding of interactions among the co-located workloads and…

Distributed, Parallel, and Cluster Computing · Computer Science 2018-11-19 Rui Ren , Jinheng Li , Lei Wang , Jianfeng Zhan , Zheng Cao

Along with the wide-adoption of Serverless Computing, more and more applications are developed and deployed on cloud platforms. Major cloud providers present their serverless workflow services to orchestrate serverless functions, making it…

Software Engineering · Computer Science 2021-01-14 Jinfeng Wen , Yi Liu

Dataloaders, in charge of moving data from storage into GPUs while training machine learning models, might hold the key to drastically improving the performance of training jobs. Recent advances have shown promise not only by considerably…

Distributed, Parallel, and Cluster Computing · Computer Science 2022-09-29 Iason Ofeidis , Diego Kiedanski , Leandros Tassiulas

Microservice architectures are a popular choice for deploying large-scale data-intensive applications. This architectural style allows microservice practitioners to achieve requirements related to loose coupling, fault contention, workload…

Databases · Computer Science 2024-05-21 Rodrigo Laigner , Yongluan Zhou

HPC datacenters offer a backbone to the modern digital society. Increasingly, they run Machine Learning (ML) jobs next to generic, compute-intensive workloads, supporting science, business, and other decision-making processes. However,…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-09-16 Xiaoyu Chu , Daniel Hofstätter , Shashikant Ilager , Sacheendra Talluri , Duncan Kampert , Damian Podareanu , Dmitry Duplyakin , Ivona Brandic , Alexandru Iosup

Infrastructure as a Service (IaaS) clouds have become the predominant underlying infrastructure for the operation of modern and smart technology. IaaS clouds have proven to be useful for multiple reasons such as reduced costs, increased…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-01-13 Nivedhitha Duggi , Masoud Rafiei , Mohsen Amini Salehi

Domain-specific software and hardware co-design is encouraging as it is much easier to achieve efficiency for fewer tasks. Agile domain-specific benchmarking speeds up the process as it provides not only relevant design inputs but also…