English
Related papers

Related papers: Characterizing and Subsetting Big Data Workloads

200 papers

It is important for big data systems to identify their performance bottleneck. However, the popular indicators such as resource utilizations, are often misleading and incomparable with each other. In this paper, a novel indicator framework…

Databases · Computer Science 2018-11-28 Chen Yang , Zhihui Du , Xiaofeng Meng , Yongjie Du , Zhiqiang Duan

Data center networking is the central infrastructure of the modern information society. However, benchmarking them is very challenging as the real-world network traffic is difficult to model, and Internet service giants treat the network…

Networking and Internet Architecture · Computer Science 2023-02-24 Ke Liu , Wanling Gao , Chunjie Luo , Cheng Huang , Chunxin Lan , Zhenxing Zhang , Lei Wang , Xiwen He , Nan Li , Jianfeng Zhan

The recent boom of big data, coupled with the challenges of its processing and storage gave rise to the development of distributed data processing and storage paradigms like MapReduce, Spark, and NoSQL databases. With the advent of cloud…

Distributed, Parallel, and Cluster Computing · Computer Science 2017-11-30 Sheriffo Ceesay , Adam Barker , Blesson Varghese

Performance regressions in large-scale software systems can lead to substantial resource inefficiencies, making their early detection critical. Frequent benchmarking is essential for identifying these regressions and maintaining…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-10-22 Nils Japke , Sebastian Koch , Helmut Lukasczyk , David Bermbach

During early stages of CPU design, benchmarks can only run on simulators to evaluate CPU performance. However, most big data benchmarks are too huge at code size scale, which causes them to be unable to finish running on simulators at an…

Performance · Computer Science 2023-09-20 Yikang Yang , Lei Wang , Jianfeng Zhan

Principal component analysis (PCA) is often used to analyze multivariate data together with cluster analysis, which depends on the number of principal components used. It is therefore important to determine the number of significant…

Applications · Statistics 2024-09-19 Joshua C. Macdonald , Javier Blanco-Portillo , Marcus W. Feldman , Yoav Ram

Commonsense question-answering (QA) tasks, in the form of benchmarks, are constantly being introduced for challenging and comparing commonsense QA systems. The benchmarks provide question sets that systems' developers can use to train and…

Artificial Intelligence · Computer Science 2020-12-23 Henrique Santos , Minor Gordon , Zhicheng Liang , Gretchen Forbush , Deborah L. McGuinness

Comprehensive benchmarking of clustering algorithms is rendered difficult by two key factors: (i)~the elusiveness of a unique mathematical definition of this unsupervised learning approach and (ii)~dependencies between the generating models…

Neural and Evolutionary Computing · Computer Science 2022-01-11 Cameron Shand , Richard Allmendinger , Julia Handl , Andrew Webb , John Keane

Principal Component Analysis (PCA) is a ubiquitous tool with many applications in machine learning including feature construction, subspace embedding, and outlier detection. In this paper, we present an algorithm for computing the top…

Machine Learning · Computer Science 2013-10-25 Nikos Karampatziakis , Paul Mineiro

AI models are increasingly prevalent in high-stakes environments, necessitating thorough assessment of their capabilities and risks. Benchmarks are popular for measuring these attributes and for comparing model performance, tracking…

Artificial Intelligence · Computer Science 2024-11-21 Anka Reuel , Amelia Hardy , Chandler Smith , Max Lamparth , Malcolm Hardy , Mykel J. Kochenderfer

In this paper, we consider clustering based on principal component analysis (PCA) for high-dimension, low-sample-size (HDLSS) data. We give theoretical reasons why PCA is effective for clustering HDLSS data. First, we derive a geometric…

Statistics Theory · Mathematics 2015-03-17 Kazuyoshi Yata , Makoto Aoshima

Measuring performance-critical characteristics of application workloads is important both for developers, who must understand and optimize the performance of codes, as well as designers and integrators of HPC systems, who must ensure that…

Software Engineering · Computer Science 2018-11-01 Beau Johnston , Josh Milthorpe

The increasing attention on deep learning has tremendously spurred the design of intelligence processing hardware. The variety of emerging intelligence processors requires standard benchmarks for fair comparison and system optimization (in…

We introduce WorkBench: a benchmark dataset for evaluating agents' ability to execute tasks in a workplace setting. WorkBench contains a sandbox environment with five databases, 26 tools, and 690 tasks. These tasks represent common business…

Computation and Language · Computer Science 2024-08-06 Olly Styles , Sam Miller , Patricio Cerda-Mardini , Tanaya Guha , Victor Sanchez , Bertie Vidgen

Instance-optimized components have made their way into production systems. To some extent, this adoption is due to the characteristics of customer workloads, which can be individually leveraged during the model training phase. However,…

Databases · Computer Science 2025-06-17 Skander Krid , Mihail Stoian , Andreas Kipf

The field of High-Performance Computing (HPC) is defined by providing computing devices with highest performance for a variety of demanding scientific users. The tight co-design relationship between HPC providers and users propels the field…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-12-17 Andreas Herten , Olga Pearce , Filipe S. M. Guimarães

For the architecture community, reasonable simulation time is a strong requirement in addition to performance data accuracy. However, emerging big data and AI workloads are too huge at binary size level and prohibitively expensive to run on…

Distributed, Parallel, and Cluster Computing · Computer Science 2018-10-23 Wanling Gao , Jianfeng Zhan , Lei Wang , Chunjie Luo , Zhen Jia , Daoyi Zheng , Chen Zheng , Xiwen He , Hainan Ye , Haibin Wang , Rui Ren

Microservice architectures are a popular choice for deploying large-scale data-intensive applications. This architectural style allows microservice practitioners to achieve requirements related to loose coupling, fault contention, workload…

Databases · Computer Science 2024-05-21 Rodrigo Laigner , Yongluan Zhou

Cloud providers introduce features (e.g., Spot VMs, Harvest VMs, and Burstable VMs) and optimizations (e.g., oversubscription, auto-scaling, power harvesting, and overclocking) to improve efficiency and reliability. To effectively utilize…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-05-14 Anjaly Parayil , Jue Zhang , Xiaoting Qin , Íñigo Goiri , Lexiang Huang , Timothy Zhu , Chetan Bansal

In this paper, we ask the research question of whether all the datasets in the benchmark are necessary. We approach this by first characterizing the distinguishability of datasets when comparing different systems. Experiments on 9 datasets…

Computation and Language · Computer Science 2022-05-05 Yang Xiao , Jinlan Fu , See-Kiong Ng , Pengfei Liu