English
Related papers

Related papers: Characterizing and Subsetting Big Data Workloads

200 papers

We consider estimation of large approximate factor models in high-dimensional panels of stationary time series using Principal Component Analysis (PCA). We review the key results establishing the necessary and sufficient conditions for…

Econometrics · Economics 2026-02-13 Matteo Barigozzi

Big Data can mean different things to different people. The scale and challenges of Big Data are often described using three attributes, namely Volume, Velocity and Variety (3Vs), which only reflect some of the aspects of data. In this…

Distributed, Parallel, and Cluster Computing · Computer Science 2016-01-14 Caesar Wu , Rajkumar Buyya , Kotagiri Ramamohanarao

Current quantum systems have significant limitations affecting the processing of large datasets with high dimensionality, typical of high energy physics. In the present paper, feature and data prototype selection techniques were studied to…

High Energy Physics - Phenomenology · Physics 2023-12-18 Miguel Caçador Peixoto , Nuno Filipe Castro , Miguel Crispim Romão , Maria Gabriela Jordão Oliveira , Inês Ochoa

Benchmarking is essential for developing and evaluating black-box optimization algorithms, providing a structured means to analyze their search behavior. Its effectiveness relies on carefully selected problem sets used for evaluation. To…

Neural and Evolutionary Computing · Computer Science 2025-11-17 Iván Olarte Rodríguez , Maria Laura Santoni , Fabian Duddeck , Carola Doerr , Thomas Bäck , Elena Raponi

Strong empirical evidence that one machine-learning algorithm A outperforms another one B ideally calls for multiple trials optimizing the learning pipeline over sources of variation such as data sampling, data augmentation, parameter…

Complex networks are a powerful modeling tool, allowing the study of countless real-world systems. They have been used in very different domains such as computer science, biology, sociology, management, etc. Authors have been trying to…

Social and Information Networks · Computer Science 2014-02-04 Burcu Kantarcı , Vincent Labatut

There is a great diversity of clustering and community detection algorithms, which are key components of many data analysis and exploration systems. To the best of our knowledge, however, there does not exist yet any uniform benchmarking…

Distributed, Parallel, and Cluster Computing · Computer Science 2019-02-04 Artem Lutov , Mourad Khayati , Philippe Cudré-Mauroux

In the recent past, characterizing workloads has been attempted to gain a foothold in the emerging serverless cloud market, especially in the large production cloud clusters of Google, AWS, and so forth. While analyzing and characterizing…

Distributed, Parallel, and Cluster Computing · Computer Science 2022-05-25 Thomas van Loo , Anshul Jindal , Shajulin Benedict , Mohak Chadha , Michael Gerndt

Adding new hardware features to a cloud computing server requires testing both the functionalities and the performance of the new hardware mechanisms. However, commonly used cloud computing server workloads are not well-represented by the…

Distributed, Parallel, and Cluster Computing · Computer Science 2016-03-07 Hao Wu , Fangfei Liu , Ruby B. Lee

Principal component analysis (PCA) is a most frequently used statistical tool in almost all branches of data science. However, like many other statistical tools, there is sometimes the risk of misuse or even abuse. In this paper, we…

Methodology · Statistics 2021-08-12 Xinyu Zhang , Howell Tong

A new look on the principal component analysis has been presented. Firstly, a geometric interpretation of determination coefficient was shown. In turn, the ability to represent the analyzed data and their interdependencies in the form of…

Methodology · Statistics 2017-11-29 Zenon Gniazdowski

Cloud computing recently developed into a viable alternative to on-premises systems for executing high-performance computing (HPC) applications. With the emergence of new vendors and hardware options, there is now a growing need to…

Distributed, Parallel, and Cluster Computing · Computer Science 2018-12-14 Mohammad Mohammadi , Timur Bazhirov

Despite the recent advances showing that a model pre-trained on large-scale source code data is able to gain appreciable generalization capability, it still requires a sizeable amount of data on the target task for fine-tuning. And the…

Software Engineering · Computer Science 2023-02-13 Changan Niu , Chuanyi Li , Vincent Ng , Bin Luo

A critical yet frequently overlooked challenge in the field of deepfake detection is the lack of a standardized, unified, comprehensive benchmark. This issue leads to unfair performance comparisons and potentially misleading results.…

Computer Vision and Pattern Recognition · Computer Science 2023-10-31 Zhiyuan Yan , Yong Zhang , Xinhang Yuan , Siwei Lyu , Baoyuan Wu

One key challenge in optimization is the selection of a suitable set of benchmark problems. A common goal is to find functions which are representative of a class of real-world optimization problems in order to ensure findings on the…

Neural and Evolutionary Computing · Computer Science 2025-05-15 Diederick Vermetten , Catalin-Viorel Dinu , Marcus Gallagher

Data-based classification is fundamental to most branches of science. While recent years have brought enormous progress in various areas of statistical computing and clustering, some general challenges in clustering remain: model selection,…

Artificial Intelligence · Computer Science 2007-06-13 Jens Oehlschlägel

Benchmarks are a useful tool for empirical performance comparisons. However, one of the main shortcomings of existing benchmarks is that it remains largely unclear how they relate to real-world problems. What does an algorithm's performance…

Neural and Evolutionary Computing · Computer Science 2020-04-15 Koen van der Blom , Timo M. Deist , Tea Tušar , Mariapia Marchi , Yusuke Nojima , Akira Oyama , Vanessa Volz , Boris Naujoks

Clustering is an important research topic for wireless sensor networks (WSNs). A large variety of approaches has been presented focusing on different performance metrics. Even though all of them have many practical applications, an…

Networking and Internet Architecture · Computer Science 2011-07-11 Dimitrios Amaxilatis , Ioannis Chatzigiannakis , Christos Koninis , Apostolos Pyrgelis

Workload characterization is an integral part of performance analysis of high performance computing (HPC) systems. An understanding of workload properties sheds light on resource utilization and can be used to inform performance…

Distributed, Parallel, and Cluster Computing · Computer Science 2018-01-16 Nikolay A. Simakov , Joseph P. White , Robert L. DeLeon , Steven M. Gallo , Matthew D. Jones , Jeffrey T. Palmer , Benjamin Plessinger , Thomas R. Furlani

Rapid advances in quantum computing technology lead to an increasing need for software simulators that enable both algorithm design and the validation of results obtained from quantum hardware. This includes calculations that aim at probing…

Quantum Physics · Physics 2025-01-09 Amit Jamadagni , Andreas M. Läuchli , Cornelius Hempel