English
Related papers

Related papers: Theodolite: Scalability Benchmarking of Distribute…

200 papers

The rapid growth of blockchain systems leads to increasing interest in understanding and comparing blockchain performance at scale. In this paper, we focus on analyzing the performance of Hyperledger Fabric v1.1 - one of the most popular…

Databases · Computer Science 2021-07-22 Minh Quang Nguyen , Dumitrel Loghin , Tien Tuan Anh Dinh

Data quality is fundamental to modern data science workflows, where data continuously flows as unbounded streams feeding critical downstream tasks, from elementary analytics to advanced artificial intelligence models. Existing data quality…

Databases · Computer Science 2025-06-09 Vasileios Papastergios , Anastasios Gounaris

Developing high-performance and energy-efficient algorithms for maximum matchings is becoming increasingly important in social network analysis, computational sciences, scheduling, and others. In this work, we propose the first maximum…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-10-29 Maciej Besta , Marc Fischer , Tal Ben-Nun , Dimitri Stanojevic , Johannes De Fine Licht , Torsten Hoefler

Stream processing acceleration is driven by the continuously increasing volume and velocity of data generated on the Web and the limitations of storage, computation, and power consumption. Hardware solutions provide better performance and…

Databases · Computer Science 2024-08-29 Mohammadreza Najafi , Thamir M. Qadah , Mohammad Sadoghi , Hans-Arno Jacobsen

We propose DFModel, a modeling framework for mapping dataflow computation graphs onto large-scale systems. Mapping a workload to a system requires optimizing dataflow mappings at various levels, including the inter-chip (between chips)…

Hardware Architecture · Computer Science 2024-12-24 Sho Ko , Nathan Zhang , Olivia Hsu , Ardavan Pedram , Kunle Olukotun

Stream processing applications extract value from raw data through Directed Acyclic Graphs of data analysis tasks. Shared-nothing (SN) parallelism is the de-facto standard to scale stream processing applications. Given an application, SN…

Distributed, Parallel, and Cluster Computing · Computer Science 2022-05-02 Vincenzo Gulisano , Hannaneh Najdataei , Yiannis Nikolakopoulos , Alessandro V. Papadopoulos , Marina Papatriantafilou , Philippas Tsigas

Streaming, big data applications face challenges in creating scalable data flow pipelines, in which multiple data streams must be collected, stored, queried, and analyzed. These data sources are characterized by their volume (in terms of…

Databases · Computer Science 2014-07-23 Scott M. Sawyer , B. David O'Gwynn

The recent developments and research in distributed ledger technologies and blockchain have contributed to the increasing adoption of distributed systems. To collect relevant insights into systems' behavior, we observe many evaluation…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-10-27 Filip Rezabek , Kilian Glas , Richard von Seck , Achraf Aroua , Tizian Leonhardt , Georg Carle

The performance of Deep-Learning (DL) computing frameworks rely on the performance of data ingestion and checkpointing. In fact, during the training, a considerable high number of relatively small files are first loaded and pre-processed on…

Distributed, Parallel, and Cluster Computing · Computer Science 2019-04-10 Steven W. D. Chien , Stefano Markidis , Chaitanya Prasad Sishtla , Luis Santos , Pawel Herman , Sai Narasimhamurthy , Erwin Laure

In the most popular distributed stream processing frameworks (DSPFs), programs are modeled as a directed acyclic graph. This model allows a DSPF to benefit from the parallelism power of distributed clusters. However, choosing the proper…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-11-03 Hamid Nasiri , Saeed Nasehi , Arman Divband , Maziar Goudarzi

Most of the popular Big Data analytics tools evolved to adapt their working environment to extract valuable information from a vast amount of unstructured data. The ability of data mining techniques to filter this helpful information from…

Distributed, Parallel, and Cluster Computing · Computer Science 2022-09-23 Taha Tekdogan , Ali Cakmak

This article presents an automatic approach to quickly derive a good solution for hardware resource partition and task granularity for task-based parallel applications on heterogeneous many-core architectures. Our approach employs a…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-03-10 Peng Zhang , Jianbin Fang , Canqun Yang , Chun Huang , Tao Tang , Zheng Wang

Software modernisation through the migration from monolithic architectures to microservices has become increasingly critical, yet identifying effective service boundaries remains a complex and unresolved challenge. Although numerous…

Stream processing engines (SPEs) are widely used for large scale streaming analytics over unbounded time-ordered data streams. Modern day streaming analytics applications exhibit diverse compute characteristics and demand strict latency and…

Databases · Computer Science 2023-01-31 Anand Jayarajan , Wei Zhao , Yudi Sun , Gennady Pekhimenko

Performance of standard processes over large distributed networks typically scales with the size of the network. For example, in planar topologies where nodes communicate with their natural neighbors, the scaling factor is $O(n)$, where $n$…

Distributed, Parallel, and Cluster Computing · Computer Science 2019-02-18 Abhinav Mishra

Now we live in an era of big data, and big data applications are becoming more and more pervasive. How to benchmark data center computer systems running big data applications (in short big data systems) is a hot topic. In this paper, we…

Performance · Computer Science 2013-07-31 Zhen Jia , Runlin Zhou , Chunge Zhu , Lei Wang , Wanling Gao , Yingjie Shi , Jianfeng Zhan , Lixin Zhang

The prevalence of scientific workflows with high computational demands calls for their execution on various distributed computing platforms, including large-scale leadership-class high-performance computing (HPC) clusters. To handle the…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-02-10 Tainã Coleman , Henri Casanova , Ketan Maheshwari , Loïc Pottier , Sean R. Wilkinson , Justin Wozniak , Frédéric Suter , Mallikarjun Shankar , Rafael Ferreira da Silva

Graphs, consisting of vertices and edges, are vital for representing complex relationships in fields like social networks, finance, and blockchain. Visualizing these graphs helps analysts identify structural patterns, with readability…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-11-18 Sanggeon Yun

The last few years in the software engineering field has seen a paradigm shift from monolithic application towards architectures in which the application is split in various smaller entities (i.e., microservices) fueled by the improved…

Networking and Internet Architecture · Computer Science 2024-04-23 Emilien Wansart , Maxime Goffart , Justin Iurman , Benoit Donnet

Real-time embedded systems require precise timing and fault detection to ensure correct behavior. Traditional tracing tools often rely on local desktops with limited processing and storage capabilities, which hampers large-scale analysis.…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-07-29 David Jannis Schmidt , Grigory Fridman , Florian von Zabiensky