English
Related papers

Related papers: ML-based Modeling to Predict I/O Performance on Di…

200 papers

Object-oriented programming has long been regarded as too inefficient for SIMD high-performance computing, despite the fact that many important HPC applications have an inherent object structure. On SIMD accelerators, including GPUs, this…

Programming Languages · Computer Science 2019-06-11 Matthias Springer , Hidehiko Masuhara

When handling large datasets that exceed the capacity of the main memory, movement of data between main memory and external memory (disk), rather than actual (CPU) computation time, is often the bottleneck in the computation. Since data is…

Data Structures and Algorithms · Computer Science 2017-10-30 Lars Arge , Mathias Rav , Svend C. Svendsen , Jakob Truelsen

AI accelerator processing capabilities and memory constraints largely dictate the scale in which machine learning workloads (e.g., training and inference) can be executed within a desirable time frame. Training a state of the art,…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-10-12 Michael Benington , Leo Phan , Chris Pierre Paul , Evan Shoemaker , Priyanka Ranade , Torstein Collett , Grant Hodgson Perez , Christopher Krieger

Profiling techniques are used extensively at different parts of the computing stack to achieve many goals. One major goal is to make a piece of software execute more efficiently on a specific hardware platform, where efficiency spans…

Distributed, Parallel, and Cluster Computing · Computer Science 2017-11-07 Chris Quackenbush , Mohamed Zahran

Task parallelism research has traditionally focused on optimizing computation-intensive applications. Due to the proliferation of commodity parallel processors, there has been recent interest in supporting interactive applications. Such…

Distributed, Parallel, and Cluster Computing · Computer Science 2019-06-20 Kyle Singer , Kunal Agrawal , I-Ting Angelina Lee

For an increasing number of data intensive scientific applications, parallel I/O concepts are a major performance issue. Tackling this issue, we develop an input/output system designed for highly efficient, scalable and conveniently usable…

Distributed, Parallel, and Cluster Computing · Computer Science 2018-08-06 Erich Schikuta , Helmut Wanek , Heinz Stockinger , Kurt Stockinger , Thomas Fürle , Oliver Jorns , Christoph Löffelhardt , Peter Brezany , Minh Dang , Thomas Mück

The performance of data intensive applications is often dominated by their input/output (I/O) operations but the I/O stack of systems is complex and severely depends on system specific settings and hardware components. This situation makes…

Performance · Computer Science 2023-06-12 Masoud Gholami , Florian Schintke

The extensive use of HPC infrastructures and frameworks for running dataintensive applications has led to a growing interest in data partitioning techniques and strategies. In fact, application performance can be heavily affected by how…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-02-02 Riccardo Cantini , Fabrizio Marozzo , Alessio Orsino , Domenico Talia , Paolo Trunfio , Rosa M. Badia , Jorge Ejarque , Fernando Vazquez

Intermittently powered devices enable new applications in harsh or inaccessible environments, such as space or in-body implants, but also introduce problems in programmability and correctness. Researchers have developed programming models…

Programming Languages · Computer Science 2021-06-29 Milijana Surbatovich , Limin Jia , Brandon Lucia

Memory profiling captures programs' dynamic memory behavior, assisting programmers in debugging, tuning, and enabling advanced compiler optimizations like speculation-based automatic parallelization. As each use case demands its unique…

Performance · Computer Science 2023-11-07 Ziyang Xu , Yebin Chon , Yian Su , Zujun Tan , Sotiris Apostolakis , Simone Campanoni , David I. August

This paper explores a prevailing trend in the industry: migrating data-intensive analytics applications from on-premises to cloud-native environments. We find that the unique cost models associated with cloud-based storage necessitate a…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-11-02 Chunxu Tang , Yi Wang , Bin Fan , Beinan Wang , Shouwei Chen , Ziyue Qiu , Chen Liang , Jing Zhao , Yu Zhu , Mingmin Chen , Zhongting Hu

Performance modeling of parallel applications on multicore processors remains a challenge in computational co-design due to multicore processors' complex design. Multicores include complex private and shared memory hierarchies. We present a…

Distributed, Parallel, and Cluster Computing · Computer Science 2021-03-26 Atanu Barai , Gopinath Chennupati , Nandakishore Santhi , Abdel-Hameed Badawy , Yehia Arafa , Stephan Eidenbenz

Processing-in-memory (PIM) has emerged as a promising solution for accelerating memory-intensive workloads as they provide high memory bandwidth to the processing units. This approach has drawn attention not only from the academic community…

Hardware Architecture · Computer Science 2024-09-11 Dongjae Lee , Bongjoon Hyun , Taehun Kim , Minsoo Rhu

With the tremendous advances in processor and memory technology, I/O has risen to become the bottleneck in high-performance computing for many applications. The development of parallel file systems has helped to ease the performance gap,…

Distributed, Parallel, and Cluster Computing · Computer Science 2007-05-23 Avery Ching , Alok Choudhary , Wei-keng Liao , Rob Ross , William Gropp

We present PPT-Multicore, an analytical model embedded in the Performance Prediction Toolkit (PPT) to predict parallel application performance running on a multicore processor. PPT-Multicore builds upon our previous work towards a multicore…

We present the Cuckoo Trie, a fast, memory-efficient ordered index structure. The Cuckoo Trie is designed to have memory-level parallelism -- which a modern out-of-order processor can exploit to execute DRAM accesses in parallel -- without…

Data Structures and Algorithms · Computer Science 2022-01-25 Adar Zeitak , Adam Morrison

Optimizing scientific applications to take full advan-tage of modern memory subsystems is a continual challenge forapplication and compiler developers. Factors beyond working setsize affect performance. A benchmark framework that…

Performance · Computer Science 2018-12-20 Mahesh Lakshminarasimhan , Catherine Olschanowsky

Persistent Memory (PMEM), also known as Non-Volatile Memory (NVM), can deliver higher density and lower cost per bit when compared with DRAM. Its main drawback is that it is typically slower than DRAM. On the other hand, DRAM has…

Machine Learning · Computer Science 2022-11-07 Diego Moura , Vinicius Petrucci , Daniel Mosse

Frontier models increasingly adopt Mixture-of-Experts (MoE) architectures to achieve large-model performance at reduced cost. However, training MoE models on HPC platforms is hindered by large memory footprints, frequent large-scale…

Distributed, Parallel, and Cluster Computing · Computer Science 2026-05-07 Sajal Dash , Feiyi Wang

Data loading has been one of the most common performance bottlenecks for many big data applications, especially when they are running on inefficient human-readable formats, such as JSON or CSV. Parsing, validating, integrity checking and…

Databases · Computer Science 2021-02-24 Cong Ding , Dixin Tang , Xi Liang , Aaron J. Elmore , Sanjay Krishnan