English
Related papers

Related papers: DAOS as HPC Storage, a view from Numerical Weather…

200 papers

With the tremendous advances in processor and memory technology, I/O has risen to become the bottleneck in high-performance computing for many applications. The development of parallel file systems has helped to ease the performance gap,…

Distributed, Parallel, and Cluster Computing · Computer Science 2007-05-23 Avery Ching , Alok Choudhary , Wei-keng Liao , Rob Ross , William Gropp

Checkpointing large amounts of related data concurrently to stable storage is a common I/O pattern of many HPC applications. However, such a pattern frequently leads to I/O bottlenecks that lead to poor scalability and performance. As…

Distributed, Parallel, and Cluster Computing · Computer Science 2021-03-04 Bogdan Nicolae , Adam Moody , Gregory Kosinovsky , Kathryn Mohror , Franck Cappello

Data-driven predictive control (DPC) has been studied and used in various scenarios, since it could generate the predicted control sequence only relying on the historical input and output data. Recently, based on cloud computing,…

Systems and Control · Electrical Eng. & Systems 2022-09-19 Runze Gao , Qiwen Li , Li Dai , Yufeng Zhan , Yuanqing Xia

In recent years, the increasing complexity in scientific simulations and emerging demands for training heavy artificial intelligence models require massive and fast data accesses, which urges high-performance computing (HPC) platforms to…

Distributed, Parallel, and Cluster Computing · Computer Science 2021-08-04 Bo Fang , Daoce Wang , Sian Jin , Quincey Koziol , Zhao Zhang , Qiang Guan , Suren Byna , Sriram Krishnamoorthy , Dingwen Tao

We demonstrate that general-purpose memory allocation involving many threads on many cores can be done with high performance, multicore scalability, and low memory consumption. For this purpose, we have designed and implemented scalloc, a…

Programming Languages · Computer Science 2015-08-26 Martin Aigner , Christoph M. Kirsch , Michael Lippautz , Ana Sokolova

While (1) serverless computing is emerging as a popular form of cloud execution, datacenters are going through major changes: (2) storage dissaggregation in the system infrastructure level and (3) integration of domain-specific accelerators…

Ensuring Service Level Objectives (SLOs) in large-scale architectures, such as Distributed Computing Continuum Systems (DCCS), is challenging due to their heterogeneous nature and varying service requirements across different devices and…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-08-22 Alfreds Lapkovskis , Boris Sedlak , Sindri Magnússon , Schahram Dustdar , Praveen Kumar Donta

Exponential increases in scientific experimental data are outstripping the rate of progress in silicon technology. As a result, heterogeneous combinations of architectures and process or device technologies are increasingly important to…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-07-02 Wilkie Olin-Ammentorp , Xingfu Wu , Andrew A. Chien

This paper presents a high-performance, scalable network monitoring and intrusion detection system (IDS) implemented in P4. The proposed solution is designed for high-performance environments such as cloud data centers, where ultra-low…

Networking and Internet Architecture · Computer Science 2024-12-24 Yaying Chen , Siamak Layeghy , Liam Daly Manocchio , Marius Portmann

This paper examines disaggregated data center architectures from the perspective of the applications that would run on these data centers, and challenges the abstractions that have been proposed to date. In particular, we argue that…

Operating Systems · Computer Science 2019-10-30 Sebastian Angel , Mihir Nanavati , Siddhartha Sen

With the advent of hundreds of cores on a chip to accelerate applications, the operating system (OS) needs to exploit the existing parallelism provided by the underlying hardware resources to determine the right amount of processes to be…

Operating Systems · Computer Science 2025-01-07 Yao Xiao , Nikos Kanakaris , Anzhe Cheng , Chenzhong Yin , Nesreen K. Ahmed , Shahin Nazarian , Andrei Irimia , Paul Bogdan

Many high end and next generation computing systems to incorporated alternative memory technologies to meet performance goals. Since these technologies present distinct advantages and tradeoffs compared to conventional DDR* SDRAM, such as…

Performance · Computer Science 2021-10-06 M. Ben Olson , Brandon Kammerdiener , Kshitij A. Doshi , Terry Jones , Michael R. Jantz

A model of cloud services is emerging whereby a few trusted providers manage the underlying hardware and communications whereas many companies build on this infrastructure to offer higher level, cloud-hosted PaaS services and/or SaaS…

Cryptography and Security · Computer Science 2018-05-09 Thomas F. J. -M. Pasquier , Jatinder Singh , David Eyers , Jean Bacon

Object-oriented programming has long been regarded as too inefficient for SIMD high-performance computing, despite the fact that many important HPC applications have an inherent object structure. On SIMD accelerators, including GPUs, this…

Programming Languages · Computer Science 2019-06-11 Matthias Springer , Hidehiko Masuhara

Current HPC systems provide memory resources that are statically configured and tightly coupled with compute nodes. However, workloads on HPC systems are evolving. Diverse workloads lead to a need for configurable memory resources to…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-03-23 Jacob Wahlgren , Maya Gokhale , Ivy B. Peng

We examine the problem of creating an encoded distributed storage representation of a data object for a network of mobile storage nodes so as to achieve the optimal recovery delay. A source node creates a single data object and disseminates…

Information Theory · Computer Science 2016-11-17 Derek Leong , Alexandros G. Dimakis , Tracey Ho

Distributed systems often serve dynamic workloads and resource demands evolve over time. Such a temporal behavior stands in contrast to the static and demand-oblivious nature of most data structures used by these systems. In this paper, we…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-11-19 Arash Pourdamghani , Chen Avin , Robert Sama , Maryam Shiran , Stefan Schmid

Next-generation supercomputers will feature more hierarchical and heterogeneous memory systems with different memory technologies working side-by-side. A critical question is whether at large scale existing HPC applications and emerging…

Distributed, Parallel, and Cluster Computing · Computer Science 2017-04-27 Ivy Bo Peng , Stefano Markidis , Erwin Laure , Gokcen Kestor , Roberto Gioiosa

Recently, a new generation of P2P systems capable of addressing data integrity and authenticity has emerged for the development of new applications for a "more" decentralized Internet, i.e., Distributed Ledger Technologies (DLT) and…

Distributed, Parallel, and Cluster Computing · Computer Science 2021-09-13 Mirko Zichichi , Luca Serena , Stefano Ferretti , Gabriele D'Angelo

This paper advocates the use of the distributed compressed sensing (DCS) paradigm to deploy energy harvesting (EH) Internet of Thing (IoT) devices for energy self-sustainability. We consider networks with signal/energy models that capture…

Information Theory · Computer Science 2021-01-28 Wei Chen , Nikos Deligiannis , Yiannis Andreopoulos , Ian J. Wassell