English
Related papers

Related papers: DAOS as HPC Storage, a view from Numerical Weather…

200 papers

The advent of the Internet of Things (IoT) gives the opportunity to numerous devices to interact with their environment, collect and process data. Data are transferred, in an upwards mode, to the Cloud through the Edge Computing (EC)…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-07-29 T. Koukaras , K. Kolomvatsos

High-performance computing (HPC) storage systems become increasingly critical to scientific applications given the data-driven discovery paradigm shift. As a storage solution for large-scale HPC systems, dozens of applications share the…

Distributed, Parallel, and Cluster Computing · Computer Science 2018-05-17 Neda Tavakoli , Dong Dai , John Jenkins , Philip Carns , Robert Ross , Yong Chen

We present a comprehensive study on applying machine learning to detect distributed Denial of service (DDoS) attacks using large-scale Internet of Things (IoT) systems. While prior works and existing DDoS attacks have largely focused on…

Cryptography and Security · Computer Science 2023-02-17 Arvin Hekmati , Nishant Jethwa , Eugenio Grippo , Bhaskar Krishnamachari

HPC and Cloud have evolved independently, specializing their innovations into performance or productivity. Acceleration as a Service (XaaS) is a recipe to empower both fields with a shared execution platform that provides transparent access…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-01-10 Torsten Hoefler , Marcin Copik , Pete Beckman , Andrew Jones , Ian Foster , Manish Parashar , Daniel Reed , Matthias Troyer , Thomas Schulthess , Dan Ernst , Jack Dongarra

High-level I/O libraries, such as HDF5 and PnetCDF, are commonly used by large-scale scientific applications to perform I/O tasks in parallel. These I/O libraries store the metadata such as data types and dimensionality along with the raw…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-06-19 Youjia Li , Robert Latham , Robert Ross , Ankit Agrawal , Alok Choudhary , Wei-Keng Liao

One of the most discussed features offered by Information-centric Networking (ICN) architectures is the ability to support packet-level caching at every node in the network. By individually naming each packet, ICN allows routers to turn…

Networking and Internet Architecture · Computer Science 2016-01-28 Yannis Thomas , George Xylomenos , Christos Tsilopoulos , George C. Polyzos

Internet of Things (IoT) is a technology paradigm where millions of sensors monitor, and help inform or manage, physical, envi- ronmental and human systems in real-time. The inherent closed-loop re- sponsiveness and decision making of IoT…

Distributed, Parallel, and Cluster Computing · Computer Science 2019-05-13 Anshu Shukla , Yogesh Simmhan

As the complexity of enterprise systems increases, the need for monitoring and analyzing such systems also grows. A number of companies have built sophisticated monitoring tools that go far beyond simple resource utilization reports. For…

To deal with the constant growth of unstructured data, vendors have deployed scalable, resilient, and cost effective object-based storage systems built on RESTful web services. However, many applications rely on richer file-system APIs and…

Distributed, Parallel, and Cluster Computing · Computer Science 2019-09-02 Kunal Lillaney , Vasily Tarasov , David Pease , Randal Burns

Byte-addressable persistent memory (PM) brings hash tables the potential of low latency, cheap persistence and instant recovery. The recent advent of Intel Optane DC Persistent Memory Modules (DCPMM) further accelerates this trend. Many new…

Databases · Computer Science 2020-10-30 Baotong Lu , Xiangpeng Hao , Tianzheng Wang , Eric Lo

Modern storage systems often combine fast cache with slower backend devices to accelerate I/O. As performance gaps narrow, concurrently accessing both devices, rather than relying solely on cache hits, can improve throughput. However, in…

Operating Systems · Computer Science 2026-04-21 Joon Yong Hwang , Chanseo Park , Younghoon Kim

With the advent of the Internet-of-Things (IoT), handling large volumes of time-series data has become a growing concern. Data, generated from millions of Internet-connected sensors, will drive new IoT applications and services. A key…

Databases · Computer Science 2016-05-10 Daniel G. Waddington , Changhui Lin

Data-intensive applications often require exploratory analysis of large datasets. If analysis is performed on distributed resources, data locality can be crucial to high throughput and performance. We propose a "data diffusion" approach…

Distributed, Parallel, and Cluster Computing · Computer Science 2016-11-17 Ioan Raicu , Yong Zhao , Ian Foster , Alex Szalay

Increasing investment in computing technologies and the advancements in silicon technology has fueled rapid growth in advanced driver assistance systems (ADAS) and corresponding SoC developments. An ADAS SoC represents a heterogeneous…

Hardware Architecture · Computer Science 2022-09-14 Hao Luan , Yu Yao , Chang Huang

We implement and benchmark parallel I/O methods for the fully-manycore driven particle-in-cell code PIConGPU. Identifying throughput and overall I/O size as a major challenge for applications on today's and future HPC systems, we present a…

Data Access will be the next generation data abstraction layer for EPICS. Its implementation in C++ brought up a number of issues that are related to object oriented technology's impact on CPU and memory usage. What is gained by the new…

Software Engineering · Computer Science 2007-05-23 R. Lange , J. Hill

Storage systems are essential building blocks for cloud computing infrastructures. Although high performance storage servers are the ultimate solution for cloud storage, the implementation of inexpensive storage system remains an open…

Distributed, Parallel, and Cluster Computing · Computer Science 2011-12-30 Julia Myint , Thinn Thu Naing

This report evaluates the new analytical capabilities of DataStax Enterprise (DSE) [1] through the use of standard Hadoop workloads. In particular, we run experiments with CPU and I/O bound micro-benchmarks as well as OLAP-style analytical…

Distributed, Parallel, and Cluster Computing · Computer Science 2014-12-17 Todor Ivanov , Raik Niemann , Sead Izberovic , Marten Rosselli , Karsten Tolle , Roberto V. Zicari

As the High Performance Computing world moves towards the Exa-Scale era, huge amounts of data should be analyzed, manipulated and stored. In the traditional storage/memory hierarchy, each compute node retains its data objects in its local…

Distributed, Parallel, and Cluster Computing · Computer Science 2021-09-07 Yehonatan Fridman , Yaniv Snir , Matan Rusanovsky , Kfir Zvi , Harel Levin , Danny Hendler , Hagit Attiya , Gal Oren

Object-based parallel file systems have emerged as promising storage solutions for high-performance computing (HPC) systems. Despite the fact that object storage provides a flexible interface, scheduling highly concurrent I/O requests that…

Distributed, Parallel, and Cluster Computing · Computer Science 2018-05-17 Neda Tavakoli , Dong Dai , Yong Chen