English
Related papers

Related papers: Reading from External Memory

200 papers

The Intel Optane DC Persistent Memory (DCPM) is an attractive novel technology for building storage systems for data intensive HPC applications, as it provides lower cost per byte, low standby power and larger capacities than DRAM, with…

The growing memory demands of modern applications have driven the adoption of far memory technologies in data centers to provide cost-effective, high-capacity memory solutions. However, far memory presents new performance challenges because…

Hardware Architecture · Computer Science 2024-04-18 Luming Wang , Xu Zhang , Songyue Wang , Zhuolun Jiang , Tianyue Lu , Mingyu Chen , Siwei Luo , Keji Huang

Dataset storage, exchange, and access play a critical role in scientific applications. For such purposes netCDF serves as a portable and efficient file format and programming interface, which is popular in numerous scientific application…

Distributed, Parallel, and Cluster Computing · Computer Science 2007-05-23 Jianwei Li , Wei-keng Liao , Alok Choudhary , Robert Ross , Rajeev Thakur , William Gropp , Rob Latham

The input/output complexity, which is the complexity of data exchange between the main memory and the external memory, has been elaborately studied by a lot of former researchers. However, the existing works failed to consider the…

Computational Complexity · Computer Science 2022-08-23 Hengzhao Ma , Jianzhong Li , Xiangyu Gao , Tianpeng Gao

Scalable nonvolatile memory DIMMs will finally be commercially available with the release of the Intel Optane DC Persistent Memory Module (or just "Optane DC PMM"). This new nonvolatile DIMM supports byte-granularity accesses with access…

Distributed, Parallel, and Cluster Computing · Computer Science 2019-08-13 Joseph Izraelevitz , Jian Yang , Lu Zhang , Juno Kim , Xiao Liu , Amirsaman Memaripour , Yun Joon Soh , Zixuan Wang , Yi Xu , Subramanya R. Dulloor , Jishen Zhao , Steven Swanson

Custom memory organization are challenging task in the area of VLSI design. This study aims to design high speed and low power consumption memory for embedded system. Synchronous SRAM has been proposed and analyzed using various simulators.…

Hardware Architecture · Computer Science 2014-06-19 Ravi Khatwal , Manoj Kumar Jain

Over the past two decades, the storage capacity and access bandwidth of main memory have improved tremendously, by 128x and 20x, respectively. These improvements are mainly due to the continuous technology scaling of DRAM (dynamic…

Hardware Architecture · Computer Science 2017-12-25 Kevin K. Chang

With the tremendous advances in processor and memory technology, I/O has risen to become the bottleneck in high-performance computing for many applications. The development of parallel file systems has helped to ease the performance gap,…

Distributed, Parallel, and Cluster Computing · Computer Science 2007-05-23 Avery Ching , Alok Choudhary , Wei-keng Liao , Rob Ross , William Gropp

External sorting is at the core of many operations in large-scale database systems, such as ordering and aggregation queries for large result sets, building indexes, sort-merge joins, duplicate removal, sharding, and record clustering.…

Databases · Computer Science 2023-05-11 Ani Kristo , Tim Kraska

Intel OptaneTM DC Persistent Memory resides on the memory bus and approaches DRAM in access latency. One avenue for its adoption is to employ it in place of persistent storage; another is to use it as a cheaper and denser extension of DRAM.…

Hardware Architecture · Computer Science 2022-05-30 Alexandra Fedorova , Keith Smith , Keith Bostic , Alexander Gorrod , Sue LoVerso , Michael Cahill

In this paper, we introduce a new user-level DSM system which has the ability to directly interact with underlying interconnection networks. The DSM system provides the application programmer a flexible API to program parallel applications…

Distributed, Parallel, and Cluster Computing · Computer Science 2007-05-23 Bharath Ramesh , Srinidhi Varadarajan

As the High Performance Computing world moves towards the Exa-Scale era, huge amounts of data should be analyzed, manipulated and stored. In the traditional storage/memory hierarchy, each compute node retains its data objects in its local…

Distributed, Parallel, and Cluster Computing · Computer Science 2021-09-07 Yehonatan Fridman , Yaniv Snir , Matan Rusanovsky , Kfir Zvi , Harel Levin , Danny Hendler , Hagit Attiya , Gal Oren

We can use a hybrid memory system consisting of DRAM and Intel Optane DC Persistent Memory (We call it DCPM in this paper) as DCPM is now commercially available since April 2019. Even if the latency for DCPM is several times higher than…

Performance · Computer Science 2020-08-31 Kazuichi Oe

Modern Operating Systems are typically POSIX-compliant. The system calls are the fundamental layer of interaction between user-space applications and the OS kernel and its implementation of fundamental abstractions and primitives used in…

Operating Systems · Computer Science 2017-12-25 Vyacheslav Dubeyko , Cyril Guyot , Luis Cargnini , Adam Manzanares

Emerging storage systems with new flash exhibit ultra-low latency (ULL) that can address performance disparities between DRAM and conventional solid state drives (SSDs) in the memory hierarchy. Considering the advanced low-latency…

Operating Systems · Computer Science 2019-12-17 Sungjoon Koh , Junhyeok Jang , Changrim Lee , Miryeong Kwon , Jie Zhang , Myoungsoo Jung

This paper studies how RAID (redundant array of independent disks) could take full advantage of modern SSDs (solid-state drives) with built-in transparent compression. In current practice, RAID users are forced to choose a specific RAID…

Hardware Architecture · Computer Science 2022-09-12 Zheng Gu , Jiangpeng Li , Yong Peng , Yang Liu , Tong Zhang

Distributed algorithms that operate in the fail-recovery model rely on the state stored in stable memory to guarantee the irreversibility of operations even in the presence of failures. The performance of these algorithms lean heavily on…

Operating Systems · Computer Science 2020-02-19 William B. Mingardi , Gustavo M. D. Vieira

Next-generation supercomputers will feature more hierarchical and heterogeneous memory systems with different memory technologies working side-by-side. A critical question is whether at large scale existing HPC applications and emerging…

Distributed, Parallel, and Cluster Computing · Computer Science 2017-04-27 Ivy Bo Peng , Stefano Markidis , Erwin Laure , Gokcen Kestor , Roberto Gioiosa

Recent advances in optics have shown that solitons have a great potential for upgrading the future optical systems which demand fast and reliable data transfer. Along side Different architectures have evolved to realize an optical computer.…

General Physics · Physics 2011-01-18 Mohd Abubakr , R. M. Vinay

Almost all modern hardware, from phone SoCs to high-end servers with accelerators, contain memory translation and protection hardware like IOMMUs, firewalls, and lookup tables which make it impossible to reason about, and enforce protection…

Operating Systems · Computer Science 2020-09-08 Reto Achermann , Nora Hossle , Lukas Humbel , Daniel Schwyn , David Cock , Timothy Roscoe