English

Using Intel Optane Devices for In-situ Data Staging in HPC Workflows

Distributed, Parallel, and Cluster Computing 2018-07-26 v1
Authors: Pradeep Subedi , Philip E. Davis , J. J. Villalobos , Ivan Rodero , Manish Parashar
View on arXiv ↗ PDF ↗

Abstract

Emerging non-volatile memory technologies (NVRAM) offer alternatives to hard drives that are persistent, while providing similar latencies to DRAM. Intel recently released the Optane drive, which features 3D XPoint memory technology. This device can be deployed as an SSD or as persistent memory. In this paper, we provide a performance comparison between Optane (SSD DC4800X) and NVMe (SSD DC3700) drives as block devices. We study the performance from two perspectives: 1) Benchmarking of drives using FIO workloads, and 2) Assessing the impact of using Optane over NVMe within the DataSpaces framework for in-memory data staging to support in-situ scientific workflows.

Keywords

memory hierarchy

Cite

@article{arxiv.1807.09651,
  title  = {Using Intel Optane Devices for In-situ Data Staging in HPC Workflows},
  author = {Pradeep Subedi and Philip E. Davis and J. J. Villalobos and Ivan Rodero and Manish Parashar},
  journal= {arXiv preprint arXiv:1807.09651},
  year   = {2018}
}

Related papers

View all related →
Distributed, Parallel, and Cluster Computing · Computer Science
Early Evaluation of Intel Optane Non-Volatile Memory with HPC I/O Workloads
Kai Wu, Frank Ober, Shari Hamlin, Dong Li
2018-05-15
Performance · Computer Science
Evaluation of Intel Memory Drive Technology Performance for Scientific Applications
Vladimir Mironov, Andrey Kudryavtsev, Yuri Alexeev, Alexander Moskovsky +2
2018-11-27
Databases · Computer Science
Lessons learned from the early performance evaluation of Intel Optane DC Persistent Memory in DBMS
Yinjun Wu, Kwanghyun Park, Rathijit Sen, Brian Kroth +1
2020-05-18
Distributed, Parallel, and Cluster Computing · Computer Science
System Evaluation of the Intel Optane Byte-addressable NVM
Ivy B. Peng, Maya B. Gokhale, Eric W. Green
2019-10-18
Distributed, Parallel, and Cluster Computing · Computer Science
An Empirical Guide to the Behavior and Use of Scalable Persistent Memory
Jian Yang, Juno Kim, Morteza Hoseinzadeh, Joseph Izraelevitz +1
2019-08-13
Distributed, Parallel, and Cluster Computing · Computer Science
Basic Performance Measurements of the Intel Optane DC Persistent Memory Module
Joseph Izraelevitz, Jian Yang, Lu Zhang, Juno Kim +8
2019-08-13
Distributed, Parallel, and Cluster Computing · Computer Science
Assessing the Use Cases of Persistent Memory in High-Performance Scientific Computing
Yehonatan Fridman, Yaniv Snir, Matan Rusanovsky, Kfir Zvi +4
2021-09-07
Hardware Architecture · Computer Science
Writes Hurt: Lessons in Cache Design for Optane NVRAM
Alexandra Fedorova, Keith Smith, Keith Bostic, Alexander Gorrod +2
2022-05-30
Hardware Architecture · Computer Science
Extending Memory Capacity in Consumer Devices with Emerging Non-Volatile Memory: An Experimental Study
Geraldo F. Oliveira, Saugata Ghose, Juan Gómez-Luna, Amirali Boroumand +7
2023-09-20
Databases · Computer Science
Energy Consumption Evaluation of Optane DC Persistent Memory for Indexing Data Structures
Manolis Katsaragakis, Christos Baloukas, Lazaros Papadopoulos, Verena Kantere +2
2023-04-04
Distributed, Parallel, and Cluster Computing · Computer Science
Unimem: Runtime Data Management on Non-Volatile Memory-based Heterogeneous Main Memory
Kai Wu, Yingchao Huang, Dong Li
2017-05-03
Databases · Computer Science
Evaluating Persistent Memory Range Indexes: Part Two [Extended Version]
Yuliang He, Duo Lu, Kaisong Huang, Tianzheng Wang
2022-07-29
Distributed, Parallel, and Cluster Computing · Computer Science
Intel Optane DCPMM and Serverless Computing
Ahmet Uyar, Selahattin Akkas, Jiayu Li, Judy Fox
2021-09-24
Emerging Technologies · Computer Science
NVMExplorer: A Framework for Cross-Stack Comparisons of Embedded Non-Volatile Memories
Lillian Pentecost, Alexander Hankin, Marco Donato, Mark Hempstead +2
2022-01-13
Performance · Computer Science
A Prompt Report on the Performance of Intel Optane DC Persistent Memory Module
Takahiro Hirofuchi, Ryousei Takano
2020-06-24
Performance · Computer Science
Performance benefits of Intel(R) OptaneTM DC persistent memory for the parallel processing of large neuroimaging data
Valerie Hayot-Sasson, Shawn T Brown, Tristan Glatard
2019-12-30
Emerging Technologies · Computer Science
First Demonstration of 28 nm Fabricated FeFET-Based Nonvolatile 6T SRAM
Albi Mema, Simon Thomann, Narendra Singh Dhakad, Hussam Amrouch
2026-03-30
Hardware Architecture · Computer Science
Modeling and Simulating Emerging Memory Technologies: A Tutorial
Yun-Chih Chen, Tristan Seidl, Nils Hölscher, Christian Hakert +14
2025-03-11
Operating Systems · Computer Science
The Preliminary Evaluation of a Hypervisor-based Virtualization Mechanism for Intel Optane DC Persistent Memory Module
Takahiro Hirofuchi, Ryousei Takano
2019-07-30
Hardware Architecture · Computer Science
On the Reliability of Computing-in-Memory Accelerators for Deep Neural Networks
Zheyu Yan, Xiaobo Sharon Hu, Yiyu Shi
2022-05-27
Databases · Computer Science
How to use Persistent Memory in your Database
Dimitrios Koutsoukos, Raghav Bhartia, Ana Klimovic, Gustavo Alonso
2021-12-02
Distributed, Parallel, and Cluster Computing · Computer Science
Performance Evaluation and Modeling of HPC I/O on Non-Volatile Memory
Wei Liu, Kai Wu, Jialin Liu, Feng Chen +1
2017-05-11
Programming Languages · Computer Science
Emulating Hybrid Memory on NUMA Hardware
Shoaib Akram, Jennifer B. Sartor, Kathryn S. McKinley, Lieven Eeckhout
2018-08-02
Distributed, Parallel, and Cluster Computing · Computer Science
A Survey of Non-Volatile Main Memory Technologies: State-of-the-Arts, Practices, and Future Directions
Haikun Liu, Di Chen, Hai Jin, Xiaofei Liao +3
2020-10-12
Operating Systems · Computer Science
Motivating Next-Generation OS Physical Memory Management for Terabyte-Scale NVMMs
Shivank Garg, Aravinda Prasad, Debadatta Mishra, Sreenivas Subramoney
2023-10-06
R2 v1 2026-06-23T03:14:05.622Z