English
Related papers

Related papers: DuckDB on xNVMe

200 papers

This paper introduces NVCache, an approach that uses a non-volatile main memory (NVMM) as a write cache to improve the write performance of legacy applications. We compare NVCache against file systems tailored for NVMM (Ext4-DAX and NOVA)…

Distributed, Parallel, and Cluster Computing · Computer Science 2021-09-06 Rémi Dulong , Rafael Pires , Andreia Correia , Valerio Schiavoni , Pedro Ramalhete , Pascal Felber , Gaël Thomas

Object storage solutions potentially address long-standing performance issues with POSIX file systems for certain I/O workloads, and new storage technologies offer promising performance characteristics for data-intensive use cases. In this…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-02-28 Nicolau Manubens , Tiago Quintino , Simon D. Smart , Emanuele Danovaro , Adrian Jackson

Contrary to the other resources such as CPU, memory, and network, for which virtualization is efficiently achieved through direct access, disk virtualization is peculiar. In this paper, we make four contributions. Our first contribution is…

Distributed, Parallel, and Cluster Computing · Computer Science 2022-05-17 Kevin Nguetchouang , Theophile Dubuc , Stella Bitchebe , Alain Tchana , Pierre Olivier

This work in progress paper outlines research looking at the performance impact of using different storage interfaces to access the high performance object store DAOS. We demonstrate that using DAOS through a FUSE based filesystem interface…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-12-01 Adrian Jackson , Nicolau Manubens

Scalable nonvolatile memory DIMMs will finally be commercially available with the release of the Intel Optane DC Persistent Memory Module (or just "Optane DC PMM"). This new nonvolatile DIMM supports byte-granularity accesses with access…

Distributed, Parallel, and Cluster Computing · Computer Science 2019-08-13 Joseph Izraelevitz , Jian Yang , Lu Zhang , Juno Kim , Xiao Liu , Amirsaman Memaripour , Yun Joon Soh , Zixuan Wang , Yi Xu , Subramanya R. Dulloor , Jishen Zhao , Steven Swanson

Modern operating systems manage and abstract hardware resources, to ensure efficient execution of user workloads. The operating system must securely interface with often untrusted user code while relying on hardware that is assumed to be…

Cryptography and Security · Computer Science 2024-11-04 Rick Wertenbroek , Alberto Dassatti

Traditionally, DBMSs separate their storage layer from their indexing layer. While the storage layer physically materializes the database and provides low-level access methods to it, the indexing layer on top enables a faster locating of…

Databases · Computer Science 2022-12-07 Felix Schuhknecht , Justus Henneberg

With the tremendous advances in processor and memory technology, I/O has risen to become the bottleneck in high-performance computing for many applications. The development of parallel file systems has helped to ease the performance gap,…

Distributed, Parallel, and Cluster Computing · Computer Science 2007-05-23 Avery Ching , Alok Choudhary , Wei-keng Liao , Rob Ross , William Gropp

Dataset storage, exchange, and access play a critical role in scientific applications. For such purposes netCDF serves as a portable and efficient file format and programming interface, which is popular in numerous scientific application…

Distributed, Parallel, and Cluster Computing · Computer Science 2007-05-23 Jianwei Li , Wei-keng Liao , Alok Choudhary , Robert Ross , Rajeev Thakur , William Gropp , Rob Latham

Software managed byte-addressable hybrid memory systems consisting of DRAMs and NVMMs offer a lot of flexibility to design efficient large scale data processing applications. Operating systems (OS) play an important role in enabling the…

Operating Systems · Computer Science 2023-10-06 Shivank Garg , Aravinda Prasad , Debadatta Mishra , Sreenivas Subramoney

Non-volatile memory is expected to co-exist or replace DRAM in upcoming architectures. Durable concurrent data structures for non-volatile memories are essential building blocks for constructing adequate software for use with these…

Distributed, Parallel, and Cluster Computing · Computer Science 2019-09-10 Yoav Zuriel , Michal Friedman , Gali Sheffi , Nachshon Cohen , Erez Petrank

Efficient virtualization of CPU and memory is standardized and mature. Capabilities such as Intel VT-x [3] have been added by manufacturers for efficient hypervisor support. In contrast, virtualization of a block device and its presentation…

Networking and Internet Architecture · Computer Science 2024-09-05 Vojtech Aschenbrenner , John Shawger , Sadman Sakib

Non-volatile memory (NVM) is an emerging technology, which has the persistence characteristics of large capacity storage devices(e.g., HDDs and SSDs), while providing the low access latency and byte-addressablity of traditional DRAM memory.…

Databases · Computer Science 2020-05-18 Yinjun Wu , Kwanghyun Park , Rathijit Sen , Brian Kroth , Jaeyoung Do

In this paper we present a new approach for distributed DBMSs called P4DB, that uses a programmable switch to accelerate OLTP workloads. The main idea of P4DB is that it implements a transaction processing engine on top of a P4-programmable…

Databases · Computer Science 2022-06-02 Matthias Jasny , Lasse Thostrup , Tobias Ziegler , Carsten Binnig

HPC applications pose high demands on I/O performance and storage capability. The emerging non-volatile memory (NVM) techniques offer low-latency, high bandwidth, and persistence for HPC applications. However, the existing I/O stack are…

Distributed, Parallel, and Cluster Computing · Computer Science 2017-05-11 Wei Liu , Kai Wu , Jialin Liu , Feng Chen , Dong Li

Solid-state drives (SSDs) are well suited for near-data processing (NDP) because they: (1) store large application datasets, and (2) support three NDP paradigms: in-storage processing (ISP), processing using DRAM in the SSD (PuD-SSD), and…

SSDs are emerging storage devices which unlike HDDs, do not have mechanical parts and therefore, have superior performance compared to HDDs. Due to the high cost of SSDs, entirely replacing HDDs with SSDs is not economically justified.…

Performance · Computer Science 2018-12-12 Reza Salkhordeh , Mostafa Hadizadeh , Hossein Asadi

The standardization of NVMe Zoned Namespaces (ZNS) in the NVMe 2.0 specification presents a unique new addition to storage devices. Unlike traditional SSDs, where the flash media management idiosyncrasies are hidden behind a flash…

Operating Systems · Computer Science 2022-06-06 Nick Tehrany , Animesh Trivedi

The CXL-based solid-state drive (CXL-SSD) provides a promising approach towards scaling the main memory capacity at low cost. However, the CXL-SSD faces performance challenges due to the long flash access latency and unpredictable events…

Hardware Architecture · Computer Science 2025-01-22 Haoyang Zhang , Yuqi Xue , Yirui Eric Zhou , Shaobo Li , Jian Huang

NAND flash-based Solid State Drives (SSDs), which are widely used from embedded systems to enterprise servers, are enhancing performance by exploiting the parallelism of NAND flash memories. To cope with the performance improvement of SSDs,…

Hardware Architecture · Computer Science 2017-04-12 Yeong-Jae Woo , Sang Lyul Min