English
Related papers

Related papers: AisLSM: Revolutionizing the Compaction with Asynch…

200 papers

Log-Structured Merge tree (LSM tree) Key-Value (KV) stores have become a foundational layer in the storage stacks of datacenter and cloud services. Current approaches for achieving reliability and availability avoid replication at the KV…

Databases · Computer Science 2021-10-20 Michalis Vardoulakis , Giorgos Saloustros , Pilar González-Férez , Angelos Bilas

Modern data-intensive applications increasingly store and process big-value items, such as multimedia objects and machine learning embeddings, which exacerbate storage inefficiencies in Log-Structured Merge-Tree (LSM)-based key-value…

Databases · Computer Science 2025-06-10 Ming Li , Wendi Cheng , Jiahe Wei , Xueqiang Shan , Weikai Liu , Xiaonan Zhao , Xiao Zhang

We present~\emph{KV-Tandem}, a modular architecture for building LSM-based storage engines on top of simple, non-ordered persistent key-value stores (KVSs). KV-Tandem enables advanced functionalities such as range queries and snapshot…

This study proposes a novel storage engine, SynchroStore, designed to address the inefficiency of update operations in columnar storage systems based on Log-Structured Merge Trees (LSM-Trees) under hybrid workload scenarios. While columnar…

Databases · Computer Science 2025-03-25 Yinan Zhang , Huiqi Hu , Xuan Zhou

We use machine learning to optimize LSM-tree structure, aiming to reduce the cost of processing various read/write operations. We introduce a new approach Camal, which boasts the following features: (1) ML-Aided: Camal is the first attempt…

Databases · Computer Science 2024-09-24 Weiping Yu , Siqiang Luo , Zihao Yu , Gao Cong

Zoned storage devices, such as zoned namespace (ZNS) solid-state drives (SSDs) and host-managed shingled magnetic recording (HM-SMR) hard-disk drives (HDDs), expose interfaces for host-level applications to support fine-grained,…

Performance · Computer Science 2022-05-25 Jinhong Li , Qiuping Wang , Patrick P. C. Lee

Log-Structured Merge (LSM) tree-based Key-Value Stores (KVSs) are widely adopted for their high performance in write-intensive environments, but they often face performance degradation due to write stalls during compaction. Prior solutions,…

Hardware Architecture · Computer Science 2024-10-30 KiHwan Kim , Hyunsun Chung , Seonghoon Ahn , Junhyeok Park , Safdar Jamil , Hongsu Byun , Myungcheol Lee , Jinchun Choi , Youngjae Kim

LSM-tree based key-value stores are widely adopted as the data storage backend in modern big data applications. The LSM-tree grows with data ingestion, by either adding levels with fixed level capacities (dubbed as vertical scheme) or…

Databases · Computer Science 2025-04-25 Dingheng Mo , Siqiang Luo , Stratos Idreos

Log-Structured-Merge (LSM) tree-based key value stores are facing critical challenges of fully leveraging the dramatic performance improvements of the underlying storage devices, which makes the compaction operations of LSM key value stores…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-04-08 Peng Xu , Jiguang Wan , Ping Huang , Xiaogang Yang , Chenlei Tang , Fei Wu , Changsheng Xie

We propose BS-tree, an in-memory implementation of the B+-tree that adopts the structure of the disk-based index (i.e., a balanced, multiway tree), setting the node size to a memory block that can be processed fast and in parallel using…

Databases · Computer Science 2025-11-14 Dimitrios Tsitsigkos , Achilleas Michalopoulos , Nikos Mamoulis , Manolis Terrovitis

Log-Structured Merge trees (LSM trees) are increasingly used as the storage engines behind several data systems, frequently deployed in the cloud. Similar to other database architectures, LSM trees take into account information about the…

Databases · Computer Science 2021-11-04 Andy Huynh , Harshal A. Chaudhari , Evimaria Terzi , Manos Athanassoulis

In recent years, emerging storage hardware technologies have focused on divergent goals: better performance or lower cost-per-bit. Correspondingly, data systems that employ these technologies are typically optimized either to be fast (but…

Databases · Computer Science 2022-05-27 Ashwini Raina , Jianan Lu , Asaf Cidon , Michael J. Freedman

Modern key-value stores rely heavily on Log-Structured Merge (LSM) trees for write optimization, but this design introduces significant read amplification. Auxiliary structures like Bloom filters help, but impose memory costs that scale…

Data Structures and Algorithms · Computer Science 2025-08-05 Nicholas Fidalgo , Puyuan Ye

The proliferation of small files in data lakes poses significant challenges, including degraded query performance, increased storage costs, and scalability bottlenecks in distributed storage systems. Log-structured table formats (LSTs) such…

Modern large language models (LLMs) drive interactive AI systems but are bottlenecked by the memory-heavy growth of key-value (KV) caches, which limits real-time throughput under concurrent loads. Existing KV-cache compression methods rely…

Machine Learning · Computer Science 2026-01-07 Joseph Kampeas , Emir Haleva

Understanding the performance profiles of storage devices and how best to utilize them has always been non-trivial due to factors such as seek times, caching, scheduling, concurrent access, flash wear-out, and garbage collection. However,…

Data Structures and Algorithms · Computer Science 2025-07-10 Erin Ransom , Andrew Lim , Michael Mitzenmacher

Indexes facilitate efficient querying when the selection predicate is on an indexed key. As a result, when loading data, if we anticipate future selective (point or range) queries, we typically maintain an index that is gradually populated…

Databases · Computer Science 2022-02-10 Aneesh Raman , Subhadeep Sarkar , Matthaios Olma , Manos Athanassoulis

The Log Structured Merge (LSM) Tree is a popular choice for key-value stores that focus on optimized write throughput while maintaining performant, production-ready read latencies. To optimize read performance, LSM stores rely on a…

Databases · Computer Science 2025-02-18 Hayder Tirmazi

Owing to the characteristics of high density and unlimited write cycles, skyrmion racetrack memory (SK-RM) has demonstrated great potential as either the next-generation main memory or the last-level cache of processors with non-volatility.…

Hardware Architecture · Computer Science 2024-07-26 Yu-Shiang Tsai , Shuo-Han Chen , Martijn Noorlander , Kuan-Hsun Chen

In-memory key-value stores (IMKVSes) serve many online applications because of their efficiency. To support data backup, popular industrial IMKVSes periodically take a point-in-time snapshot of the in-memory data with the system call fork.…