English
Related papers

Related papers: BVLSM: Write-Efficient LSM-Tree Storage via WAL-Ti…

200 papers

Many applications require update-intensive workloads on spatial objects, e.g., social-network services and shared-riding services that track moving objects. By buffering insert and delete operations in memory, the Log Structured Merge Tree…

Data Structures and Algorithms · Computer Science 2023-05-03 Jaewoo Shin , Jianguo Wang , Walid G. Aref

Modern key-value stores rely heavily on Log-Structured Merge (LSM) trees for write optimization, but this design introduces significant read amplification. Auxiliary structures like Bloom filters help, but impose memory costs that scale…

Data Structures and Algorithms · Computer Science 2025-08-05 Nicholas Fidalgo , Puyuan Ye

The cloud infrastructure motivates disaggregation of monolithic data stores into components that are assembled together based on an application's workload. This study investigates disaggregation of an LSM-tree key-value store into…

Databases · Computer Science 2021-05-04 Haoyu Huang , Shahram Ghandeharizadeh

Key\-value separation is used in LSM\-tree to stored large value in separate log files to reduce write amplification, but requires garbage collection to garbage collect invalid values. Existing garbage collection techniques in LSM\-tree…

Databases · Computer Science 2024-06-04 Zhutao Zhuang , Xinqi Zeng , Zhiguang Chen

Modern mainstream persistent key-value storage engines utilize Log-Structured Merge tree (LSM-tree) based designs, optimizing read/write performance by leveraging sequential disk I/O. However, the advent of SSDs, with their significant…

Databases · Computer Science 2024-06-27 Jin Jiang , Dongsheng He , Yu Hu , Dong Liu , Chenfan Xiao , Hongxiao Bi , Yusong Zhang , Chaoqu Jiang , Zhijun Fu

Log-Structured Merge-tree-based Key-Value Stores (LSM-KVS) have been optimized and redesigned for disaggregated storage via techniques such as compaction offloading to reduce the network I/Os between compute and storage. However, the…

Databases · Computer Science 2026-03-06 Qi Lin , Gangqi Huang , Te Guo , Chang Guo , Viraj Thakkar , Zichen Zhu , Jianguo Wang , Zhichao Cao

With the prevalence of online platforms, today, data is being generated and accessed by users at a very high rate. Besides, applications such as stock trading or high frequency trading require guaranteed low delays for performing an…

Databases · Computer Science 2020-03-03 Sepanta Zeighami , Raymond Chi-Wing Wong

Scan-based operations, such as backstage compaction and value filtering, have emerged as the main bottleneck for LSM-Trees in supporting contemporary data-intensive applications. For slower external storage devices, such as HDD and SATA…

Databases · Computer Science 2025-08-19 Jianfeng Huang , Ziyao Wang , Lin Yuan , Jiajie Wen , Yihao Cao , Dongjing Miao , Yong Wang , Jiahao Zhang

The Log Structured Merge Trees (LSM-tree) based key-value stores are widely used in many storage systems to support a variety of operations such as updates, point reads, and range reads. Traditionally, LSM-tree's merge policy organizes data…

Databases · Computer Science 2024-07-02 Fuheng Zhao , Zach Miller , Leron Reznikov , Divyakant Agrawal , Amr El Abbadi

LSM-tree has been widely used in cloud computing systems by Google, Facebook, and Amazon, to achieve high performance for write-intensive workloads. However, in LSM-tree, random key-value queries can experience long latency and low…

Data Structures and Algorithms · Computer Science 2016-06-08 Lei Guo , Dejun Teng , Rubao Lee , Feng Chen , Siyuan Ma , Xiaodong Zhang

This paper studies the design of B-tree that can take full advantage of modern storage hardware with built-in transparent compression. Recent years have witnessed significant interest in applying log-structured merge tree (LSM-tree) as an…

Databases · Computer Science 2021-07-30 Yifan Qiao , Xubin Chen , Ning Zheng , Jiangpeng Li , Yang Liu , Tong Zhang

We present Keigo, a concurrency- and workload-aware storage middleware that enhances the performance of log-structured merge key-value stores (LSM KVS) when they are deployed on a hierarchy of storage devices. The key observation behind…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-06-18 Rúben Adão , Zhongjie Wu , Changjun Zhou , Oana Balmau , João Paulo , Ricardo Macedo

Modern key-value storage engines built on Log-Structured Merge-trees (LSM-trees), such as RocksDB and LevelDB, rely heavily on the performance of their compaction operations, which are impacted by a complex set of interdependent…

Performance · Computer Science 2026-02-16 Jiabiao Ding , Yina Lv , Qiao Li , Zhirong Shen , Chun Jason Xue

The growing volume of graph data may exhaust the main memory. It is crucial to design a disk-based graph storage system to ingest updates and analyze graphs efficiently. However, existing dynamic graph storage systems suffer from read or…

LSM-tree based key-value stores are widely adopted as the data storage backend in modern big data applications. The LSM-tree grows with data ingestion, by either adding levels with fixed level capacities (dubbed as vertical scheme) or…

Databases · Computer Science 2025-04-25 Dingheng Mo , Siqiang Luo , Stratos Idreos

Many modern machine learning (ML) methods rely on embedding models to learn vector representations (embeddings) for a set of entities (embedding tables). As increasingly diverse ML applications utilize embedding models and embedding tables…

The log-structured merge tree (LSM-tree) gains wide popularity in building key-value (KV) stores. It employs logs to back up arriving KV pairs and maintains a few on-disk levels with exponentially increasing capacity limits, resembling a…

Data Structures and Algorithms · Computer Science 2021-09-29 Yanpeng Hu , Chundong Wang

The Log Structured Merge (LSM) Tree is a popular choice for key-value stores that focus on optimized write throughput while maintaining performant, production-ready read latencies. To optimize read performance, LSM stores rely on a…

Databases · Computer Science 2025-02-18 Hayder Tirmazi

Key-value (KV) separation is a technique that introduces randomness in the I/O access patterns to reduce I/O amplification in LSM-based key-value stores for fast storage devices (NVMe). KV separation has a significant drawback that makes it…

The multi-level design of Log-Structured Merge-trees (LSM-trees) naturally fits the tiered storage architecture: the upper levels (recently inserted/updated records) are kept in fast storage to guarantee performance while the lower levels…

Databases · Computer Science 2024-12-20 Jiansheng Qiu , Fangzhou Yuan , Mingyu Gao , Huanchen Zhang