English
Related papers

Related papers: [Extended Version] ArceKV: Towards Workload-driven…

200 papers

LSM-tree based key-value (KV) stores organize data in a multi-level structure for high-speed writes. Range queries on traditional LSM-trees must seek and sort-merge data from multiple table files on the fly, which is expensive and often…

Databases · Computer Science 2021-01-27 Wenshao Zhong , Chen Chen , Xingbo Wu , Song Jiang

The Log Structured Merge Trees (LSM-tree) based key-value stores are widely used in many storage systems to support a variety of operations such as updates, point reads, and range reads. Traditionally, LSM-tree's merge policy organizes data…

Databases · Computer Science 2024-07-02 Fuheng Zhao , Zach Miller , Leron Reznikov , Divyakant Agrawal , Amr El Abbadi

LSM-tree has been widely used in cloud computing systems by Google, Facebook, and Amazon, to achieve high performance for write-intensive workloads. However, in LSM-tree, random key-value queries can experience long latency and low…

Data Structures and Algorithms · Computer Science 2016-06-08 Lei Guo , Dejun Teng , Rubao Lee , Feng Chen , Siyuan Ma , Xiaodong Zhang

We present Keigo, a concurrency- and workload-aware storage middleware that enhances the performance of log-structured merge key-value stores (LSM KVS) when they are deployed on a hierarchy of storage devices. The key observation behind…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-06-18 Rúben Adão , Zhongjie Wu , Changjun Zhou , Oana Balmau , João Paulo , Ricardo Macedo

Compaction is a necessary, but often costly background process in write-optimized data structures like LSM-trees that reorganizes incoming data that is sequentially appended to logs. In this paper, we introduce Transformation-Embedded…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-06-11 Holly Casaletto , Jeff Lefevre , Aldrin Montana , Peter Alvaro

The growing volume of graph data may exhaust the main memory. It is crucial to design a disk-based graph storage system to ingest updates and analyze graphs efficiently. However, existing dynamic graph storage systems suffer from read or…

Modern databases typically makes use of the Log Structured Merge-Tree for organizing data in indexes, which is a kind of disk-based data structure. It was proposed to efficiently handle frequent update queries (also called update intensive…

Databases · Computer Science 2024-02-28 Supriya Mishra

The Log-Structured Merge-Tree (LSM-tree) has been widely adopted for use in modern NoSQL systems for its superior write performance. Despite the popularity of LSM-trees, they have been criticized for suffering from write stalls and large…

Databases · Computer Science 2020-04-14 Chen Luo , Michael J. Carey

The Log Structured Merge (LSM) Tree is a popular choice for key-value stores that focus on optimized write throughput while maintaining performant, production-ready read latencies. To optimize read performance, LSM stores rely on a…

Databases · Computer Science 2025-02-18 Hayder Tirmazi

Key-Value Stores (KVS) based on log-structured merge-trees (LSM-trees) are widely used in storage systems but face significant challenges, such as high write amplification caused by compaction. KV-separated LSM-trees address write…

Databases · Computer Science 2025-08-20 Jianshun Zhang , Fang Wang , Jiaxin Ou , Yi Wang , Ming Zhao , Sheng Qiu , Junxun Huang , Baoquan Li , Peng Fang , Dan Feng

Modern data-intensive applications increasingly store and process big-value items, such as multimedia objects and machine learning embeddings, which exacerbate storage inefficiencies in Log-Structured Merge-Tree (LSM)-based key-value…

Databases · Computer Science 2025-06-10 Ming Li , Wendi Cheng , Jiahe Wei , Xueqiang Shan , Weikai Liu , Xiaonan Zhao , Xiao Zhang

In recent years, the Log Structured Merge (LSM) tree has been widely adopted by NoSQL and NewSQL systems for its superior write performance. Despite its popularity, however, most existing work has focused on LSM-based key-value stores with…

Databases · Computer Science 2019-01-08 Chen Luo , Michael J. Carey

High read and write performance is important for generic key-value stores, which are foundational to modern applications and databases. Yet, achieving high performance for mixed and dynamic workloads is challenging due to fundamental…

Databases · Computer Science 2026-04-20 Tony Astolfi , Vidya Silai , Darby Huye , Lan Liu , Raja R. Sambasivan , Johes Bater

Many applications require update-intensive workloads on spatial objects, e.g., social-network services and shared-riding services that track moving objects. By buffering insert and delete operations in memory, the Log Structured Merge Tree…

Data Structures and Algorithms · Computer Science 2023-05-03 Jaewoo Shin , Jianguo Wang , Walid G. Aref

Scan-based operations, such as backstage compaction and value filtering, have emerged as the main bottleneck for LSM-Trees in supporting contemporary data-intensive applications. For slower external storage devices, such as HDD and SATA…

Databases · Computer Science 2025-08-19 Jianfeng Huang , Ziyao Wang , Lin Yuan , Jiajie Wen , Yihao Cao , Dongjing Miao , Yong Wang , Jiahao Zhang

LSM-tree-based data stores are widely adopted in industries for their excellent performance. As data scales increase, disk-based join operations become indispensable yet costly for the database, making the selection of suitable join methods…

Databases · Computer Science 2026-03-03 Weiping Yu , Fan Wang , Xuwei Zhang , Siqiang Luo

This study proposes a novel storage engine, SynchroStore, designed to address the inefficiency of update operations in columnar storage systems based on Log-Structured Merge Trees (LSM-Trees) under hybrid workload scenarios. While columnar…

Databases · Computer Science 2025-03-25 Yinan Zhang , Huiqi Hu , Xuan Zhou

Key\-value separation is used in LSM\-tree to stored large value in separate log files to reduce write amplification, but requires garbage collection to garbage collect invalid values. Existing garbage collection techniques in LSM\-tree…

Databases · Computer Science 2024-06-04 Zhutao Zhuang , Xinqi Zeng , Zhiguang Chen

Key-value store is a popular type of cloud computing applications. The performance of key-value store applications have been shown to be very sensitive to load within the data center, and in particular to latency. As load within data center…

Hardware Architecture · Computer Science 2018-05-30 Yuta Tokusashi , Hiroki Matsutani , Noa Zilberman

Key-Value Stores (KVS) implemented with log-structured merge-tree (LSM-tree) have gained widespread acceptance in storage systems. Nonetheless, a significant challenge arises in the form of high write amplification due to the compaction…

Databases · Computer Science 2025-08-20 Jianshun Zhang , Fang Wang , Sheng Qiu , Yi Wang , Jiaxin Ou , Junxun Huang , Baoquan Li , Peng Fang , Dan Feng