English
Related papers

Related papers: vLSM: Low tail latency and I/O amplification in LS…

200 papers

Log-Structured Merge tree (LSM tree) Key-Value (KV) stores have become a foundational layer in the storage stacks of datacenter and cloud services. Current approaches for achieving reliability and availability avoid replication at the KV…

Databases · Computer Science 2021-10-20 Michalis Vardoulakis , Giorgos Saloustros , Pilar González-Férez , Angelos Bilas

The log-structured merge tree (LSM-tree) is widely employed to build key-value (KV) stores. LSM-tree organizes multiple levels in memory and on disk. The compaction of LSM-tree, which is used to redeploy KV pairs between on-disk levels in…

Databases · Computer Science 2023-08-01 Yanpeng Hu , Li Zhu , Lei Jia , Chundong Wang

Log-structured merge tree (LSM-tree) based key-value stores are widely employed in large-scale storage systems. In the compaction of the key-value store, SSTables are merged with overlapping key ranges and sorted for data queries. This,…

Distributed, Parallel, and Cluster Computing · Computer Science 2018-07-12 Hui Sun , Wei Liu , Jianzhong Huang , Weisong Shi

Large language models (LLMs) rely on Key-Value (KV) cache to reduce time-to-first-token (TTFT) latency, but existing disk-based KV cache systems using file-per-object layouts suffer from severe scalability bottlenecks due to file system…

Databases · Computer Science 2025-11-26 Weiping Yu , Ye Jiarui , He Mengke , Junfeng Liu , Siqiang Luo

Modern key-value storage engines built on Log-Structured Merge-trees (LSM-trees), such as RocksDB and LevelDB, rely heavily on the performance of their compaction operations, which are impacted by a complex set of interdependent…

Performance · Computer Science 2026-02-16 Jiabiao Ding , Yina Lv , Qiao Li , Zhirong Shen , Chun Jason Xue

LSM-tree is a widely adopted data structure in modern key-value store systems that optimizes write performance in write-heavy applications by using append writes to achieve sequential writes. However, the unpredictability of LSM-tree…

Databases · Computer Science 2025-07-15 Yina Lv , Qiao Li , Quanqing Xu , Congming Gao , Chuanhui Yang , Xiaoli Wang , Chun Jason Xue

LSM-tree has been widely used in cloud computing systems by Google, Facebook, and Amazon, to achieve high performance for write-intensive workloads. However, in LSM-tree, random key-value queries can experience long latency and low…

Data Structures and Algorithms · Computer Science 2016-06-08 Lei Guo , Dejun Teng , Rubao Lee , Feng Chen , Siyuan Ma , Xiaodong Zhang

When key-value (KV) stores use SSDs for storing a large number of items, oftentimes they also require large in-memory data structures including indices and caches to be traversed to reduce IOs. This paper considers offloading most of such…

Scan-based operations, such as backstage compaction and value filtering, have emerged as the main bottleneck for LSM-Trees in supporting contemporary data-intensive applications. For slower external storage devices, such as HDD and SATA…

Databases · Computer Science 2025-08-19 Jianfeng Huang , Ziyao Wang , Lin Yuan , Jiajie Wen , Yihao Cao , Dongjing Miao , Yong Wang , Jiahao Zhang

The log-structured merge tree (LSM-tree) gains wide popularity in building key-value (KV) stores. It employs logs to back up arriving KV pairs and maintains a few on-disk levels with exponentially increasing capacity limits, resembling a…

Data Structures and Algorithms · Computer Science 2021-09-29 Yanpeng Hu , Chundong Wang

Log-Structured Merge-tree-based Key-Value Stores (LSM-KVS) have been optimized and redesigned for disaggregated storage via techniques such as compaction offloading to reduce the network I/Os between compute and storage. However, the…

Databases · Computer Science 2026-03-06 Qi Lin , Gangqi Huang , Te Guo , Chang Guo , Viraj Thakkar , Zichen Zhu , Jianguo Wang , Zhichao Cao

Key-Value Stores (KVS) based on log-structured merge-trees (LSM-trees) are widely used in storage systems but face significant challenges, such as high write amplification caused by compaction. KV-separated LSM-trees address write…

Databases · Computer Science 2025-08-20 Jianshun Zhang , Fang Wang , Jiaxin Ou , Yi Wang , Ming Zhao , Sheng Qiu , Junxun Huang , Baoquan Li , Peng Fang , Dan Feng

Persistent key-value (KV) stores mostly build on the Log-Structured Merge (LSM) tree for high write performance, yet the LSM-tree suffers from the inherently high I/O amplification. KV separation mitigates I/O amplification by storing only…

Databases · Computer Science 2019-06-18 Yongkun Li , Helen H. W. Chan , Patrick P. C. Lee , Yinlong Xu

Log-structured merge (LSM) trees offer efficient ingestion by appending incoming data, and thus, are widely used as the storage layer of production NoSQL data stores. To enable competitive read performance, LSM-trees periodically…

Databases · Computer Science 2022-03-01 Subhadeep Sarkar , Dimitris Staratzis , Zichen Zhu , Manos Athanassoulis

Key-Value Stores (KVS) implemented with log-structured merge-tree (LSM-tree) have gained widespread acceptance in storage systems. Nonetheless, a significant challenge arises in the form of high write amplification due to the compaction…

Databases · Computer Science 2025-08-20 Jianshun Zhang , Fang Wang , Sheng Qiu , Yi Wang , Jiaxin Ou , Junxun Huang , Baoquan Li , Peng Fang , Dan Feng

The Key-Value (KV) cache is a crucial component in serving transformer-based autoregressive large language models (LLMs), enabling faster inference by storing previously computed KV vectors. However, its memory consumption scales linearly…

Machine Learning · Computer Science 2024-10-07 Rongzhi Zhang , Kuang Wang , Liyuan Liu , Shuohang Wang , Hao Cheng , Chao Zhang , Yelong Shen

This paper introduces the concept of size-aware sharding to improve tail latencies for in-memory key-value stores, and describes its implementation in the Minos key-value store. Tail latencies are crucial in distributed applications with…

Databases · Computer Science 2018-02-05 Diego Didona , Willy Zwaenepoel

We present~\emph{KV-Tandem}, a modular architecture for building LSM-based storage engines on top of simple, non-ordered persistent key-value stores (KVSs). KV-Tandem enables advanced functionalities such as range queries and snapshot…

Log-Structured Merge-tree-based Key-Value Store (LSM-KVS) is a foundational storage engine serving diverse modern workloads, systems, and applications. To suit varying use cases, LSM-KVS allows a vast configuration space that controls core…

Log-Structured Merge (LSM) tree-based Key-Value Stores (KVSs) are widely adopted for their high performance in write-intensive environments, but they often face performance degradation due to write stalls during compaction. Prior solutions,…

Hardware Architecture · Computer Science 2024-10-30 KiHwan Kim , Hyunsun Chung , Seonghoon Ahn , Junhyeok Park , Safdar Jamil , Hongsu Byun , Myungcheol Lee , Jinchun Choi , Youngjae Kim
‹ Prev 1 2 3 10 Next ›