English
Related papers

Related papers: LearnedKV: Integrating LSM and Learned Index for S…

200 papers

Log-structured merge tree (LSM-tree) based key-value stores are widely employed in large-scale storage systems. In the compaction of the key-value store, SSTables are merged with overlapping key ranges and sorted for data queries. This,…

Distributed, Parallel, and Cluster Computing · Computer Science 2018-07-12 Hui Sun , Wei Liu , Jianzhong Huang , Weisong Shi

Persistent key-value (KV) stores mostly build on the Log-Structured Merge (LSM) tree for high write performance, yet the LSM-tree suffers from the inherently high I/O amplification. KV separation mitigates I/O amplification by storing only…

Databases · Computer Science 2019-06-18 Yongkun Li , Helen H. W. Chan , Patrick P. C. Lee , Yinlong Xu

Key-value stores underpin a wide range of applications due to their simplicity and efficiency. Log-Structured Merge Trees (LSM-trees) dominate as their underlying structure, excelling at handling rapidly growing data. Recent research has…

Databases · Computer Science 2026-01-29 Junfeng Liu , Haoxuan Xie , Siqiang Luo

Modern key-value stores rely heavily on Log-Structured Merge (LSM) trees for write optimization, but this design introduces significant read amplification. Auxiliary structures like Bloom filters help, but impose memory costs that scale…

Data Structures and Algorithms · Computer Science 2025-08-05 Nicholas Fidalgo , Puyuan Ye

Key\-value separation is used in LSM\-tree to stored large value in separate log files to reduce write amplification, but requires garbage collection to garbage collect invalid values. Existing garbage collection techniques in LSM\-tree…

Databases · Computer Science 2024-06-04 Zhutao Zhuang , Xinqi Zeng , Zhiguang Chen

LSM-tree based key-value (KV) stores organize data in a multi-level structure for high-speed writes. Range queries on traditional LSM-trees must seek and sort-merge data from multiple table files on the fly, which is expensive and often…

Databases · Computer Science 2021-01-27 Wenshao Zhong , Chen Chen , Xingbo Wu , Song Jiang

Modern databases typically makes use of the Log Structured Merge-Tree for organizing data in indexes, which is a kind of disk-based data structure. It was proposed to efficiently handle frequent update queries (also called update intensive…

Databases · Computer Science 2024-02-28 Supriya Mishra

In this paper, we introduce DobLIX, a dual-objective learned index specifically designed for Log-Structured Merge(LSM) tree-based key-value stores. Although traditional learned indexes focus exclusively on optimizing index lookups, they…

Databases · Computer Science 2025-09-03 Alireza Heidari , Amirhossein Ahmadi , Wei Zhang

High read and write performance is important for generic key-value stores, which are foundational to modern applications and databases. Yet, achieving high performance for mixed and dynamic workloads is challenging due to fundamental…

Databases · Computer Science 2026-04-20 Tony Astolfi , Vidya Silai , Darby Huye , Lan Liu , Raja R. Sambasivan , Johes Bater

Large language models (LLMs) rely on Key-Value (KV) cache to reduce time-to-first-token (TTFT) latency, but existing disk-based KV cache systems using file-per-object layouts suffer from severe scalability bottlenecks due to file system…

Databases · Computer Science 2025-11-26 Weiping Yu , Ye Jiarui , He Mengke , Junfeng Liu , Siqiang Luo

LSM-tree-based data stores are widely used in industry due to their exceptional performance. However, as data volumes grow, efficiently querying large-scale databases becomes increasingly challenging. To address this, recent studies…

Databases · Computer Science 2025-06-11 Junfeng Liu , Jiarui Ye , Mengshi Chen , Meng Li , Siqiang Luo

Efficient key-value (KV) cache compression is critical for scaling transformer-based Large Language Models (LLMs) in long sequences and resource-limited settings. Existing methods evict tokens based on their positions or importance scores,…

Computation and Language · Computer Science 2025-05-19 Ziwei He , Jian Yuan , Haoli Bai , Jingwen Leng , Bo Jiang

The log-structured merge tree (LSM-tree) gains wide popularity in building key-value (KV) stores. It employs logs to back up arriving KV pairs and maintains a few on-disk levels with exponentially increasing capacity limits, resembling a…

Data Structures and Algorithms · Computer Science 2021-09-29 Yanpeng Hu , Chundong Wang

The Log Structured Merge Trees (LSM-tree) based key-value stores are widely used in many storage systems to support a variety of operations such as updates, point reads, and range reads. Traditionally, LSM-tree's merge policy organizes data…

Databases · Computer Science 2024-07-02 Fuheng Zhao , Zach Miller , Leron Reznikov , Divyakant Agrawal , Amr El Abbadi

Large Language Models (LLMs) use key-value (KV) cache to reduce redundant computation in autoregressive generation. However, the KV cache size increases linearly during generation, leading to excessive memory usage, especially for long…

Computation and Language · Computer Science 2025-03-04 Jian Yuan , Ziwei He , Haoli Bai , Jingwen Leng , Bo Jiang

In recent years, the Log Structured Merge (LSM) tree has been widely adopted by NoSQL and NewSQL systems for its superior write performance. Despite its popularity, however, most existing work has focused on LSM-based key-value stores with…

Databases · Computer Science 2019-01-08 Chen Luo , Michael J. Carey

Many modern machine learning (ML) methods rely on embedding models to learn vector representations (embeddings) for a set of entities (embedding tables). As increasingly diverse ML applications utilize embedding models and embedding tables…

LSM-tree is a widely adopted data structure in modern key-value store systems that optimizes write performance in write-heavy applications by using append writes to achieve sequential writes. However, the unpredictability of LSM-tree…

Databases · Computer Science 2025-07-15 Yina Lv , Qiao Li , Quanqing Xu , Congming Gao , Chuanhui Yang , Xiaoli Wang , Chun Jason Xue

Efficient inference of large language models (LLMs) is hindered by an ever-growing key-value (KV) cache, making KV cache compression a critical research direction. Traditional methods selectively evict less important KV cache entries, which…

Machine Learning · Computer Science 2025-12-01 Yuxuan Tian , Zihan Wang , Yebo Peng , Aomufei Yuan , Zhiming Wang , Bairen Yi , Xin Liu , Yong Cui , Tong Yang

Log-Structured Merge (LSM) Trees provide a tiered data storage and retrieval paradigm that is attractive for write-optimized data systems. Maintaining an efficient buffer in memory and deferring updates past their initial write-time, the…

Databases · Computer Science 2018-09-11 Aron Szanto
‹ Prev 1 2 3 10 Next ›