English
Related papers

Related papers: Micro-architectural Analysis of a Learned Index

200 papers

A recent research trend involves treating database index structures as Machine Learning (ML) models. In this domain, single or multiple ML models are trained to learn the mapping from keys to positions inside a data set. This class of…

Databases · Computer Science 2024-03-12 Abdullah Al-Mamun , Hao Wu , Qiyang He , Jianguo Wang , Walid G. Aref

Index is an important component in database systems. Learned indexes have been shown to outperform traditional tree-based index structures for fixed-sized integer or floating point keys. However, the application of the learned solution to…

Databases · Computer Science 2024-07-17 Yifan Yang , Shimin Chen

Index plays an essential role in modern database engines to accelerate the query processing. The new paradigm of "learned index" has significantly changed the way of designing index structures in DBMS. The key insight is that indexes could…

Databases · Computer Science 2021-04-14 Jiacheng Wu , Yong Zhang , Shimin Chen , Jin Wang , Yu Chen , Chunxiao Xing

Efficient indexing is fundamental for multi-dimensional data management and analytics. An emerging tendency is to directly learn the storage layout of multi-dimensional data by simple machine learning models, yielding the concept of Learned…

Databases · Computer Science 2024-05-10 Qiyu Liu , Maocheng Li , Yuxiang Zeng , Yanyan Shen , Lei Chen

Recently, numerous promising results have shown that updatable learned indexes can perform better than traditional indexes with much lower memory space consumption. But it is unknown how these learned indexes compare against each other and…

Databases · Computer Science 2022-09-07 Chaichon Wongkham , Baotong Lu , Chris Liu , Zhicong Zhong , Eric Lo , Tianzheng Wang

Learned indexes have attracted significant research interest due to their ability to offer better space-time trade-offs compared to traditional B+-tree variants. Among various learned indexes, the PGM-Index based on error-bounded piecewise…

Databases · Computer Science 2024-10-02 Qiyu Liu , Siyuan Han , Yanlin Qi , Jingshu Peng , Jin Li , Longlong Lin , Lei Chen

Although many updatable learned indexes have been proposed in recent years, whether they can outperform traditional approaches on disk remains unknown. In this study, we revisit and implement four state-of-the-art updatable learned indexes…

Databases · Computer Science 2023-05-03 Hai Lan , Zhifeng Bao , J. Shane Culpepper , Renata Borovica-Gajic

The growth in data storage capacity and the increasing demands for high performance have created several challenges for concurrent indexing structures. One promising solution is learned indexes, which use a learning-based approach to fit…

Databases · Computer Science 2023-09-06 Jiake Ge , Huanchen Zhang , Boyu Shi , Yuanhui Luo , Yunda Guo , Yunpeng Chai , Yuxing Chen , Anqun Pan

Learned indices using neural networks have been shown to outperform traditional indices such as B-trees in both query time and memory. However, learning the distribution of a large dataset can be expensive, and updating learned indices is…

Databases · Computer Science 2021-02-19 Guanli Liu , Lars Kulik , Xingjun Ma , Jianzhong Qi

Efficiently querying data on embedded sensor and IoT devices is challenging given the very limited memory and CPU resources. With the increasing volumes of collected data, it is critical to process, filter, and manipulate data on the edge…

Databases · Computer Science 2023-03-07 David Ding , Ivan Carvalho , Ramon Lawrence

Joins are among the most time-consuming and data-intensive operations in relational query processing. Much research effort has been applied to the optimization of join processing due to their frequent execution. Recent studies have shown…

Databases · Computer Science 2025-05-26 Yuvaraj Chesetti , Prashant Pandey

Indexing large-scale databases in main memory is still challenging today. Learned index structures -- in which the core components of classical indexes are replaced with machine learning models -- have recently been suggested to…

Databases · Computer Science 2021-01-27 Ali Hadian , Thomas Heinis

A fundamental problem in data management is to find the elements in an array that match a query. Recently, learned indexes are being extensively used to solve this problem, where they learn a model to predict the location of the items in…

Databases · Computer Science 2023-06-21 Sepanta Zeighami , Cyrus Shahabi

There is great excitement about learned index structures, but understandable skepticism about the practicality of a new method uprooting decades of research on B-Trees. In this paper, we work to remove some of that uncertainty by…

Indexes provide a method to access data in databases quickly. It can improve the response speed of subsequent queries by building a complete index in advance. However, it also leads to a huge overhead of the continuous updating during…

Databases · Computer Science 2019-11-27 Gang Wu , Yidong Song , Guodong Zhao , Wei Sun , Donghong Han , Baiyou Qiao , Guoren Wang , Ye Yuan

Reinforcement learning has recently been used to enhance index structures, giving rise to reinforcement learning-enhanced spatial indices (RLESIs) that aim to improve query efficiency during index construction. However, their practical…

Databases · Computer Science 2025-12-15 Guanli Liu , Renata Borovica-Gajic , Hai Lan , Zhifeng Bao

With the aim of obtaining time/space improvements in classic Data Structures, an emerging trend is to combine Machine Learning techniques with the ones proper of Data Structures. This new area goes under the name of Learned Data Structures.…

Databases · Computer Science 2022-03-29 Domenico Amato , Giosue' Lo Bosco , Raffaele Giancarlo

Learned indexes are promising to replace traditional tree-based indexes. They typically employ machine learning models to efficiently predict target positions in strictly sorted linear arrays. However, the strict sorted order 1)…

Databases · Computer Science 2025-02-18 Huibing Dong , Wenlong Wang , Chun Liu , David Du

Machine Learning (ML) techniques have been successfully applied to design various learned database index structures for both the one- and multi-dimensional spaces. Particularly, a class of traditional multi-dimensional indexes has been…

Databases · Computer Science 2025-02-17 Abdullah Al-Mamun , Ch. Md. Rakin Haider , Jianguo Wang , Walid G. Aref

The recent proposal of learned index structures opens up a new perspective on how traditional range indexes can be optimized. However, the current learned indexes assume the data distribution is relatively static and the access pattern is…

Machine Learning · Computer Science 2019-02-05 Chuzhe Tang , Zhiyuan Dong , Minjie Wang , Zhaoguo Wang , Haibo Chen