English
Related papers

Related papers: Benchmarking Learned Indexes

200 papers

Learned indexes, which use machine learning models to replace traditional index structures, have shown promising results in recent studies. However, existing learned indexes exhibit a performance gap between synthetic and real-world…

Databases · Computer Science 2022-05-20 Jiaoyi Zhang , Yihan Gao

A fundamental problem in data management is to find the elements in an array that match a query. Recently, learned indexes are being extensively used to solve this problem, where they learn a model to predict the location of the items in…

Databases · Computer Science 2023-06-21 Sepanta Zeighami , Cyrus Shahabi

In this work, we present a new benchmarking suite with new real-life inspired skewed workloads to test the performance of concurrent index data structures. We started this project to prepare workloads specifically for self-adjusting data…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-05-19 Vitaly Aksenov , Dmitry Ivanov , Ravil Galiev

Learned indexes are promising to replace traditional tree-based indexes. They typically employ machine learning models to efficiently predict target positions in strictly sorted linear arrays. However, the strict sorted order 1)…

Databases · Computer Science 2025-02-18 Huibing Dong , Wenlong Wang , Chun Liu , David Du

Inverted indexes are vital in providing fast key-word-based search. For every term in the document collection, a list of identifiers of documents in which the term appears is stored, along with auxiliary information such as term frequency,…

Information Retrieval · Computer Science 2019-01-30 Harrie Oosterhuis , J. Shane Culpepper , Maarten de Rijke

With the aim of obtaining time/space improvements in classic Data Structures, an emerging trend is to combine Machine Learning techniques with the ones proper of Data Structures. This new area goes under the name of Learned Data Structures.…

Databases · Computer Science 2022-03-29 Domenico Amato , Giosue' Lo Bosco , Raffaele Giancarlo

Reinforcement learning has recently been used to enhance index structures, giving rise to reinforcement learning-enhanced spatial indices (RLESIs) that aim to improve query efficiency during index construction. However, their practical…

Databases · Computer Science 2025-12-15 Guanli Liu , Renata Borovica-Gajic , Hai Lan , Zhifeng Bao

Indexing large-scale databases in main memory is still challenging today. Learned index structures -- in which the core components of classical indexes are replaced with machine learning models -- have recently been suggested to…

Databases · Computer Science 2021-01-27 Ali Hadian , Thomas Heinis

The emergence of learned indexes has caused a paradigm shift in our perception of indexing by considering indexes as predictive models that estimate keys' positions within a data set, resulting in notable improvements in key search…

Databases · Computer Science 2024-08-09 Alireza Heidari , Amirhossein Ahmadi , Wei Zhang

While early empirical evidence has supported the case for learned index structures as having favourable average-case performance, little is known about their worst-case performance. By contrast, classical structures are known to achieve…

Databases · Computer Science 2022-07-26 Matthias Bachfischer , Renata Borovica-Gajic , Benjamin I. P. Rubinstein

Database indexes facilitate data retrieval and benefit broad applications in real-world systems. Recently, a new family of index, named learned index, is proposed to learn hidden yet useful data distribution and incorporate such information…

Databases · Computer Science 2021-01-05 Yaliang Li , Daoyuan Chen , Bolin Ding , Kai Zeng , Jingren Zhou

Machine learning algorithms have enabled computers to predict things by learning from previous data. The data storage and processing power are increasing rapidly, thus increasing machine learning and Artificial intelligence applications.…

Distributed, Parallel, and Cluster Computing · Computer Science 2021-09-14 Muhammad Fahad Saleem

Spatial data is ubiquitous. Massive amounts of data are generated every day from billions of GPS-enabled devices such as cell phones, cars, sensors, and various consumer-based applications such as Uber, Tinder, location-tagged posts in…

Databases · Computer Science 2020-08-25 Varun Pandey , Alexander van Renen , Andreas Kipf , Ibrahim Sabek , Jialin Ding , Alfons Kemper

It is common to evaluate the performance of a machine learning model by measuring its predictive power on a test dataset. This approach favors complicated models that can smoothly fit complex functions and generalize well from training data…

Machine Learning · Computer Science 2022-10-07 Hugo Cisneros , Josef Sivic , Tomas Mikolov

We design the first learned index that solves the dictionary problem with time and space complexity provably better than classic data structures for hierarchical memories, such as B-trees, and modern learned indexes. We call our solution…

Data Structures and Algorithms · Computer Science 2019-03-12 Giorgio Vinciguerra , Paolo Ferragina , Michele Miccinesi

Learned indexes have attracted significant research interest due to their ability to offer better space-time trade-offs compared to traditional B+-tree variants. Among various learned indexes, the PGM-Index based on error-bounded piecewise…

Databases · Computer Science 2024-10-02 Qiyu Liu , Siyuan Han , Yanlin Qi , Jingshu Peng , Jin Li , Longlong Lin , Lei Chen

While in-memory learned indexes have shown promising performance as compared to B+-tree, most widely used databases in real applications still rely on disk-based operations. Based on our experiments, we observe that directly applying the…

Databases · Computer Science 2023-06-06 Hai Lan , Zhifeng Bao , J. Shane Culpepper , Renata Borovica-Gajic , Yu Dong

The concept of learned index structures relies on the idea that the input-output functionality of a database index can be viewed as a prediction task and, thus, be implemented using a machine learning model instead of traditional…

Cryptography and Security · Computer Science 2022-03-01 Evgenios M. Kornaropoulos , Silei Ren , Roberto Tamassia

Recent work proposed learned index structures, which learn the distribution of the underlying dataset to improve performance. The initial work on learned indexes has shown that by learning the cumulative distribution function of the data,…

Databases · Computer Science 2021-02-03 Ali Hadian , Behzad Ghaffari , Taiyi Wang , Thomas Heinis

Indexes are critical for efficient data retrieval and updates in modern databases. Recent advances in machine learning have led to the development of learned indexes, which model the cumulative distribution function of data to predict…

Databases · Computer Science 2026-04-27 Xinyi Zhang , Liang Liang , Anastasia Ailamaki , Jianliang Xu