English
Related papers

Related papers: LSI: A Learned Secondary Index Structure

200 papers

Modern key-value stores rely heavily on Log-Structured Merge (LSM) trees for write optimization, but this design introduces significant read amplification. Auxiliary structures like Bloom filters help, but impose memory costs that scale…

Data Structures and Algorithms · Computer Science 2025-08-05 Nicholas Fidalgo , Puyuan Ye

We design the first learned index that solves the dictionary problem with time and space complexity provably better than classic data structures for hierarchical memories, such as B-trees, and modern learned indexes. We call our solution…

Data Structures and Algorithms · Computer Science 2019-03-12 Giorgio Vinciguerra , Paolo Ferragina , Michele Miccinesi

Inverted indexes are vital in providing fast key-word-based search. For every term in the document collection, a list of identifiers of documents in which the term appears is stored, along with auxiliary information such as term frequency,…

Information Retrieval · Computer Science 2019-01-30 Harrie Oosterhuis , J. Shane Culpepper , Maarten de Rijke

Learned indexes leverage machine learning models to accelerate query answering in databases, showing impressive practical performance. However, theoretical understanding of these methods remains incomplete. Existing research suggests that…

Databases · Computer Science 2024-10-23 Luis Croquevielle , Guang Yang , Liang Liang , Ali Hadian , Thomas Heinis

Recently, numerous promising results have shown that updatable learned indexes can perform better than traditional indexes with much lower memory space consumption. But it is unknown how these learned indexes compare against each other and…

Databases · Computer Science 2022-09-07 Chaichon Wongkham , Baotong Lu , Chris Liu , Zhicong Zhong , Eric Lo , Tianzheng Wang

Learned indexes, which use machine learning models to replace traditional index structures, have shown promising results in recent studies. However, existing learned indexes exhibit a performance gap between synthetic and real-world…

Databases · Computer Science 2022-05-20 Jiaoyi Zhang , Yihan Gao

Indexes can significantly improve search performance in relational databases. However, if the query workload changes frequently or new data updates occur continuously, it may not be worthwhile to build a conventional index upfront for query…

Databases · Computer Science 2025-08-06 Suvam Kumar Das , Suprio Ray

Indexes facilitate efficient querying when the selection predicate is on an indexed key. As a result, when loading data, if we anticipate future selective (point or range) queries, we typically maintain an index that is gradually populated…

Databases · Computer Science 2022-02-10 Aneesh Raman , Subhadeep Sarkar , Matthaios Olma , Manos Athanassoulis

Let S be a finite, ordered alphabet, and let x = x_1 x_2 ... x_n be a string over S. A "secondary index" for x answers alphabet range queries of the form: Given a range [a_l,a_r] over S, return the set I_{[a_l;a_r]} = {i |x_i \in [a_l;…

Databases · Computer Science 2008-11-19 Rasmus Pagh , S. Srinivasa Rao

Learning from the multidimensional data has been an interesting concept in the field of machine learning. However, such learning can be difficult, complex, expensive because of expensive data processing, manipulations as the number of…

Machine Learning · Computer Science 2020-12-04 Mahbubur Rahman

There is great excitement about learned index structures, but understandable skepticism about the practicality of a new method uprooting decades of research on B-Trees. In this paper, we work to remove some of that uncertainty by…

Joins are among the most time-consuming and data-intensive operations in relational query processing. Much research effort has been applied to the optimization of join processing due to their frequent execution. Recent studies have shown…

Databases · Computer Science 2025-05-26 Yuvaraj Chesetti , Prashant Pandey

The Binary Search Tree (BST) is average in computer science which supports a compact data structure in memory and oneself even conducts a row of quick algorithms, by which people often apply it in dynamical circumstance. Besides these…

Data Structures and Algorithms · Computer Science 2018-10-05 Yong Tan

With the aim of obtaining time/space improvements in classic Data Structures, an emerging trend is to combine Machine Learning techniques with the ones proper of Data Structures. This new area goes under the name of Learned Data Structures.…

Databases · Computer Science 2022-03-29 Domenico Amato , Giosue' Lo Bosco , Raffaele Giancarlo

Efficiently computing spatio-textual queries has become increasingly important in various applications that need to quickly retrieve geolocated entities associated with textual information, such as in location-based services and social…

Data Structures and Algorithms · Computer Science 2023-12-18 Georgios Chatzigeorgakidis , Kostas Patroumpas , Dimitrios Skoutas , Spiros Athanasiou

Learned indexes fit machine learning (ML) models to the data and use them to make query operations more time and space-efficient. Recent works propose using learned spatial indexes to improve spatial query performance by optimizing the…

Databases · Computer Science 2024-03-21 Sachith Pai , Michael Mathioudakis , Yanhao Wang

In recent years, dense retrieval has been the focus of information retrieval (IR) research. While effective, dense retrieval produces uninterpretable dense vectors, and suffers from the drawback of large index size. Learned sparse retrieval…

Information Retrieval · Computer Science 2025-11-10 Zhichao Xu , Aosong Feng , Yijun Tian , Haibo Ding , Lin Lee Cheong

Supervised, semi-supervised, and unsupervised learning estimate a function given input/output samples. Generalization of the learned function to unseen data can be improved by incorporating side information into learning. Side information…

Machine Learning · Computer Science 2016-02-11 Rico Jonschkowski , Sebastian Höfer , Oliver Brock

The ever-growing collections of data series create a pressing need for efficient similarity search, which serves as the backbone for various analytics pipelines. Recent studies have shown that tree-based series indexes excel in many…

Databases · Computer Science 2025-02-05 Qitong Wang , Ioana Ileana , Themis Palpanas

Recent work on "learned indexes" has changed the way we look at the decades-old field of DBMS indexing. The key idea is that indexes can be thought of as "models" that predict the position of a key in a dataset. Indexes can, thus, be…