English
Related papers

Related papers: Learned Adaptive Indexing

200 papers

Adaptive indexing is a concept that considers index creation in databases as a by-product of query processing; as opposed to traditional full index creation where the indexing effort is performed up front before answering any queries.…

Databases · Computer Science 2014-04-09 Victor Alvarez , Felix Martin Schuhknecht , Jens Dittrich , Stefan Richter

Indexes are models: a B-Tree-Index can be seen as a model to map a key to the position of a record within a sorted array, a Hash-Index as a model to map a key to a position of a record within an unsorted array, and a BitMap-Index as a model…

Databases · Computer Science 2018-05-01 Tim Kraska , Alex Beutel , Ed H. Chi , Jeffrey Dean , Neoklis Polyzotis

A recent research trend involves treating database index structures as Machine Learning (ML) models. In this domain, single or multiple ML models are trained to learn the mapping from keys to positions inside a data set. This class of…

Databases · Computer Science 2024-03-12 Abdullah Al-Mamun , Hao Wu , Qiyang He , Jianguo Wang , Walid G. Aref

A learned multi-dimensional index is a data structure that efficiently answers multi-dimensional orthogonal queries by understanding the data distribution using machine learning models. One of the existing problems is that the search…

Data Structures and Algorithms · Computer Science 2024-11-18 Fuma Hidaka , Yusuke Matsui

Learned indices have been proposed to replace classic index structures like B-Tree with machine learning (ML) models. They require to replace both the indices and query processing algorithms currently deployed by the databases, and such a…

Databases · Computer Science 2021-10-12 Tu Gu , Kaiyu Feng , Gao Cong , Cheng Long , Zheng Wang , Sheng Wang

There is great excitement about learned index structures, but understandable skepticism about the practicality of a new method uprooting decades of research on B-Trees. In this paper, we work to remove some of that uncertainty by…

Index tuning, i.e., selecting the indexes appropriate for a workload, is a crucial problem in database system tuning. In this paper, we solve index tuning for large problem instances that are common in practice, e.g., thousands of queries…

Databases · Computer Science 2011-04-19 Debabrata Dash , Neoklis Polyzotis , Anastasia Ailamaki

The ever-growing collections of data series create a pressing need for efficient similarity search, which serves as the backbone for various analytics pipelines. Recent studies have shown that tree-based series indexes excel in many…

Databases · Computer Science 2025-02-05 Qitong Wang , Ioana Ileana , Themis Palpanas

Learned indexes have attracted significant research interest due to their ability to offer better space-time trade-offs compared to traditional B+-tree variants. Among various learned indexes, the PGM-Index based on error-bounded piecewise…

Databases · Computer Science 2024-10-02 Qiyu Liu , Siyuan Han , Yanlin Qi , Jingshu Peng , Jin Li , Longlong Lin , Lei Chen

Learned indexes fit machine learning (ML) models to the data and use them to make query operations more time and space-efficient. Recent works propose using learned spatial indexes to improve spatial query performance by optimizing the…

Databases · Computer Science 2024-03-21 Sachith Pai , Michael Mathioudakis , Yanhao Wang

The recursive model index (RMI) has recently been introduced as a machine-learned replacement for traditional indexes over sorted data, achieving remarkably fast lookups. Follow-up work focused on explaining RMI's performance and…

Databases · Computer Science 2021-11-23 Marcel Maltry , Jens Dittrich

The growth in data storage capacity and the increasing demands for high performance have created several challenges for concurrent indexing structures. One promising solution is learned indexes, which use a learning-based approach to fit…

Databases · Computer Science 2023-09-06 Jiake Ge , Huanchen Zhang , Boyu Shi , Yuanhui Luo , Yunda Guo , Yunpeng Chai , Yuxing Chen , Anqun Pan

Learned index structures have been shown to achieve favorable lookup performance and space consumption compared to their traditional counterparts such as B-trees. However, most learned index studies have focused on the primary indexing…

Databases · Computer Science 2022-05-13 Andreas Kipf , Dominik Horn , Pascal Pfeil , Ryan Marcus , Tim Kraska

Index structures are fundamental for efficient query processing on large-scale datasets. Learned indexes model the indexing process as a prediction problem to overcome the inherent trade-offs of traditional indexes. However, most existing…

Databases · Computer Science 2026-03-31 Yuzhen Chen , Bin Yao

The concept of learned index structures relies on the idea that the input-output functionality of a database index can be viewed as a prediction task and, thus, be implemented using a machine learning model instead of traditional…

Cryptography and Security · Computer Science 2022-03-01 Evgenios M. Kornaropoulos , Silei Ren , Roberto Tamassia

Learned Index Structures (LIS) have significantly advanced data management by leveraging machine learning models to optimize data indexing. However, designing these structures often involves critical trade-offs, making it challenging for…

Databases · Computer Science 2025-02-19 Taiyi Wang , Liang Liang , Guang Yang , Thomas Heinis , Eiko Yoneki

Use of machine learning to perform database operations, such as indexing, cardinality estimation, and sorting, is shown to provide substantial performance benefits. However, when datasets change and data distribution shifts, empirical…

Machine Learning · Computer Science 2024-11-12 Sepanta Zeighami , Cyrus Shahahbi

Minimizing data-to-analysis time while enabling real-time interaction and efficient analytical computations on large datasets are fundamental objectives of contemporary exploratory systems. Although some of the recent adaptive indexing and…

Databases · Computer Science 2025-05-27 Stavros Maroulis , Nikos Bikakis , Vassilis Stamatopoulos , George Papastefanatos

Automating physical database design has remained a long-term interest in database research due to substantial performance gains afforded by optimised structures. Despite significant progress, a majority of today's commercial solutions are…

Databases · Computer Science 2020-10-21 R. Malinga Perera , Bastian Oetomo , Benjamin I. P. Rubinstein , Renata Borovica-Gajic

Even though existing database indexes (e.g., B+-Tree) speed up the query execution, they suffer from two main drawbacks: (1) A database index usually yields 5% to 15% additional storage overhead which results in non-ignorable dollar cost in…

Databases · Computer Science 2016-04-13 Jia Yu , Mohamed Sarwat