English
Related papers

Related papers: WaZI: A Learned and Workload-aware Z-Index

200 papers

Recently, numerous promising results have shown that updatable learned indexes can perform better than traditional indexes with much lower memory space consumption. But it is unknown how these learned indexes compare against each other and…

Databases · Computer Science 2022-09-07 Chaichon Wongkham , Baotong Lu , Chris Liu , Zhicong Zhong , Eric Lo , Tianzheng Wang

Index structures are important for efficient data access, which have been widely used to improve the performance in many in-memory systems. Due to high in-memory overheads, traditional index structures become difficult to process the…

Databases · Computer Science 2019-05-16 Pengfei Li , Yu Hua , Pengfei Zuo , Jingnan Jia

Learned indexes are promising to replace traditional tree-based indexes. They typically employ machine learning models to efficiently predict target positions in strictly sorted linear arrays. However, the strict sorted order 1)…

Databases · Computer Science 2025-02-18 Huibing Dong , Wenlong Wang , Chun Liu , David Du

A corpus of recent work has revealed that the learned index can improve query performance while reducing the storage overhead. It potentially offers an opportunity to address the spatial query processing challenges caused by the surge in…

Databases · Computer Science 2021-02-16 Songnian Zhang , Suprio Ray , Rongxing Lu , Yandong Zheng

The recent introduction of learned indexes has shaken the foundations of the decades-old field of indexing data structures. Combining, or even replacing, classic design elements such as B-tree nodes with machine learning models has proven…

Data Structures and Algorithms · Computer Science 2020-05-08 Paolo Ferragina , Giorgio Vinciguerra

Learned index structures aim to accelerate queries by training machine learning models to approximate the rank function associated with a database attribute. While effective in practice, their theoretical limitations are not fully…

Data Structures and Algorithms · Computer Science 2026-01-13 Luis Alberto Croquevielle , Roman Sokolovskii , Thomas Heinis

A recent research trend involves treating database index structures as Machine Learning (ML) models. In this domain, single or multiple ML models are trained to learn the mapping from keys to positions inside a data set. This class of…

Databases · Computer Science 2024-03-12 Abdullah Al-Mamun , Hao Wu , Qiyang He , Jianguo Wang , Walid G. Aref

Recent advancements in learned index structures propose replacing existing index structures, like B-Trees, with approximate learned models. In this work, we present a unified benchmark that compares well-tuned implementations of three…

Existing learned indexes (e.g., RMI, ALEX, PGM) optimize the internal regressor of each node, not the overall structure such as index height, the size of each layer, etc. In this paper, we share our recent findings that we can achieve…

Databases · Computer Science 2022-08-09 Supawit Chockchowwat , Wenjie Liu , Yongjoo Park

Machine Learning Techniques, properly combined with Data Structures, have resulted in Learned Static Indexes, innovative and powerful tools that speed-up Binary Search, with the use of additional space with respect to the table being…

Information Retrieval · Computer Science 2022-09-20 Domenico Amato , Giosuè Lo Bosco , Raffaele Giancarlo

The performance levels of a computing machine running a given workload configuration are crucial for both users and providers of computing resources. Knowing how well a computing machine is running with a given workload configuration is…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-12-16 Lorenzo Luciano , Imre Kiss , Peter William Beardshear , Esther Kadosh , A. Ben Hamza

Index plays an essential role in modern database engines to accelerate the query processing. The new paradigm of "learned index" has significantly changed the way of designing index structures in DBMS. The key insight is that indexes could…

Databases · Computer Science 2021-04-14 Jiacheng Wu , Yong Zhang , Shimin Chen , Jin Wang , Yu Chen , Chunxiao Xing

The emergence of learned indexes has caused a paradigm shift in our perception of indexing by considering indexes as predictive models that estimate keys' positions within a data set, resulting in notable improvements in key search…

Databases · Computer Science 2024-08-09 Alireza Heidari , Amirhossein Ahmadi , Wei Zhang

Filtering data based on predicates is one of the most fundamental operations for any modern data warehouse. Techniques to accelerate the execution of filter expressions include clustered indexes, specialized sort orders (e.g., Z-order),…

Databases · Computer Science 2020-06-25 Jialin Ding , Vikram Nathan , Mohammad Alizadeh , Tim Kraska

Large language models have demonstrated exceptional capabilities across diverse tasks, but their fine-tuning demands significant memory, posing challenges for resource-constrained environments. Zeroth-order (ZO) optimization provides a…

Machine Learning · Computer Science 2025-02-18 Zhen Zhang , Yifan Yang , Kai Zhen , Nathan Susanj , Athanasios Mouchtaris , Siegfried Kunzmann , Zheng Zhang

We design the first learned index that solves the dictionary problem with time and space complexity provably better than classic data structures for hierarchical memories, such as B-trees, and modern learned indexes. We call our solution…

Data Structures and Algorithms · Computer Science 2019-03-12 Giorgio Vinciguerra , Paolo Ferragina , Michele Miccinesi

Spatial indexes are crucial for the analysis of the increasing amounts of spatial data, for example generated through IoT applications. The plethora of indexes that has been developed in recent decades has primarily been optimised for disk.…

Databases · Computer Science 2020-08-11 Ali Hadian , Ankit Kumar , Thomas Heinis

Recent work on "learned indexes" has changed the way we look at the decades-old field of DBMS indexing. The key idea is that indexes can be thought of as "models" that predict the position of a key in a dataset. Indexes can, thus, be…

Efficient indexing is fundamental for multi-dimensional data management and analytics. An emerging tendency is to directly learn the storage layout of multi-dimensional data by simple machine learning models, yielding the concept of Learned…

Databases · Computer Science 2024-05-10 Qiyu Liu , Maocheng Li , Yuxiang Zeng , Yanyan Shen , Lei Chen

Very large volumes of spatial data increasingly become available and demand effective management. While there has been decades of research on spatial data management, few works consider the current state of commodity hardware, having…