English
Related papers

Related papers: Evaluating Learned Indexes for External-Memory Joi…

200 papers

Intelligence necessitates memory. Without memory, humans fail to perform various nontrivial tasks such as reading novels, playing games or solving maths. As the ultimate goal of machine learning is to derive intelligent systems that learn…

Machine Learning · Computer Science 2021-07-06 Hung Le

Learned indexes use machine learning models to learn the mappings between keys and their corresponding positions in key-value indexes. These indexes use the mapping information as training data. Learned indexes require frequent retrainings…

Machine Learning · Computer Science 2025-03-25 Minsu Kim , Jinwoo Hwang , Guseul Heo , Seiyeon Cho , Divya Mahajan , Jongse Park

With the prevalence of online platforms, today, data is being generated and accessed by users at a very high rate. Besides, applications such as stock trading or high frequency trading require guaranteed low delays for performing an…

Databases · Computer Science 2020-03-03 Sepanta Zeighami , Raymond Chi-Wing Wong

Clustering is an unsupervised learning technique in which data or objects are grouped into sets based on some similarity measure. Most of the clustering algorithms assume that the main memory is infinite and can accommodate the set of…

Data Structures and Algorithms · Computer Science 2015-05-25 Pankaj Kumar Yadav , Sriniwas Pandey , Sraban Kumar Mohanty

Deep learning has been effectively applied to many discrete optimization problems. However, learning-based scheduling on unrelated parallel machines remains particularly difficult to design. Not only do the numbers of jobs and machines…

Machine Learning · Computer Science 2025-12-23 Diego Hitzges , Guillaume Sagnol

Hash tables are a ubiquitous class of dictionary data structures. However, standard hash table implementations do not translate well into the external memory model, because they do not incorporate locality for insertions. Iacono and…

Data Structures and Algorithms · Computer Science 2018-05-25 Alex Conway , Martin Farach-Colton , Philip Shilane

This research concerns Learned Data Structures, a recent area that has emerged at the crossroad of Machine Learning and Classic Data Structures. It is methodologically important and with a high practical impact. We focus on Learned Indexes,…

Data Structures and Algorithms · Computer Science 2023-09-06 Domenico Amato , Giosué Lo Bosco , Raffaele Giancarlo

The proliferation of location-based services has led to massive spatial data generation. Spatial join is a crucial database operation that identifies pairs of objects from two spatial datasets based on spatial relationships. Due to the…

Databases · Computer Science 2025-04-03 Yongyi Liu , Ahmed Mahmood , Amr Magdy , Minyao Zhu

A key characteristic of deep recommendation models is the immense memory requirements of their embedding tables. These embedding tables can often reach hundreds of gigabytes which increases hardware requirements and training cost. A common…

Databases employ indexes to filter out irrelevant records, which reduces scan overhead and speeds up query execution. However, this optimization is only available to queries that filter on the indexed attribute. To extend these speedups to…

Databases · Computer Science 2020-12-15 Vikram Nathan , Jialin Ding , Tim Kraska , Mohammad Alizadeh

Temporal graphs model relationships among entities over time. Recent studies applied temporal graphs to abstract complex systems such as continuous communication among participants of social networks. Often, the amount of data is larger…

Data Structures and Algorithms · Computer Science 2022-04-27 Luiz F. A. Brito , Bruno A. N. Travençolo , Marcelo K. Albertini

This paper proposes round-hashing, which is suitable for data storage on distributed servers and for implementing external-memory tables in which each lookup retrieves at most a single block of external memory, using a stash. For data…

Data Structures and Algorithms · Computer Science 2018-05-09 Roberto Grossi , Luca Versari

Index structures are fundamental for efficient query processing on large-scale datasets. Learned indexes model the indexing process as a prediction problem to overcome the inherent trade-offs of traditional indexes. However, most existing…

Databases · Computer Science 2026-03-31 Yuzhen Chen , Bin Yao

Driver intention recognition studies increasingly rely on deep neural networks. Deep neural networks have achieved top performance for many different tasks, but it is not a common practice to explicitly analyse the complexity and…

Machine Learning · Computer Science 2024-11-22 Koen Vellenga , H. Joe Steinhauer , Alexander Karlsson , Göran Falkman , Asli Rhodin , Ashok Koppisetty

Worst-case optimal join algorithms have gained a lot of attention in the database literature. We now count with several algorithms that are optimal in the worst case, and many of them have been implemented and validated in practice.…

Databases · Computer Science 2020-01-10 Gonzalo Navarro , Juan L. Reutter , Javiel Rojas-Ledesma

We present an optimal partially-persistent external-memory search tree with amortized I/O bounds matching those achieved by the non-persistent $B^{\varepsilon}$-tree by Brodal and Fagerberg [SODA 2003]. In a partially-persistent data…

Data Structures and Algorithms · Computer Science 2025-03-12 Gerth Stølting Brodal , Casper Moldrup Rysgaard , Rolf Svenning

Machine Learning Techniques, properly combined with Data Structures, have resulted in Learned Static Indexes, innovative and powerful tools that speed-up Binary Search, with the use of additional space with respect to the table being…

Information Retrieval · Computer Science 2022-09-20 Domenico Amato , Giosuè Lo Bosco , Raffaele Giancarlo

Memory plays a vital role in the temporal evolution of interactions of complex systems. To address the impact of memory on the temporal pattern of networks, we propose a simple preferential connection model, in which nodes have a…

Physics and Society · Physics 2020-01-16 F. Rabbani , T. Khraisha , F. Abbasi , G. R. Jafari

Sorting extremely large datasets is a frequently occuring task in practice. These datasets are usually much larger than the computer's main memory; thus external memory sorting algorithms, first introduced by Aggarwal and Vitter (1988), are…

Data Structures and Algorithms · Computer Science 2018-11-06 Alireza Farhadi , MohammadTaghi Hajiaghayi , Kasper Green Larsen , Elaine Shi

In this paper, we revisit the problem of indexing multi-dimensional data in memory for the efficient support of multi-dimensional range queries and nearest neighbor queries. This is a classic problem in main-memory databases, where there is…

Databases · Computer Science 2026-05-06 Achilleas Michalopoulos , Dimitrios Tsitsigkos , Nikos Mamoulis