English
Related papers

Related papers: How I Learned to Stop Worrying and Love Re-optimiz…

200 papers

Predicting the execution time of queries is an important problem with applications in scheduling, service level agreements and error detection. During query planning, a cost is associated with the chosen execution plan and used to rank…

Databases · Computer Science 2019-05-03 Anthony Kleerekoper , Javier Navaridas , Mikel Lujan

In data warehouse and data mart systems, queries often take a long time to execute due to their complex nature. Query response times can be greatly improved by caching final/intermediate results of previous queries, and using them to answer…

Databases · Computer Science 2007-05-23 Prasan Roy , Krithi Ramamritham , S. Seshadri , Pradeep Shenoy , S. Sudarshan

Many database applications perform complex data retrieval and update tasks. Nested queries, and queries that invoke user-defined functions, which are written using a mix of procedural and SQL constructs, are often used in such applications.…

Databases · Computer Science 2009-11-04 Ravindra Guravannavar

Query optimization has played a central role in database research for decades. However, more often than not, the proposed optimization techniques lead to a performance improvement in some, but not in all, situations. Therefore, we urgently…

Many data analytics systems store and process large datasets in partitions containing millions of rows. By mapping rows to partitions in an optimized way, it is possible to improve query performance by skipping over large numbers of…

Databases · Computer Science 2024-05-09 Kexin Rong , Paul Liu , Sarah Ashok Sonje , Moses Charikar

Query processing over big data is ubiquitous in modern clouds, where the system takes care of picking both the physical query execution plans and the resources needed to run those plans, using a cost-based query optimizer. A good cost…

Databases · Computer Science 2020-03-02 Tarique Siddiqui , Alekh Jindal , Shi Qiao , Hiren Patel , Wangchao le

Exhaustive enumeration of all possible join orders is often avoided, and most optimizers leverage heuristics to prune the search space. The design and implementation of heuristics are well-understood when the cost model is roughly linear,…

Databases · Computer Science 2019-01-14 Sanjay Krishnan , Zongheng Yang , Ken Goldberg , Joseph Hellerstein , Ion Stoica

Database theory is exciting because it studies highly general and practically useful abstractions. Conjunctive query (CQ) evaluation is a prime example: it simultaneously generalizes graph pattern matching, constraint satisfaction, and…

Databases · Computer Science 2026-04-07 Mahmoud Abo Khamis , Hung Q. Ngo , Dan Suciu

Cost and cardinality estimation is vital to query optimizer, which can guide the plan selection. However traditional empirical cost and cardinality estimation techniques cannot provide high-quality estimation, because they cannot capture…

Databases · Computer Science 2019-06-07 Ji Sun , Guoliang Li

Reasoning models have gained significant attention due to their strong performance, particularly when enhanced with retrieval augmentation. However, these models often incur high computational costs, as both retrieval and reasoning tokens…

Computation and Language · Computer Science 2025-10-20 Helia Hashemi , Victor Rühle , Saravan Rajmohan

Efficient join processing is one of the most fundamental and well-studied tasks in database research. In this work, we examine algorithms for natural join queries over many relations and describe a novel algorithm to process these queries…

Databases · Computer Science 2012-03-12 Hung Q. Ngo , Ely Porat , Christopher Ré , Atri Rudra

Query optimizers are a performance-critical component in every database system. Due to their complexity, optimizers take experts months to write and years to refine. In this work, we demonstrate for the first time that learning to optimize…

Databases · Computer Science 2022-05-05 Zongheng Yang , Wei-Lin Chiang , Sifei Luan , Gautam Mittal , Michael Luo , Ion Stoica

Various works have utilized deep learning to address the query optimization problem in database system. They either learn to construct plans from scratch in a bottom-up manner or steer the plan generation behavior of traditional optimizer…

Databases · Computer Science 2024-08-15 Kai Zhong , Luming Sun , Tao Ji , Cuiping Li , Hong Chen

Evaluating the relational join is one of the central algorithmic and most well-studied problems in database systems. A staggering number of variants have been considered including Block-Nested loop join, Hash-Join, Grace, Sort-merge for…

Databases · Computer Science 2013-10-17 Hung Q. Ngo , Christopher Re , Atri Rudra

Unreliable cardinality estimation remains a critical performance bottleneck in database management systems (DBMSs). Adaptive Query Processing (AQP) strategies address this limitation by providing a more robust query execution mechanism.…

Databases · Computer Science 2025-11-21 Pei Mu , Anderson Chaves Carniel , Antonio Barbalace , Amir Shaikhha

Several data warehouse and database providers have recently introduced extensions to SQL called AI Queries, enabling users to specify functions and conditions in SQL that are evaluated by LLMs, thereby broadening significantly the kinds of…

Bloom filters are used in query processing to perform early data reduction and improve query performance. The optimal query plan may be different when Bloom filters are used, indicating the need for Bloom filter-aware query optimization. To…

Databases · Computer Science 2025-05-07 Tim Zeyl , Qi Cheng , Reza Pournaghi , Jason Lam , Weicheng Wang , Calvin Wong , Chong Chen , Per-Ake Larson

Generative AI and LLMs in particular are heavily used nowadays for various document processing tasks such as question answering and summarization. However, different LLMs come with different capabilities for different tasks as well as with…

Computation and Language · Computer Science 2024-02-06 Shivanshu Shekhar , Tanishq Dubey , Koyel Mukherjee , Apoorv Saxena , Atharv Tyagi , Nishanth Kotla

In modern large-scale distributed systems, analytics jobs submitted by various users often share similar work, for example scanning and processing the same subset of data. Instead of optimizing jobs independently, which may result in…

Databases · Computer Science 2018-05-23 Pietro Michiardi , Damiano Carra , Sara Migliorini