English
Related papers

Related papers: A Survey on Advancing the DBMS Query Optimizer: Ca…

200 papers

Join order optimization is among the most crucial query optimization problems, and its central position is also evident in the new research field where quantum computing is applied to database optimization and data management. In the field,…

Quantum Physics · Physics 2025-02-04 Valter Uotila

Cardinality estimation has long been crucial for cost-based database optimizers in identifying optimal query execution plans, attracting significant attention over the past decades. While recent advancements have significantly improved the…

Databases · Computer Science 2025-10-20 Renrui Li , Qingzhi Ma , Jiajie Xu , Lei Zhao , An Liu

Cardinality estimation (CardEst) is an essential component in query optimizers and a fundamental problem in DBMS. A desired CardEst method should attain good algorithm performance, be stable to varied data settings, and be friendly to…

Databases · Computer Science 2021-02-03 Ziniu Wu , Amir Shaikhha , Rong Zhu , Kai Zeng , Yuxing Han , Jingren Zhou

Cardinality estimation remains a fundamental challenge in query optimization, often resulting in sub-optimal execution plans and degraded performance. While errors in cardinality estimation are inevitable, existing methods for identifying…

Databases · Computer Science 2025-01-29 Asoke Datta , Yesdaulet Izenov , Brian Tsan , Abylay Amanbayev , Florin Rusu

Query optimizers have long been considered as among the most complex components of a database engine, while the assessment of an optimizer's quality remains a challenging task. Indeed, existing performance benchmarks for database engines…

Databases · Computer Science 2016-08-10 Zhan Li , Olga Papaemmanouil , Mitch Cherniack

View materialization, index selection, and plan caching are well-known techniques for optimization of query processing in database systems. The essence of these tasks is to select and save a subset of the most useful candidates…

Databases · Computer Science 2025-01-28 Sergey Zinchenko , Denis Ponomaryov

Modern database systems rely on cost-based query optimizers to come up with good execution plans for input queries. Such query optimizers rely on cost models to estimate the costs of candidate query execution plans. A cost model represents…

Databases · Computer Science 2024-04-02 Wentao Wu , Chi Wang

Lakehouse systems enable the same data to be queried with multiple execution engines. However, selecting the engine best suited to run a SQL query still requires a priori knowledge of the query computational requirements and an engine…

Databases · Computer Science 2025-06-04 András Strausz , Niels Pardon , Ioana Giurgiu

A recent line of works apply machine learning techniques to assist or rebuild cost-based query optimizers in DBMS. While exhibiting superiority in some benchmarks, their deficiencies, e.g., unstable performance, high training cost, and slow…

Databases · Computer Science 2023-02-21 Rong Zhu , Wei Chen , Bolin Ding , Xingguang Chen , Andreas Pfadler , Ziniu Wu , Jingren Zhou

In recent years, \emph{learned cardinality estimation} has emerged as an alternative to traditional query optimization methods: by training machine learning models over observed query performance, learned cardinality estimation techniques…

Databases · Computer Science 2023-12-05 Peizhi Wu , Ryan Marcus , Zachary G. Ives

Algorithms that exploit sort orders are widely used to implement joins, grouping, duplicate elimination and other set operations. Query optimizers traditionally deal with sort orders by using the notion of interesting orders. The number of…

Databases · Computer Science 2007-05-23 Ravindra Guravannavar , S Sudarshan , Ajit A Diwan , Ch. Sobhan Babu

Cardinality estimation is a fundamental task in database query processing and optimization. As shown in recent papers, machine learning (ML)-based approaches can deliver more accurate cardinality estimations than traditional approaches.…

Databases · Computer Science 2022-01-19 Lucas Woltmann , Claudio Hartmann , Dirk Habich , Wolfgang Lehner

Query optimization remains one of the most important and well-studied problems in database systems. However, traditional query optimizers are complex heuristically-driven systems, requiring large amounts of time to tune for a particular…

Databases · Computer Science 2018-12-19 Ryan Marcus , Olga Papaemmanouil

Cardinality estimation is a fundamental component in database systems, crucial for generating efficient execution plans. Despite advancements in learning-based cardinality estimation, existing methods may struggle to simultaneously optimize…

Databases · Computer Science 2025-05-14 Jiawei Liu , Ju Fan , Tongyu Liu , Kai Zeng , Jiannan Wang , Quehuan Liu , Tao Ye , Nan Tang

Predicting the execution time of queries is an important problem with applications in scheduling, service level agreements and error detection. During query planning, a cost is associated with the chosen execution plan and used to rank…

Databases · Computer Science 2019-05-03 Anthony Kleerekoper , Javier Navaridas , Mikel Lujan

Recently, using automatic configuration tuning to improve the performance of modern database management systems (DBMSs) has attracted increasing interest from the database community. This is embodied with a number of systems featuring…

Databases · Computer Science 2022-03-15 Xinyi Zhang , Zhuo Chang , Yang Li , Hong Wu , Jian Tan , Feifei Li , Bin Cui

As declarative query processing techniques expand in scope --- to the Web, data streams, network routers, and cloud platforms --- there is an increasing need for adaptive query processing techniques that can re-plan in the presence of…

Databases · Computer Science 2014-09-23 Mengmeng Liu , Zachary G. Ives , Boon Thau Loo

Unreliable cardinality estimation remains a critical performance bottleneck in database management systems (DBMSs). Adaptive Query Processing (AQP) strategies address this limitation by providing a more robust query execution mechanism.…

Databases · Computer Science 2025-11-21 Pei Mu , Anderson Chaves Carniel , Antonio Barbalace , Amir Shaikhha

Cardinality estimation is a fundamental functionality in database systems. Most existing cardinality estimators focus on handling predicates over numeric or categorical data. They have largely omitted an important data type, set-valued…

Databases · Computer Science 2025-03-20 Yufan Sheng , Xin Cao , Kaiqi Zhao , Yixiang Fang , Jianzhong Qi , Wenjie Zhang , Christian S. Jensen

Query Optimization remains an open problem for Big Data Management Systems. Traditional optimizers are cost-based and use statistical estimates of intermediate result cardinalities to assign costs and pick the best plan. However, such…

Databases · Computer Science 2020-10-07 Christina Pavlopoulou , Michael J. Carey , Vassilis J. Tsotras