English
Related papers

Related papers: Adaptive Cardinality Estimation

200 papers

Cardinality estimation is one of the most fundamental and challenging problems in query optimization. Neither classical nor learning-based methods yield satisfactory performance when estimating the cardinality of the join queries. They…

Databases · Computer Science 2022-12-13 Ziniu Wu , Parimarjan Negi , Mohammad Alizadeh , Tim Kraska , Samuel Madden

Cardinality estimation is a fundamental component in database systems, crucial for generating efficient execution plans. Despite advancements in learning-based cardinality estimation, existing methods may struggle to simultaneously optimize…

Databases · Computer Science 2025-05-14 Jiawei Liu , Ju Fan , Tongyu Liu , Kai Zeng , Jiannan Wang , Quehuan Liu , Tao Ye , Nan Tang

The principal component of conventional database query optimizers is a cost model that is used to estimate expected performance of query plans. The accuracy of the cost model has direct impact on the optimality of execution plans selected…

Databases · Computer Science 2024-09-26 Nikita Vasilenko , Alexander Demin , Denis Ponomaryov

Cardinality estimation is a fundamental functionality in database systems. Most existing cardinality estimators focus on handling predicates over numeric or categorical data. They have largely omitted an important data type, set-valued…

Databases · Computer Science 2025-03-20 Yufan Sheng , Xin Cao , Kaiqi Zhao , Yixiang Fang , Jianzhong Qi , Wenjie Zhang , Christian S. Jensen

Recent work has reemphasized the importance of cardinality estimates for query optimization. While new techniques have continuously improved in accuracy over time, they still generally allow for under-estimates which often lead optimizers…

Databases · Computer Science 2022-11-21 Kyle Deeds , Dan Suciu , Magda Balazinska

Cardinality estimation (CE), the task of predicting the result size of queries is a critical component of query optimization. Accurate estimates are essential for generating efficient query execution plans. Recently, machine learning…

Databases · Computer Science 2025-12-16 Lankadinee Rathuwadu , Guanli Liu , Christopher Leckie , Renata Borovica-Gajic

Cardinality estimation is a key component of database query optimization. Recent studies have demonstrated that learned cardinality estimation techniques can surpass traditional methods in accuracy. However, a significant barrier to their…

Databases · Computer Science 2025-12-30 Lyu Yi , Weiqi Feng , Yuanbiao Wang , Yuhong Kan

Cardinality estimation algorithms receive a stream of elements, with possible repetitions, and return the number of distinct elements in the stream. Such algorithms seek to minimize the required memory and CPU resource consumption at the…

Networking and Internet Architecture · Computer Science 2019-03-15 Reuven Cohen , Yuval Nezri

Cardinality estimation has long been crucial for cost-based database optimizers in identifying optimal query execution plans, attracting significant attention over the past decades. While recent advancements have significantly improved the…

Databases · Computer Science 2025-10-20 Renrui Li , Qingzhi Ma , Jiajie Xu , Lei Zhao , An Liu

We implement and evaluate deep learning for cardinality estimation by studying the accuracy, space and time trade-offs across several architectures. We find that simple deep learning models can learn cardinality estimations across a variety…

Databases · Computer Science 2019-09-13 Jennifer Ortiz , Magdalena Balazinska , Johannes Gehrke , S. Sathiya Keerthi

Cardinality Estimation is to estimate the size of the output of a query without computing it, by using only statistics on the input relations. Existing estimators try to return an unbiased estimate of the cardinality: this is notoriously…

Databases · Computer Science 2024-12-03 Mahmoud Abo Khamis , Kyle Deeds , Dan Olteanu , Dan Suciu

Performance-critical industrial applications, including large-scale program, network, and distributed system analyses, are increasingly reliant on recursive queries for data analysis. Yet traditional relational algebra-based query…

Databases · Computer Science 2024-03-20 Anna Herlihy , Guillaume Martres , Anastasia Ailamaki , Martin Odersky

In recent years, machine learning-based cardinality estimation methods are replacing traditional methods. This change is expected to contribute to one of the most important applications of cardinality estimation, the query optimizer, to…

Databases · Computer Science 2023-04-03 Ryuichi Ito , Yuya Sasaki , Chuan Xiao , Makoto Onizuka

In query optimisation accurate cardinality estimation is essential for finding optimal query plans. It is especially challenging for RDF due to the lack of explicit schema and the excessive occurrence of joins in RDF queries. Existing…

Databases · Computer Science 2018-01-22 Xin Wang , Eugene Siow , Aastha Madaan , Thanassis Tiropanis

As declarative query processing techniques expand in scope --- to the Web, data streams, network routers, and cloud platforms --- there is an increasing need for adaptive query processing techniques that can re-plan in the presence of…

Databases · Computer Science 2014-09-23 Mengmeng Liu , Zachary G. Ives , Boon Thau Loo

Cardinality estimation (CardEst), a central component of the query optimizer, plays a significant role in generating high-quality query plans in DBMS. The CardEst problem has been extensively studied in the last several decades, using both…

Databases · Computer Science 2021-12-08 Rong Zhu , Tianjing Zeng , Andreas Pfadler , Wei Chen , Bolin Ding , Jingren Zhou

Estimating the cardinality (i.e., the number of answers) of conjunctive queries is particularly difficult in RDF systems: queries over RDF data are navigational and thus tend to involve many joins. We present a new, principled cardinality…

Databases · Computer Science 2018-02-19 Giorgio Stefanoni , Boris Motik , Egor V. Kostylev

Cardinality estimation is a critical component and a longstanding challenge in modern data warehouses. ByteHouse, ByteDance's cloud-native engine for extensive data analysis in exabyte-scale environments, serves numerous internal…

Databases · Computer Science 2024-04-12 Yuxing Han , Haoyu Wang , Lixiang Chen , Yifeng Dong , Xing Chen , Benquan Yu , Chengcheng Yang , Weining Qian

Cardinality estimation is the problem of estimating the size of the output of a query, without actually evaluating the query. The cardinality estimator is a critical piece of a query optimizer, and is often the main culprit when the…

Databases · Computer Science 2025-02-11 Haozhe Zhang , Christoph Mayer , Mahmoud Abo Khamis , Dan Olteanu , Dan Suciu

Optimization - minimization or maximization - in the lattice of subsets is a frequent operation in Artificial Intelligence tasks. Examples are subset-minimal model-based diagnosis, nonmonotonic reasoning by means of circumscription, or…

Artificial Intelligence · Computer Science 2016-12-23 Wolfgang Faber , Mauro Vallati , Federico Cerutti , Massimiliano Giacomin