English
Related papers

Related papers: An Empirical Analysis of Deep Learning for Cardina…

200 papers

Cardinality estimation (CardEst) plays a significant role in generating high-quality query plans for a query optimizer in DBMS. In the last decade, an increasing number of advanced CardEst methods (especially ML-based) have been proposed…

Cardinality estimation is a key component of database query optimization. Recent studies have demonstrated that learned cardinality estimation techniques can surpass traditional methods in accuracy. However, a significant barrier to their…

Databases · Computer Science 2025-12-30 Lyu Yi , Weiqi Feng , Yuanbiao Wang , Yuhong Kan

Cardinality estimation is a fundamental task in database management systems, aiming to predict query results accurately without executing the queries. However, existing techniques either achieve low estimation accuracy or incur high…

Databases · Computer Science 2025-08-14 Yaoyu Zhu , Jintao Zhang , Guoliang Li , Jianhua Feng

Query optimizers rely on accurate cardinality estimates to produce good execution plans. Despite decades of research, existing cardinality estimators are inaccurate for complex queries, due to making lossy modeling assumptions and not…

Databases · Computer Science 2020-11-04 Zongheng Yang , Amog Kamsetty , Sifei Luan , Eric Liang , Yan Duan , Xi Chen , Ion Stoica

High-dimensional data has become ubiquitous across the sciences but presents computational and statistical challenges. A common approach to addressing these challenges is through sparsity. In this paper, we introduce a new concept of…

Statistics Theory · Mathematics 2025-09-03 Ali Mohades , Johannes Lederer

Cardinality estimation is a critical component and a longstanding challenge in modern data warehouses. ByteHouse, ByteDance's cloud-native engine for extensive data analysis in exabyte-scale environments, serves numerous internal…

Databases · Computer Science 2024-04-12 Yuxing Han , Haoyu Wang , Lixiang Chen , Yifeng Dong , Xing Chen , Benquan Yu , Chengcheng Yang , Weining Qian

Recent work has reemphasized the importance of cardinality estimates for query optimization. While new techniques have continuously improved in accuracy over time, they still generally allow for under-estimates which often lead optimizers…

Databases · Computer Science 2022-11-21 Kyle Deeds , Dan Suciu , Magda Balazinska

Cardinality estimation (CE), the task of predicting the result size of queries is a critical component of query optimization. Accurate estimates are essential for generating efficient query execution plans. Recently, machine learning…

Databases · Computer Science 2025-12-16 Lankadinee Rathuwadu , Guanli Liu , Christopher Leckie , Renata Borovica-Gajic

Machine learning models have demonstrated substantial performance enhancements over non-learned alternatives in various fundamental data management operations, including indexing (locating items in an array), cardinality estimation…

Databases · Computer Science 2024-11-12 Sepanta Zeighami , Cyrus Shahabi

Cardinality estimation is a fundamental task in database systems and plays a critical role in query optimization. Despite significant advances in learning-based cardinality estimation methods, most existing approaches remain difficult to…

Databases · Computer Science 2025-10-10 Xianghong Xu , Rong Kang , Xiao He , Lei Zhang , Jianjun Chen , Tieying Zhang

Selectivity estimation - the problem of estimating the result size of queries - is a fundamental problem in databases. Accurate estimation of query selectivity involving multiple correlated attributes is especially challenging. Poor…

Databases · Computer Science 2019-06-19 Shohedul Hasan , Saravanan Thirumuruganathan , Jees Augustine , Nick Koudas , Gautam Das

We develop a methodology that utilizes deep learning to simultaneously solve and estimate canonical continuous-time general equilibrium models in financial economics. We illustrate our method in two examples: (1) industrial dynamics of…

Computational Finance · Quantitative Finance 2023-05-18 Benjamin Fan , Edward Qiao , Anran Jiao , Zhouzhou Gu , Wenhao Li , Lu Lu

Cardinality potentials are a generally useful class of high order potential that affect probabilities based on how many of D binary variables are active. Maximum a posteriori (MAP) inference for cardinality potential models is…

Machine Learning · Computer Science 2012-10-19 Daniel Tarlow , Kevin Swersky , Richard S. Zemel , Ryan Prescott Adams , Brendan J. Frey

Cardinality Estimation over Knowledge Graphs (KG) is crucial for query optimization, yet remains a challenging task due to the semi-structured nature and complex correlations of typical Knowledge Graphs. In this work, we propose GNCE, a…

Databases · Computer Science 2024-06-04 Tim Schwabe , Maribel Acosta

Cardinality estimation is a key bottleneck for cost-based query optimization, yet deployable improvements remain difficult: classical estimators miss correlations, while learned estimators often require workload-specific training pipelines…

Artificial Intelligence · Computer Science 2025-12-19 Qizhi Wang

Cardinality estimation (CardEst) is an essential component in query optimizers and a fundamental problem in DBMS. A desired CardEst method should attain good algorithm performance, be stable to varied data settings, and be friendly to…

Databases · Computer Science 2021-02-03 Ziniu Wu , Amir Shaikhha , Rong Zhu , Kai Zeng , Yuxing Han , Jingren Zhou

Cardinality estimation is a fundamental component in database systems, crucial for generating efficient execution plans. Despite advancements in learning-based cardinality estimation, existing methods may struggle to simultaneously optimize…

Databases · Computer Science 2025-05-14 Jiawei Liu , Ju Fan , Tongyu Liu , Kai Zeng , Jiannan Wang , Quehuan Liu , Tao Ye , Nan Tang

Deep neural networks are increasingly being used for the analysis of medical images. However, most works neglect the uncertainty in the model's prediction. We propose an uncertainty-aware deep kernel learning model which permits the…

Machine Learning · Computer Science 2021-06-11 Zhiliang Wu , Yinchong Yang , Jindong Gu , Volker Tresp

We investigate the use of deep convolutional neural networks (deep CNNs) for automatic visual detection of galaxy mergers. Moreover, we investigate the use of transfer learning in conjunction with CNNs, by retraining networks first trained…

Instrumentation and Methods for Astrophysics · Physics 2018-06-13 Sandro Ackermann , Kevin Schawinski , Ce Zhang , Anna K. Weigel , M. Dennis Turp

Business analytics refers to methods and practices that create value through data for individuals, firms, and organizations. This field is currently experiencing a radical shift due to the advent of deep learning: deep neural networks…

Machine Learning · Computer Science 2019-09-13 Mathias Kraus , Stefan Feuerriegel , Asil Oztekin