中文
相关论文

相关论文: NeuroCard: One Cardinality Estimator for All Table…

200 篇论文

Cardinality estimation is a fundamental task in database query processing and optimization. As shown in recent papers, machine learning (ML)-based approaches can deliver more accurate cardinality estimations than traditional approaches.…

数据库 · 计算机科学 2022-01-19 Lucas Woltmann , Claudio Hartmann , Dirk Habich , Wolfgang Lehner

Recent work has reemphasized the importance of cardinality estimates for query optimization. While new techniques have continuously improved in accuracy over time, they still generally allow for under-estimates which often lead optimizers…

数据库 · 计算机科学 2022-11-21 Kyle Deeds , Dan Suciu , Magda Balazinska

Deep learning models have become popular in the analysis of tabular data, as they address the limitations of decision trees and enable valuable applications like semi-supervised learning, online learning, and transfer learning. However,…

机器学习 · 计算机科学 2024-02-29 Jiaqi Luo , Shixin Xu

Cardinality estimation is a fundamental but long unresolved problem in query optimization. Recently, multiple papers from different research groups consistently report that learned models have the potential to replace existing cardinality…

数据库 · 计算机科学 2021-08-12 Xiaoying Wang , Changbo Qu , Weiyuan Wu , Jiannan Wang , Qingqing Zhou

Query optimizer is at the heart of the database systems. Cost-based optimizer studied in this paper is adopted in almost all current database systems. A cost-based optimizer introduces a plan enumeration algorithm to find a (sub)plan, and…

数据库 · 计算机科学 2021-01-06 Hai Lan , Zhifeng Bao , Yuwei Peng

We describe a new deep learning approach to cardinality estimation. MSCN is a multi-set convolutional network, tailored to representing relational query plans, that employs set semantics to capture query features and true cardinalities.…

数据库 · 计算机科学 2018-12-19 Andreas Kipf , Thomas Kipf , Bernhard Radke , Viktor Leis , Peter Boncz , Alfons Kemper

Cardinality estimation is a fundamental component in database systems, crucial for generating efficient execution plans. Despite advancements in learning-based cardinality estimation, existing methods may struggle to simultaneously optimize…

数据库 · 计算机科学 2025-05-14 Jiawei Liu , Ju Fan , Tongyu Liu , Kai Zeng , Jiannan Wang , Quehuan Liu , Tao Ye , Nan Tang

Cardinality estimation is a critical component and a longstanding challenge in modern data warehouses. ByteHouse, ByteDance's cloud-native engine for extensive data analysis in exabyte-scale environments, serves numerous internal…

数据库 · 计算机科学 2024-04-12 Yuxing Han , Haoyu Wang , Lixiang Chen , Yifeng Dong , Xing Chen , Benquan Yu , Chengcheng Yang , Weining Qian

Learned cardinality estimation methods have achieved high precision compared to traditional methods. Among learned methods, query-driven approaches have faced the workload drift problem for a long time. Although both data-driven and hybrid…

数据库 · 计算机科学 2023-12-04 Kaixin Zhang , Hongzhi Wang , Yabin Lu , Ziqi Li , Chang Shu , Yu Yan , Donghua Yang

Existing research on making sense of deep neural networks often focuses on neuron-level interpretation, which may not adequately capture the bigger picture of how concepts are collectively encoded by multiple neurons. We present…

计算机视觉与模式识别 · 计算机科学 2021-08-31 Haekyu Park , Nilaksh Das , Rahul Duggal , Austin P. Wright , Omar Shaikh , Fred Hohman , Duen Horng Chau

Join ordering is a key factor in query performance, yet traditional cost-based optimizers often produce sub-optimal plans due to inaccurate cardinality estimates in multi-predicate, multi-join queries. Existing alternatives such as…

数据库 · 计算机科学 2025-08-26 David Justen , Matthias Boehm

Modern Cardinality Estimators struggle with data updates. This research tackles this challenge within single-table. We introduce ICE, an Index-based Cardinality Estimator, the first data-driven estimator that enables instant, tuple-leveled…

数据库 · 计算机科学 2024-09-02 Yingze Li , Xianglong Liu , Hongzhi Wang , Kaixin Zhang , Zixuan Wang

We construct neural network regression models to predict key metrics of complexity for Gr\"obner bases of binomial ideals. This work illustrates why predictions with neural networks from Gr\"obner computations are not a straightforward…

交换代数 · 数学 2025-08-28 Shahrzad Jamshidi , Eric Kang , Sonja Petrović

Cardinality Estimation over Knowledge Graphs (KG) is crucial for query optimization, yet remains a challenging task due to the semi-structured nature and complex correlations of typical Knowledge Graphs. In this work, we propose GNCE, a…

数据库 · 计算机科学 2024-06-04 Tim Schwabe , Maribel Acosta

For efficient query processing, DBMS query optimizers have for decades relied on delicate cardinality estimation methods. In this work, we propose an Attention-based LEarned Cardinality Estimator (ALECE for short) for SPJ queries. The core…

数据库 · 计算机科学 2023-10-24 Pengfei Li , Wenqing Wei , Rong Zhu , Bolin Ding , Jingren Zhou , Hua Lu

Cardinality Estimation (CE) for query is to estimate the number of results without execution, which is an effective index in query optimization. Recently, CE for queries over knowlege graph (KGs) with triple facts has achieved great…

机器学习 · 计算机科学 2025-02-19 Fei Teng , Haoyang Li , Shimin Di , Lei Chen

This work presents new cardinality estimation methods for data sets recorded by HyperLogLog sketches. A simple derivation of the original estimator was found, that also gives insight how to correct its deficiencies. The result is an…

数据结构与算法 · 计算机科学 2017-06-23 Otmar Ertl

Query optimizers rely on accurate cardinality estimation (CardEst) to produce good execution plans. The core problem of CardEst is how to model the rich joint distribution of attributes in an accurate and compact manner. Despite decades of…

数据库 · 计算机科学 2021-05-20 Rong Zhu , Ziniu Wu , Yuxing Han , Kai Zeng , Andreas Pfadler , Zhengping Qian , Jingren Zhou , Bin Cui

Deep Learning (DL) has achieved great success in many real applications. Despite its success, there are some main problems when deploying advanced DL models in database systems, such as hyper-parameters tuning, the risk of overfitting, and…

数据库 · 计算机科学 2021-07-20 Kangfei Zhao , Jeffrey Xu Yu , Zongyan He , Hao Zhang

Cardinality estimation is a key component of database query optimization. Recent studies have demonstrated that learned cardinality estimation techniques can surpass traditional methods in accuracy. However, a significant barrier to their…

数据库 · 计算机科学 2025-12-30 Lyu Yi , Weiqi Feng , Yuanbiao Wang , Yuhong Kan