English
Related papers

Related papers: Machine Learning-based Cardinality Estimation in D…

200 papers

Cardinality estimation (CardEst), a central component of the query optimizer, plays a significant role in generating high-quality query plans in DBMS. The CardEst problem has been extensively studied in the last several decades, using both…

Databases · Computer Science 2021-12-08 Rong Zhu , Tianjing Zeng , Andreas Pfadler , Wei Chen , Bolin Ding , Jingren Zhou

We present a novel approach for learning to predict sets using deep learning. In recent years, deep neural networks have shown remarkable results in computer vision, natural language processing and other related problems. Despite their…

Computer Vision and Pattern Recognition · Computer Science 2017-11-23 S. Hamid Rezatofighi , Anton Milan , Qinfeng Shi , Anthony Dick , Ian Reid

We construct neural network regression models to predict key metrics of complexity for Gr\"obner bases of binomial ideals. This work illustrates why predictions with neural networks from Gr\"obner computations are not a straightforward…

Commutative Algebra · Mathematics 2025-08-28 Shahrzad Jamshidi , Eric Kang , Sonja Petrović

Cardinality estimation has long been crucial for cost-based database optimizers in identifying optimal query execution plans, attracting significant attention over the past decades. While recent advancements have significantly improved the…

Databases · Computer Science 2025-10-20 Renrui Li , Qingzhi Ma , Jiajie Xu , Lei Zhao , An Liu

Curriculum learning-organizing training data from easy to hard-has improved efficiency across machine learning domains, yet remains underexplored for language model pretraining. We present the first systematic investigation of curriculum…

Computation and Language · Computer Science 2026-01-29 Yang Zhang , Amr Mohamed , Hadi Abdine , Guokan Shang , Michalis Vazirgiannis

For efficient query processing, DBMS query optimizers have for decades relied on delicate cardinality estimation methods. In this work, we propose an Attention-based LEarned Cardinality Estimator (ALECE for short) for SPJ queries. The core…

Databases · Computer Science 2023-10-24 Pengfei Li , Wenqing Wei , Rong Zhu , Bolin Ding , Jingren Zhou , Hua Lu

Recent advances in quantum computing have led to progress in exploring quantum applications across diverse fields, including databases and data management. This work presents a quantum machine learning model that tackles the challenge of…

Databases · Computer Science 2026-01-08 Valter Uotila

Estimating the cardinality (i.e., the number of answers) of conjunctive queries is particularly difficult in RDF systems: queries over RDF data are navigational and thus tend to involve many joins. We present a new, principled cardinality…

Databases · Computer Science 2018-02-19 Giorgio Stefanoni , Boris Motik , Egor V. Kostylev

Many machine learning problems require the prediction of multi-dimensional labels. Such structured prediction models can benefit from modeling dependencies between labels. Recently, several deep learning approaches to structured prediction…

Machine Learning · Computer Science 2018-02-14 Nataly Brukhim , Amir Globerson

Despite of decades of work, query optimizers still make mistakes on "difficult" queries because of bad cardinality estimates, often due to the interaction of multiple predicates and correlations in the data. In this paper, we propose a…

Databases · Computer Science 2016-01-22 Wentao Wu , Jeffrey F. Naughton , Harneet Singh

Cardinality estimation and conjunctive query evaluation are two of the most fundamental problems in database query processing. Recent work proposed, studied, and implemented a robust and practical information-theoretic cardinality…

Databases · Computer Science 2025-04-04 Sungjin Im , Benjamin Moseley , Hung Q. Ngo , Kirk Pruhs

Cardinality estimation is a fundamental problem in database systems. To capture the rich joint data distributions of a relational table, most of the existing work either uses data as unsupervised information or uses query workload as…

Databases · Computer Science 2021-07-28 Peizhi Wu , Gao Cong

Cardinality potentials are a generally useful class of high order potential that affect probabilities based on how many of D binary variables are active. Maximum a posteriori (MAP) inference for cardinality potential models is…

Machine Learning · Computer Science 2012-10-19 Daniel Tarlow , Kevin Swersky , Richard S. Zemel , Ryan Prescott Adams , Brendan J. Frey

Meta-learning offers a principled framework leveraging \emph{task-invariant} priors from related tasks, with which \emph{task-specific} models can be fine-tuned on downstream tasks, even with limited data records. Gradient-based…

Machine Learning · Computer Science 2026-04-16 Yilang Zhang , Abraham Jaeger Mountain , Bingcong Li , Georgios B. Giannakis

To achieve high performance of a machine learning (ML) task, a deep learning-based model must implicitly capture the entire distribution from data. Thus, it requires a huge amount of training samples, and data are expected to fully present…

Machine Learning · Computer Science 2021-11-17 Hung Nguyen , Morris Chang

Over recent years, an increasing amount of compute and data has been poured into training large language models (LLMs), usually by doing one-pass learning on as many tokens as possible randomly selected from large-scale web corpora. While…

Computation and Language · Computer Science 2023-08-24 Kushal Tirumala , Daniel Simig , Armen Aghajanyan , Ari S. Morcos

Modern Cardinality Estimators struggle with data updates. This research tackles this challenge within single-table. We introduce ICE, an Index-based Cardinality Estimator, the first data-driven estimator that enables instant, tuple-leveled…

Databases · Computer Science 2024-09-02 Yingze Li , Xianglong Liu , Hongzhi Wang , Kaixin Zhang , Zixuan Wang

Research on learned cardinality estimation has made significant progress in recent years. However, existing methods still face distinct challenges that hinder their practical deployment in production environments. We define these challenges…

Databases · Computer Science 2025-09-10 Kaixin Zhang , Hongzhi Wang , Ziqi Li , Yabin Lu , Yingze Li , Yu Yan , Yiming Guan

Meta Learning has been in focus in recent years due to the meta-learner model's ability to adapt well and generalize to new tasks, thus, reducing both the time and data requirements for learning. However, a major drawback of meta learner is…

Machine Learning · Computer Science 2021-10-28 Varad Pimpalkhute , Amey Pandit , Mayank Mishra , Rekha Singhal

Machine learning can provide deep insights into data, allowing machines to make high-quality predictions and having been widely used in real-world applications, such as text mining, visual classification, and recommender systems. However,…

Machine Learning · Computer Science 2020-08-11 Meng Wang , Weijie Fu , Xiangnan He , Shijie Hao , Xindong Wu