English
Related papers

Related papers: ACE: A Cardinality Estimator for Set-Valued Querie…

200 papers

SQL queries, with the AND, OR, and NOT operators, constitute a broad class of highly used queries. Thus, their cardinality estimation is important for query optimization. In addition, a query planner requires the set-theoretic cardinality…

Databases · Computer Science 2020-04-16 Rojeh Hayek , Oded Shmueli

Cardinality estimation is a key component of database query optimization. Recent studies have demonstrated that learned cardinality estimation techniques can surpass traditional methods in accuracy. However, a significant barrier to their…

Databases · Computer Science 2025-12-30 Lyu Yi , Weiqi Feng , Yuanbiao Wang , Yuhong Kan

Many techniques have been developed for the cardinality estimation problem in data management systems. In this document, we introduce a framework for cardinality estimation of query patterns over property graph databases, which makes it…

Databases · Computer Science 2023-06-14 Wilco van Leeuwen , George Fletcher , Nikolay Yakovets

Query optimizer is at the heart of the database systems. Cost-based optimizer studied in this paper is adopted in almost all current database systems. A cost-based optimizer introduces a plan enumeration algorithm to find a (sub)plan, and…

Databases · Computer Science 2021-01-06 Hai Lan , Zhifeng Bao , Yuwei Peng

Innovative learning based structures have recently been proposed to tackle index and cardinality estimation tasks, specifically learned indexes and data driven cardinality estimators. These structures exhibit excellent performance in…

Databases · Computer Science 2023-05-30 Yingze Li , Hongzhi Wang , Xianglong Liu

Due to the outstanding capability of capturing underlying data distributions, deep learning techniques have been recently utilized for a series of traditional database problems. In this paper, we investigate the possibilities of utilizing…

Databases · Computer Science 2021-09-27 Yaoshu Wang , Chuan Xiao , Jianbin Qin , Xin Cao , Yifang Sun , Wei Wang , Makoto Onizuka

DB engines produce efficient query execution plans by relying on cost models. Practical implementations estimate cardinality of queries using heuristics, with magic numbers tuned to improve average performance on benchmarks. Empirically,…

Cardinality estimation has long been crucial for cost-based database optimizers in identifying optimal query execution plans, attracting significant attention over the past decades. While recent advancements have significantly improved the…

Databases · Computer Science 2025-10-20 Renrui Li , Qingzhi Ma , Jiajie Xu , Lei Zhao , An Liu

Experiments are the gold standard for causal inference. In many applications, experimental units can often be recruited or chosen sequentially, and the adaptive execution of such experiments may offer greatly improved inference of causal…

Methodology · Statistics 2023-06-14 Difan Song , Simon Mak , C. F. Jeff Wu

Current evaluation frameworks for foundation models rely heavily on static, manually curated benchmarks, limiting their ability to capture the full breadth of model capabilities. This paper introduces Active learning for Capability…

Machine Learning · Computer Science 2025-10-13 Arash Afkanpour , Omkar Dige , Fatemeh Tavakoli , Negin Baghbanzadeh , Farnaz Kohankhaki , Elham Dolatabadi

Cardinality estimation algorithms receive a stream of elements whose order might be arbitrary, with possible repetitions, and return the number of distinct elements. Such algorithms usually seek to minimize the required storage and…

Data Structures and Algorithms · Computer Science 2015-08-26 Reuven Cohen , Liran Katzir , Aviv Yehezkel

Most query optimizers rely on cardinality estimates to determine optimal execution plans. While traditional databases such as PostgreSQL, Oracle, and Db2 utilize many types of synopses -- including histograms, samples, and sketches --…

Databases · Computer Science 2023-11-30 Asoke Datta , Brian Tsan , Yesdaulet Izenov , Florin Rusu

Estimating the cardinality of the output of a query is a fundamental problem in database query processing. In this article, we overview a recently published contribution that casts the cardinality estimation problem as linear optimization…

Databases · Computer Science 2025-05-13 Mahmoud Abo Khamis , Vasileios Nakos , Dan Olteanu , Dan Suciu

We present a detailed study of cardinality-aware top-$k$ classification, a novel approach that aims to learn an accurate top-$k$ set predictor while maintaining a low cardinality. We introduce a new target loss function tailored to this…

Machine Learning · Computer Science 2024-07-12 Corinna Cortes , Anqi Mao , Christopher Mohri , Mehryar Mohri , Yutao Zhong

Cardinality estimation is a fundamental component in database systems, crucial for generating efficient execution plans. Despite advancements in learning-based cardinality estimation, existing methods may struggle to simultaneously optimize…

Databases · Computer Science 2025-05-14 Jiawei Liu , Ju Fan , Tongyu Liu , Kai Zeng , Jiannan Wang , Quehuan Liu , Tao Ye , Nan Tang

The containment rate of query Q1 in query Q2 over database D is the percentage of Q1's result tuples over D that are also in Q2's result over D. We directly estimate containment rates between pairs of queries over a specific database. For…

Databases · Computer Science 2019-08-22 Rojeh Hayek , Oded Shmueli

Cardinality estimation algorithms receive a stream of elements, with possible repetitions, and return the number of distinct elements in the stream. Such algorithms seek to minimize the required memory and CPU resource consumption at the…

Networking and Internet Architecture · Computer Science 2019-03-15 Reuven Cohen , Yuval Nezri

The Causal Effect (CE) is a numerical measure of causal influence of variables on observed results. Despite being widely used in many areas, only preliminary attempts have been made to use CE as an attribution score in data management, to…

Databases · Computer Science 2025-09-23 Felipe Azua , Leopoldo Bertossi

Query optimizers rely on accurate cardinality estimates to produce good execution plans. Despite decades of research, existing cardinality estimators are inaccurate for complex queries, due to making lossy modeling assumptions and not…

Databases · Computer Science 2020-11-04 Zongheng Yang , Amog Kamsetty , Sifei Luan , Eric Liang , Yan Duan , Xi Chen , Ion Stoica

We study two classes of summary-based cardinality estimators that use statistics about input relations and small-size joins in the context of graph database management systems: (i) optimistic estimators that make uniformity and conditional…

Databases · Computer Science 2021-05-20 Jeremy Chen , Yuqing Huang , Mushi Wang , Semih Salihoglu , Ken Salem