English
Related papers

Related papers: ByteCard: Enhancing ByteDance's Data Warehouse wit…

200 papers

Cardinality estimation (CardEst) is essential for optimizing query execution plans. Recent ML-based CardEst methods achieve high accuracy but face deployment challenges due to high preparation costs and lack of transferability across…

Databases · Computer Science 2025-08-25 Tianjing Zeng , Junwei Lan , Jiahong Ma , Wenqing Wei , Rong Zhu , Pengfei Li , Bolin Ding , Defu Lian , Zhewei Wei , Jingren Zhou

Host cardinality is one of the important attributes in the field of network research. The cardinality estimation under sliding time window has become a research hotspot in recent years because of its high accuracy and small delay. This kind…

Networking and Internet Architecture · Computer Science 2018-12-04 Jie Xu , Wei Ding , Xiaoyan Hu

Cardinality estimation has long been crucial for cost-based database optimizers in identifying optimal query execution plans, attracting significant attention over the past decades. While recent advancements have significantly improved the…

Databases · Computer Science 2025-10-20 Renrui Li , Qingzhi Ma , Jiajie Xu , Lei Zhao , An Liu

Cardinality estimation - calculating the number of distinct elements in a stream - is a longstanding problem with applications from networking to bioinformatics. HyperLogLog (HLL), the prevailing standard, has a well-known error spike in…

Data Structures and Algorithms · Computer Science 2026-05-14 Brian Bushnell

Cardinality Estimation over Knowledge Graphs (KG) is crucial for query optimization, yet remains a challenging task due to the semi-structured nature and complex correlations of typical Knowledge Graphs. In this work, we propose GNCE, a…

Databases · Computer Science 2024-06-04 Tim Schwabe , Maribel Acosta

Database Management Systems (DBMSs) process a given query by creating a query plan, which is subsequently executed, to compute the query's result. Deriving an efficient query plan is challenging, and both academia and industry have invested…

Software Engineering · Computer Science 2024-01-11 Jinsheng Ba , Manuel Rigger

Cardinality estimation is a fundamental task in database systems and plays a critical role in query optimization. Despite significant advances in learning-based cardinality estimation methods, most existing approaches remain difficult to…

Databases · Computer Science 2025-10-10 Xianghong Xu , Rong Kang , Xiao He , Lei Zhang , Jianjun Chen , Tieying Zhang

In recent years, \emph{learned cardinality estimation} has emerged as an alternative to traditional query optimization methods: by training machine learning models over observed query performance, learned cardinality estimation techniques…

Databases · Computer Science 2023-12-05 Peizhi Wu , Ryan Marcus , Zachary G. Ives

Counting the number of distinct elements (cardinality) in a dataset is a fundamental problem in database management. In recent years, due to many of its modern applications, there has been significant interest to address the distinct…

Computation · Statistics 2015-03-19 Aiyou Chen , Jin Cao , Larry Shepp , Tuan Nguyen

Online monitoring user cardinalities (or degrees) in graph streams is fundamental for many applications. For example in a bipartite graph representing user-website visiting activities, user cardinalities (the number of distinct visited…

Data Structures and Algorithms · Computer Science 2018-11-27 Pinghui Wang , Peng Jia , Xiangliang Zhang , Jing Tao , Xiaohong Guan , Don Towsley

Cardinality estimation is a cornerstone of cost-based optimizers (CBOs), yet real-world workloads often violate the assumptions behind static statistics, degrading decision stability and increasing plan flip rates. We empirically…

Databases · Computer Science 2026-01-01 Ilsun Chang

For efficient query processing, DBMS query optimizers have for decades relied on delicate cardinality estimation methods. In this work, we propose an Attention-based LEarned Cardinality Estimator (ALECE for short) for SPJ queries. The core…

Databases · Computer Science 2023-10-24 Pengfei Li , Wenqing Wei , Rong Zhu , Bolin Ding , Jingren Zhou , Hua Lu

Cardinalities estimation is an important research topic in network management and security. How to solve this problem under sliding time window is a hot topic. HyperLogLog is a memory efficient algorithm work under a fixed time window. A…

Networking and Internet Architecture · Computer Science 2018-11-01 Jie Xu

Cardinality estimation is a key bottleneck for cost-based query optimization, yet deployable improvements remain difficult: classical estimators miss correlations, while learned estimators often require workload-specific training pipelines…

Artificial Intelligence · Computer Science 2025-12-19 Qizhi Wang

Query optimizers rely on accurate cardinality estimates to produce good execution plans. Despite decades of research, existing cardinality estimators are inaccurate for complex queries, due to making lossy modeling assumptions and not…

Databases · Computer Science 2020-11-04 Zongheng Yang , Amog Kamsetty , Sifei Luan , Eric Liang , Yan Duan , Xi Chen , Ion Stoica

Learned cardinality estimation methods have achieved high precision compared to traditional methods. Among learned methods, query-driven approaches have faced the workload drift problem for a long time. Although both data-driven and hybrid…

Databases · Computer Science 2023-12-04 Kaixin Zhang , Hongzhi Wang , Yabin Lu , Ziqi Li , Chang Shu , Yu Yan , Donghua Yang

Recent work has demonstrated the catastrophic effects of poor cardinality estimates on query processing time. In particular, underestimating query cardinality can result in overly optimistic query plans which take orders of magnitude longer…

Databases · Computer Science 2022-03-31 Kyle Deeds , Dan Suciu , Magda Balazinska , Walter Cai

The cardinality estimation is a key aspect of query optimization research, and its performance has significantly improved with the integration of machine learning. To overcome the "cold start" problem or the lack of model transferability in…

Databases · Computer Science 2025-05-29 Boyang Fang

Accurately detecting super host that establishes connections to a large number of distinct peers is significant for mitigating web attacks and ensuring high quality of web service. Existing sketch-based approaches estimate the number of…

Networking and Internet Architecture · Computer Science 2026-04-06 Yilin Zhao , Jiawei Huang , Xianshi Su , Weihe Li , Xin Li , Yan Liu , Jiacheng Xie , Qichen Su , Jin Ye , Wanchun Jiang , Jianxin Wang

In this work, we address the problem of cardinality estimation for similarity search in high-dimensional spaces. Our goal is to design a framework that is lightweight, easy to construct, and capable of providing accurate estimates with…

Databases · Computer Science 2026-04-07 Zhonghan Chen , Qintian Guo , Ruiyuan Zhang , Xiaofang Zhou