English
Related papers

Related papers: Scardina: Scalable Join Cardinality Estimation by …

200 papers

Co-clustering simultaneously clusters rows and columns, revealing more fine-grained groups. However, existing co-clustering methods suffer from poor scalability and cannot handle large-scale data. This paper presents a novel and scalable…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-03-20 Zihan Wu , Zhaoke Huang , Hong Yan

DB engines produce efficient query execution plans by relying on cost models. Practical implementations estimate cardinality of queries using heuristics, with magic numbers tuned to improve average performance on benchmarks. Empirically,…

The data torrent unleashed by current and upcoming astronomical surveys demands scalable analysis methods. Many machine learning approaches scale well, but separating the instrument measurement from the physical effects of interest, dealing…

Computation · Statistics 2023-04-19 Johannes Buchner

Cardinality estimation (CardEst) is a critical aspect of query optimization. Traditionally, it leverages statistics built directly over the data. However, organizational policies (e.g., regulatory compliance) may restrict global data…

Databases · Computer Science 2025-06-23 Peizhi Wu , Rong Kang , Tieying Zhang , Jianjun Chen , Ryan Marcus , Zachary G. Ives

We present a novel approach for learning to predict sets using deep learning. In recent years, deep neural networks have shown remarkable results in computer vision, natural language processing and other related problems. Despite their…

Computer Vision and Pattern Recognition · Computer Science 2017-11-23 S. Hamid Rezatofighi , Anton Milan , Qinfeng Shi , Anthony Dick , Ian Reid

SQL queries, with the AND, OR, and NOT operators, constitute a broad class of highly used queries. Thus, their cardinality estimation is important for query optimization. In addition, a query planner requires the set-theoretic cardinality…

Databases · Computer Science 2020-04-16 Rojeh Hayek , Oded Shmueli

Cardinality Estimation is to estimate the size of the output of a query without computing it, by using only statistics on the input relations. Existing estimators try to return an unbiased estimate of the cardinality: this is notoriously…

Databases · Computer Science 2024-12-03 Mahmoud Abo Khamis , Kyle Deeds , Dan Olteanu , Dan Suciu

Estimating the cardinality of the output of a query is a fundamental problem in database query processing. In this article, we overview a recently published contribution that casts the cardinality estimation problem as linear optimization…

Databases · Computer Science 2025-05-13 Mahmoud Abo Khamis , Vasileios Nakos , Dan Olteanu , Dan Suciu

We study the problem of discovering joinable datasets at scale. This is, how to automatically discover pairs of attributes in a massive collection of independent, heterogeneous datasets that can be joined. Exact (e.g., based on distinct…

Databases · Computer Science 2020-12-07 Javier Flores , Sergi Nadal , Oscar Romero

Cardinality matching is a computational method for finding the largest possible number of matched pairs of exposed and unexposed individuals from an observational dataset, with specified patterns of baseline characteristics that represent a…

Methodology · Statistics 2022-02-17 Bijan A. Niknam , Jose R. Zubizarreta

We study two classes of summary-based cardinality estimators that use statistics about input relations and small-size joins in the context of graph database management systems: (i) optimistic estimators that make uniformity and conditional…

Databases · Computer Science 2021-05-20 Jeremy Chen , Yuqing Huang , Mushi Wang , Semih Salihoglu , Ken Salem

Cardinality estimation is a fundamental functionality in database systems. Most existing cardinality estimators focus on handling predicates over numeric or categorical data. They have largely omitted an important data type, set-valued…

Databases · Computer Science 2025-03-20 Yufan Sheng , Xin Cao , Kaiqi Zhao , Yixiang Fang , Jianzhong Qi , Wenjie Zhang , Christian S. Jensen

Structured high-cardinality data arises in many domains, and poses a major challenge for both modeling and inference. Graphical models are a popular approach to modeling structured data but they are unsuitable for high-cardinality…

Data Structures and Algorithms · Computer Science 2016-07-19 Branislav Kveton , Hung Bui , Mohammad Ghavamzadeh , Georgios Theocharous , S. Muthukrishnan , Siqi Sun

Cardinality estimation (CardEst) plays a significant role in generating high-quality query plans for a query optimizer in DBMS. In the last decade, an increasing number of advanced CardEst methods (especially ML-based) have been proposed…

Subgraph counting is a fundamental problem in understanding and analyzing graph structured data, yet computationally challenging. This calls for an accurate and efficient algorithm for Subgraph Cardinality Estimation, which is to estimate…

Databases · Computer Science 2024-04-16 Wonseok Shin , Siwoo Song , Kunsoo Park , Wook-Shin Han

In this paper, we apply shrinkage strategies to estimate regression coefficients efficiently for the high-dimensional multiple regression model, where the number of samples is smaller than the number of predictors. We assume in the sparse…

Methodology · Statistics 2017-04-19 B. Yuzbasi , M. Arashi , S. E. Ahmed

We propose a penalized likelihood framework for estimating multiple precision matrices from different classes. Most existing methods either incorporate no information on relationships between the precision matrices, or require this…

Machine Learning · Statistics 2020-03-03 Bradley S. Price , Aaron J. Molstad , Ben Sherwood

This paper considers clustered multi-task compressive sensing, a hierarchical model that solves multiple compressive sensing tasks by finding clusters of tasks that leverage shared information to mutually improve signal reconstruction. The…

Signal Processing · Electrical Eng. & Systems 2023-10-03 Alexander Lin , Demba Ba

The multi-criteria decision making, which is possible with the advent of skyline queries, has been applied in many areas. Though most of the existing research is concerned with only a single relation, several real world applications require…

Databases · Computer Science 2012-06-29 Arnab Bhattacharya , B. Palvali Teja

Recent work has reemphasized the importance of cardinality estimates for query optimization. While new techniques have continuously improved in accuracy over time, they still generally allow for under-estimates which often lead optimizers…

Databases · Computer Science 2022-11-21 Kyle Deeds , Dan Suciu , Magda Balazinska