English
Related papers

Related papers: FLAT: Fast, Lightweight and Accurate Method for Ca…

200 papers

Estimating cardinality, i.e., the number of distinct elements, of a data stream is a fundamental problem in areas like databases, computer networks, and information retrieval. This study delves into a broader scenario where each element…

Databases · Computer Science 2024-06-28 Yiyan Qi , Rundong Li , Pinghui Wang , Yufang Sun , Rui Xing

Learned cardinality estimation methods have achieved high precision compared to traditional methods. Among learned methods, query-driven approaches have faced the workload drift problem for a long time. Although both data-driven and hybrid…

Databases · Computer Science 2023-12-04 Kaixin Zhang , Hongzhi Wang , Yabin Lu , Ziqi Li , Chang Shu , Yu Yan , Donghua Yang

Cardinality estimation remains a fundamental challenge in query optimization, often resulting in sub-optimal execution plans and degraded performance. While errors in cardinality estimation are inevitable, existing methods for identifying…

Databases · Computer Science 2025-01-29 Asoke Datta , Yesdaulet Izenov , Brian Tsan , Abylay Amanbayev , Florin Rusu

The cardinality estimation is a key aspect of query optimization research, and its performance has significantly improved with the integration of machine learning. To overcome the "cold start" problem or the lack of model transferability in…

Databases · Computer Science 2025-05-29 Boyang Fang

Cardinality potentials are a generally useful class of high order potential that affect probabilities based on how many of D binary variables are active. Maximum a posteriori (MAP) inference for cardinality potential models is…

Machine Learning · Computer Science 2012-10-19 Daniel Tarlow , Kevin Swersky , Richard S. Zemel , Ryan Prescott Adams , Brendan J. Frey

The Gaussian graphical model (GGM) incorporates an undirected graph to represent the conditional dependence between variables, with the precision matrix encoding partial correlation between pair of variables given the others. To achieve…

Methodology · Statistics 2023-07-03 Yueqi Qian , Xianghong Hu , Can Yang

Research on learned cardinality estimation has made significant progress in recent years. However, existing methods still face distinct challenges that hinder their practical deployment in production environments. We define these challenges…

Databases · Computer Science 2025-09-10 Kaixin Zhang , Hongzhi Wang , Ziqi Li , Yabin Lu , Yingze Li , Yu Yan , Yiming Guan

Cardinality estimation is a fundamental functionality in database systems. Most existing cardinality estimators focus on handling predicates over numeric or categorical data. They have largely omitted an important data type, set-valued…

Databases · Computer Science 2025-03-20 Yufan Sheng , Xin Cao , Kaiqi Zhao , Yixiang Fang , Jianzhong Qi , Wenjie Zhang , Christian S. Jensen

The success of Constraint Programming relies partly on the global constraints and implementation of the associated filtering algorithms. Recently, new ideas emerged to improve these implementations in practice, especially regarding the all…

Artificial Intelligence · Computer Science 2025-02-06 Margaux Schmied , Jean-Charles Regin

Due to the vast testing space, the increasing demand for effective and efficient testing of deep neural networks (DNNs) has led to the development of various DNN test case prioritization techniques. However, the fact that DNNs can deliver…

Software Engineering · Computer Science 2024-09-17 Jialuo Chen , Jingyi Wang , Xiyue Zhang , Youcheng Sun , Marta Kwiatkowska , Jiming Chen , Peng Cheng

Factor Analysis (FA) is a technique of fundamental importance that is widely used in classical and modern multivariate statistics, psychometrics and econometrics. In this paper, we revisit the classical rank-constrained FA problem, which…

Methodology · Statistics 2017-04-25 Dimitris Bertsimas , Martin S. Copenhaver , Rahul Mazumder

Modern data science relies on data analytic pipelines to organize interdependent computational steps. Such analytic pipelines often involve different algorithms across multiple steps, each with its own hyperparameters. To achieve the best…

Machine Learning · Computer Science 2016-06-27 Yuyu Zhang , Mohammad Taha Bahadori , Hang Su , Jimeng Sun

Previous approaches to learned cardinality estimation have focused on improving average estimation error, but not all estimates matter equally. Since learned models inevitably make mistakes, the goal should be to improve the estimates that…

Databases · Computer Science 2021-01-14 Parimarjan Negi , Ryan Marcus , Andreas Kipf , Hongzi Mao , Nesime Tatbul , Tim Kraska , Mohammad Alizadeh

In many existing methods in multiple comparison, one starts with either Fisher's p-values or the local fdr scores. The former one, with a usual definition as the tail probability exceeding the observed test statistic under the null…

Methodology · Statistics 2021-04-13 Zhigen Zhao

Despite the prevalence of tabular datasets, few-shot learning remains under-explored within this domain. Existing few-shot methods are not directly applicable to tabular datasets due to varying column relationships, meanings, and…

Machine Learning · Computer Science 2023-11-17 Max Zhu , Katarzyna Kobalczyk , Andrija Petrovic , Mladen Nikolic , Mihaela van der Schaar , Boris Delibasic , Petro Lio

Cardinality estimation and conjunctive query evaluation are two of the most fundamental problems in database query processing. Recent work proposed, studied, and implemented a robust and practical information-theoretic cardinality…

Databases · Computer Science 2025-04-04 Sungjin Im , Benjamin Moseley , Hung Q. Ngo , Kirk Pruhs

We propose a novel approach for optimizing the graph ratio-cut by modeling the binary assignments as random variables. We provide an upper bound on the expected ratio-cut, as well as an unbiased estimate of its gradient, to learn the…

Machine Learning · Computer Science 2025-03-12 Ayoub Ghriss , Claire Monteleoni

We propose a new splitting and successively solving augmented Lagrangian (SSAL) method for solving an optimization problem with both semicontinuous variables and a cardinality constraint. This optimization problem arises in several contexts…

Optimization and Control · Mathematics 2015-06-16 Yanqin Bai , Renli Liang , Zhouwang Yang

Subgraph matching is a basic operation widely used in many applications. However, due to its NP-hardness and the explosive growth of graph data, it is challenging to compute subgraph matching, especially in large graphs. In this paper, we…

Databases · Computer Science 2021-02-25 Xin Jin , Zhengyi Yang , Xuemin Lin , Shiyu Yang , Lu Qin , You Peng

Cardinality estimation is a fundamental but long unresolved problem in query optimization. Recently, multiple papers from different research groups consistently report that learned models have the potential to replace existing cardinality…

Databases · Computer Science 2021-08-12 Xiaoying Wang , Changbo Qu , Weiyuan Wu , Jiannan Wang , Qingqing Zhou