English
Related papers

Related papers: Cardinality Estimation in DBMS: A Comprehensive Be…

200 papers

Cost and cardinality estimation is vital to query optimizer, which can guide the plan selection. However traditional empirical cost and cardinality estimation techniques cannot provide high-quality estimation, because they cannot capture…

Databases · Computer Science 2019-06-07 Ji Sun , Guoliang Li

Recent advances in probabilistic modelling have led to a large number of simulation-based inference algorithms which do not require numerical evaluation of likelihoods. However, a public benchmark with appropriate performance metrics for…

Machine Learning · Statistics 2021-04-12 Jan-Matthis Lueckmann , Jan Boelts , David S. Greenberg , Pedro J. Gonçalves , Jakob H. Macke

Finding a good query plan is key to the optimization of query runtime. This holds in particular for cost-based federation engines, which make use of cardinality estimations to achieve this goal. A number of studies compare SPARQL federation…

Databases · Computer Science 2021-04-05 Umair Qudus , Muhammad Saleem , Axel-Cyrille Ngonga Ngomo , Young-koo Lee

Selectivity estimation is important in query optimization, however accurate estimation is difficult when predicates are complex. Instead of existing database synopses and statistics not helpful for such cases, we introduce a new approach to…

Databases · Computer Science 2018-06-25 Jun Hyung Shin

Cost-based query optimization remains a critical task in relational databases even after decades of research and industrial development. Query optimizers rely on a large range of statistical synopses -- including attribute-level histograms…

Databases · Computer Science 2021-02-05 Yesdaulet Izenov , Asoke Datta , Florin Rusu , Jun Hyung Shin

High-dimensional data has become ubiquitous across the sciences but presents computational and statistical challenges. A common approach to addressing these challenges is through sparsity. In this paper, we introduce a new concept of…

Statistics Theory · Mathematics 2025-09-03 Ali Mohades , Johannes Lederer

The integration of contextual information has significantly enhanced the performance of large language models (LLMs) on knowledge-intensive tasks. However, existing methods often overlook a critical challenge: the credibility of context…

Computation and Language · Computer Science 2025-06-19 Dyah Adila , Shuai Zhang , Boran Han , Bonan Min , Yuyang Wang

The amount of data coming from different sources such as IoT-sensors, social networks, cellular networks, has increased exponentially during the last few years. Probabilistic Data Structures (PDS) are efficient alternatives to deterministic…

Data Structures and Algorithms · Computer Science 2022-11-02 Remy Scholler , Jean-Francois Couchot , Oumaima Alaoui-Ismaili , Denis Renaud , Eric Ballot

Most recently, researchers have started building large language models (LLMs) powered data systems that allow users to analyze unstructured text documents like working with a database because LLMs are very effective in extracting attributes…

Databases · Computer Science 2025-07-14 Zhaoze Sun , Qiyan Deng , Chengliang Chai , Kaisen Jin , Xinyu Guo , Han Han , Ye Yuan , Guoren Wang , Lei Cao

Deep learning methods have reached state-of-the-art performance in cardiac image segmentation. Currently, the main bottleneck towards their effective translation into clinics requires assuring continuous high model performance and…

Image and Video Processing · Electrical Eng. & Systems 2021-06-15 Francesco Galati , Maria A. Zuluaga

Deep Learning (DL) has achieved great success in many real applications. Despite its success, there are some main problems when deploying advanced DL models in database systems, such as hyper-parameters tuning, the risk of overfitting, and…

Databases · Computer Science 2021-07-20 Kangfei Zhao , Jeffrey Xu Yu , Zongyan He , Hao Zhang

Models such as finite state automata are widely used to abstract the behavior of software systems by capturing the sequences of events observable during their execution. Nevertheless, models rarely exist in practice and, when they do, get…

Software Engineering · Computer Science 2024-08-20 Donato Clun , Donghwan Shin , Antonio Filieri , Domenico Bianculli

We introduce Deep Sketches, which are compact models of databases that allow us to estimate the result sizes of SQL queries. Deep Sketches are powered by a new deep learning approach to cardinality estimation that can capture correlations…

This work presents new cardinality estimation methods for data sets recorded by HyperLogLog sketches. A simple derivation of the original estimator was found, that also gives insight how to correct its deficiencies. The result is an…

Data Structures and Algorithms · Computer Science 2017-06-23 Otmar Ertl

Data efficiency, despite being an attractive characteristic, is often challenging to measure and optimize for in task-oriented semantic parsing; unlike exact match, it can require both model- and domain-specific setups, which have,…

Computation and Language · Computer Science 2021-07-13 Shrey Desai , Akshat Shrivastava , Justin Rill , Brian Moran , Safiyyah Saleem , Alexander Zotov , Ahmed Aly

Graph pattern cardinality estimation is the problem of estimating the number of embeddings of a query graph in a data graph. This fundamental problem arises, for example, during query planning in subgraph matching algorithms. There are two…

Databases · Computer Science 2021-03-29 Kyoungmin Kim , Hyeonji Kim , George Fletcher , Wook-Shin Han

Large language models (LLMs) have demonstrated remarkable capabilities across diverse domains, but their heavy resource demands make quantization-reducing precision to lower-bit formats-critical for efficient serving. While many…

Performance · Computer Science 2025-08-26 Tianyao Shi , Yi Ding

Despite decades of research, cardinality estimation remains the optimizer's Achilles heel, with industrial-strength systems exhibiting a systemic tendency toward underestimation. At cloud scale, this is a severe production vulnerability: in…

Databases · Computer Science 2026-03-06 Mihail Stoian , Tiemo Bang , Hangdong Zhao , Jesús Camacho-Rodríguez , Yuanyuan Tian , Andreas Kipf

The ability to estimate resource consumption of SQL queries is crucial for a number of tasks in a database system such as admission control, query scheduling and costing during query optimization. Recent work has explored the use of…

Databases · Computer Science 2012-08-02 Jiexing Li , Arnd Christian König , Vivek Narasayya , Surajit Chaudhuri

We present a detailed study of cardinality-aware top-$k$ classification, a novel approach that aims to learn an accurate top-$k$ set predictor while maintaining a low cardinality. We introduce a new target loss function tailored to this…

Machine Learning · Computer Science 2024-07-12 Corinna Cortes , Anqi Mao , Christopher Mohri , Mehryar Mohri , Yutao Zhong