English
Related papers

Related papers: New Cardinality Estimation Methods for HyperLogLog…

200 papers

We present a novel approach for learning to predict sets using deep learning. In recent years, deep neural networks have shown remarkable results in computer vision, natural language processing and other related problems. Despite their…

Computer Vision and Pattern Recognition · Computer Science 2017-11-23 S. Hamid Rezatofighi , Anton Milan , Qinfeng Shi , Anthony Dick , Ian Reid

Cardinality estimation is a key component of database query optimization. Recent studies have demonstrated that learned cardinality estimation techniques can surpass traditional methods in accuracy. However, a significant barrier to their…

Databases · Computer Science 2025-12-30 Lyu Yi , Weiqi Feng , Yuanbiao Wang , Yuhong Kan

Complex networks often exhibit community structure, with communities corresponding to denser subgraphs in which nodes are closely linked. When modelling systems where interactions extend beyond node pairs to arbitrary numbers of nodes,…

Physics and Society · Physics 2025-10-16 Bianka Kovács , Barnabás Benedek , Gergely Palla

Query optimizers rely on accurate cardinality estimates to produce good execution plans. Despite decades of research, existing cardinality estimators are inaccurate for complex queries, due to making lossy modeling assumptions and not…

Databases · Computer Science 2020-11-04 Zongheng Yang , Amog Kamsetty , Sifei Luan , Eric Liang , Yan Duan , Xi Chen , Ion Stoica

Learned cardinality estimation methods have achieved high precision compared to traditional methods. Among learned methods, query-driven approaches have faced the workload drift problem for a long time. Although both data-driven and hybrid…

Databases · Computer Science 2023-12-04 Kaixin Zhang , Hongzhi Wang , Yabin Lu , Ziqi Li , Chang Shu , Yu Yan , Donghua Yang

Many techniques have been developed for the cardinality estimation problem in data management systems. In this document, we introduce a framework for cardinality estimation of query patterns over property graph databases, which makes it…

Databases · Computer Science 2023-06-14 Wilco van Leeuwen , George Fletcher , Nikolay Yakovets

In recent years, \emph{learned cardinality estimation} has emerged as an alternative to traditional query optimization methods: by training machine learning models over observed query performance, learned cardinality estimation techniques…

Databases · Computer Science 2023-12-05 Peizhi Wu , Ryan Marcus , Zachary G. Ives

Estimating the frequency of items on the high-volume, fast data stream has been extensively studied in many areas, such as database and network measurement. Traditional sketches provide only coarse estimates under strict memory constraints.…

Machine Learning · Computer Science 2026-03-26 Xinyu Yuan , Yan Qiao , Meng Li , Zhenchun Wei , Cuiying Feng , Zonghui Wang , Wenzhi Chen

Recently, Bessa et al. (PODS 2023) showed that sketches based on coordinated weighted sampling theoretically and empirically outperform popular linear sketching methods like Johnson-Lindentrauss projection and CountSketch for the ubiquitous…

Databases · Computer Science 2024-08-23 Majid Daliri , Juliana Freire , Christopher Musco , Aécio Santos , Haoxiang Zhang

We present a novel technique for estimating disk parameters (the centre and the radius) from its 2D image. It is based on the maximal likelihood approach utilising both edge pixels coordinates and the image intensity gradients. We emphasise…

Image and Video Processing · Electrical Eng. & Systems 2020-09-03 Matwey V. Kornilov

We consider distributed optimization methods for problems where forming the Hessian is computationally challenging and communication is a significant bottleneck. We leverage randomized sketches for reducing the problem dimensions as well as…

Optimization and Control · Mathematics 2022-03-21 Burak Bartan , Mert Pilanci

Not only source catalogs are extracted from astronomy observations. Their sky coverage is always carefully recorded and used in statistical analyses, such as correlation and luminosity function studies. Here we present a novel method for…

Instrumentation and Methods for Astrophysics · Physics 2014-03-20 Dongwei Fan , Tamás Budavári , Alexander S. Szalay , Chenzhou Cui , Yongheng Zhao

Mining subgraphs with interesting structural properties from networks (or graphs) is a computationally challenging task. In this paper, we propose two algorithms for enumerating all connected induced subgraphs of a given cardinality from…

Data Structures and Algorithms · Computer Science 2023-03-17 Shanshan Wang , Chenglong Xiao

Cardinality estimation (CardEst) is an essential component in query optimizers and a fundamental problem in DBMS. A desired CardEst method should attain good algorithm performance, be stable to varied data settings, and be friendly to…

Databases · Computer Science 2021-02-03 Ziniu Wu , Amir Shaikhha , Rong Zhu , Kai Zeng , Yuxing Han , Jingren Zhou

Although it has been claimed in two different papers that the maximum cardinality cut problem is polynomial-time solvable for proper interval graphs, both of them turned out to be erroneous. In this paper, we give FPT algorithms for the…

Data Structures and Algorithms · Computer Science 2020-06-09 Arman Boyacı , Tınaz Ekim , Mordechai Shalom

Nonparametric maximum likelihood estimation is intended to infer the unknown density distribution while making as few assumptions as possible. To alleviate the over parameterization in nonparametric data fitting, smoothing assumptions are…

Machine Learning · Statistics 2021-04-21 YunPeng Li , ZhaoHui Ye

Accurate cardinality estimation of substring queries, which are commonly expressed using the SQL LIKE predicate, is crucial for query optimization in database systems. While both rule-based methods and machine learning-based methods have…

Databases · Computer Science 2025-06-02 Yirui Zhan , Wen Nie , Jun Gao

This paper addresses the task of set prediction using deep learning. This is important because the output of many computer vision tasks, including image tagging and object detection, are naturally expressed as sets of entities rather than…

Computer Vision and Pattern Recognition · Computer Science 2017-08-14 S. Hamid Rezatofighi , Vijay Kumar B G , Anton Milan , Ehsan Abbasnejad , Anthony Dick , Ian Reid

Data sketching is a critical tool for distinct counting, enabling multisets to be represented by compact summaries that admit fast cardinality estimates. Because sketches may be merged to summarize multiset unions, they are a basic building…

Data Structures and Algorithms · Computer Science 2023-02-07 Jonathan Hehir , Daniel Ting , Graham Cormode

We present a novel method to significantly speed up cosmological parameter sampling. The method relies on constructing an interpolation of the CMB-log-likelihood based on sparse grids, which is used as a shortcut for the…

Cosmology and Nongalactic Astrophysics · Physics 2015-05-18 Mona Frommert , Dirk Pflueger , Thomas Riller , Martin Reinecke , Hans-Joachim Bungartz , Torsten Ensslin