English
Related papers

Related papers: Cardinality Estimation Meets Good-Turing

200 papers

Thompson sampling has emerged as an effective heuristic for a broad range of online decision problems. In its basic form, the algorithm requires computing and sampling from a posterior distribution over models, which is tractable only for…

Machine Learning · Statistics 2023-04-26 Xiuyuan Lu , Benjamin Van Roy

In this paper we address cardinality estimation problem which is an important subproblem in query optimization. Query optimization is a part of every relational DBMS responsible for finding the best way of the execution for the given query.…

Databases · Computer Science 2017-11-23 Oleg Ivanov , Sergey Bartunov

Approximate inference in dynamic systems is the problem of estimating the state of the system given a sequence of actions and partial observations. High precision estimation is fundamental in many applications like diagnosis, natural…

Artificial Intelligence · Computer Science 2012-06-18 Hannaneh Hajishirzi , Eyal Amir

Online monitoring user cardinalities (or degrees) in graph streams is fundamental for many applications. For example in a bipartite graph representing user-website visiting activities, user cardinalities (the number of distinct visited…

Data Structures and Algorithms · Computer Science 2018-11-27 Pinghui Wang , Peng Jia , Xiangliang Zhang , Jing Tao , Xiaohong Guan , Don Towsley

Cardinality estimation is a fundamental task in database management systems, aiming to predict query results accurately without executing the queries. However, existing techniques either achieve low estimation accuracy or incur high…

Databases · Computer Science 2025-08-14 Yaoyu Zhu , Jintao Zhang , Guoliang Li , Jianhua Feng

Despite of decades of work, query optimizers still make mistakes on "difficult" queries because of bad cardinality estimates, often due to the interaction of multiple predicates and correlations in the data. In this paper, we propose a…

Databases · Computer Science 2016-01-22 Wentao Wu , Jeffrey F. Naughton , Harneet Singh

The era of huge data necessitates highly efficient machine learning algorithms. Many common machine learning algorithms, however, rely on computationally intensive subroutines that are prohibitively expensive on large datasets. Oftentimes,…

Machine Learning · Computer Science 2023-09-26 Mo Tiwari

This paper presents a novel algorithm solving the classic problem of generating a random sample of size s from population of size n with non-uniform probabilities. The sampling is done with replacement. The algorithm requires constant…

Data Structures and Algorithms · Computer Science 2016-11-03 Michał Startek

We consider ordinal online problems, i.e., tasks that only require pairwise comparisons between elements of the input. A classic example is the secretary problem and the game of googol, as well as its multiple combinatorial extensions such…

Data Structures and Algorithms · Computer Science 2023-10-13 Nick Gravin , Enze Sun , Zhihao Gavin Tang

Cardinality estimation is the task of approximating the number of distinct elements in a large dataset with possibly repeating elements. LogLog and HyperLogLog (c.f. Durand and Flajolet [ESA 2003], Flajolet et al. [Discrete Math Theor.…

Data Structures and Algorithms · Computer Science 2020-08-19 Aleksander Łukasiewicz , Przemysław Uznański

Given $m$ distributed data streams $A_1, \dots, A_m$, we consider the problem of estimating the number of unique identifiers in streams defined by set expressions over $A_1, \dots, A_m$. We identify a broad class of algorithms for solving…

Data Structures and Algorithms · Computer Science 2016-02-25 Anirban Dasgupta , Kevin Lang , Lee Rhodes , Justin Thaler

Many techniques have been developed for the cardinality estimation problem in data management systems. In this document, we introduce a framework for cardinality estimation of query patterns over property graph databases, which makes it…

Databases · Computer Science 2023-06-14 Wilco van Leeuwen , George Fletcher , Nikolay Yakovets

We introduce and study randomized sequential importance sampling algorithms for estimating the number of perfect matchings in bipartite graphs. In analyzing their performance, we establish various non-standard central limit theorems. We…

Probability · Mathematics 2025-11-18 Persi Diaconis , Brett Kolesnik

Consider a fixed universe of $N=2^n$ elements and the uniform distribution over elements of some subset of size $K$. Given samples from this distribution, the task of complement sampling is to provide a sample from the complementary subset.…

Quantum Physics · Physics 2026-02-02 Marcello Benedetti , Harry Buhrman , Jordi Weggemans

Graphs are used in many disciplines to model the relationships that exist between objects in a complex discrete system. Researchers may wish to compare a network of interest to a "typical" graph from a family (or ensemble) of graphs which…

Combinatorics · Mathematics 2025-08-08 Catherine Greenhill

Graph sampling allows mining a small representative subgraph from a big graph. Sampling algorithms deploy different strategies to replicate the properties of a given graph in the sampled graph. In this study, we provide a comprehensive…

Social and Information Networks · Computer Science 2021-02-17 Muhammad Irfan Yousuf , Izza Anwer , Raheel Anwar

Driven by applications in telecommunication networks, we explore the simulation task of estimating rare event probabilities for tandem queues in their steady state. Existing literature has recognized that importance sampling methods can be…

Machine Learning · Computer Science 2025-04-22 Ruoning Zhao , Xinyun Chen

Sampling without replacement is a natural online rounding strategy for converting fractional bipartite matching into an integral one. In Online Bipartite Matching, we can use the Balance algorithm to fractionally match each online vertex,…

Data Structures and Algorithms · Computer Science 2024-10-10 Zhiyi Huang , Chui Shan Lee , Jianqiao Lu , Xinkai Shu

Estimating the cardinality (i.e., the number of answers) of conjunctive queries is particularly difficult in RDF systems: queries over RDF data are navigational and thus tend to involve many joins. We present a new, principled cardinality…

Databases · Computer Science 2018-02-19 Giorgio Stefanoni , Boris Motik , Egor V. Kostylev

We describe an algorithm for using a quantum computer to calculate mean values of observables and the partition function of a quantum system. Our algorithm includes two sub-algorithms. The first sub-algorithm is for calculating, with…

Quantum Physics · Physics 2010-11-10 Robert R. Tucci