English
Related papers

Related papers: Cardinality Estimation Meets Good-Turing

200 papers

The cardinality estimation is a key aspect of query optimization research, and its performance has significantly improved with the integration of machine learning. To overcome the "cold start" problem or the lack of model transferability in…

Databases · Computer Science 2025-05-29 Boyang Fang

Starting with a set of weighted items, we want to create a generic sample of a certain size that we can later use to estimate the total weight of arbitrary subsets. For this purpose, we propose priority sampling which tested on Internet…

Data Structures and Algorithms · Computer Science 2007-05-23 Nick Duffield , Carsten Lund , Mikkel Thorup

Efficient sampling from a classical Gibbs distribution is an important computational problem with applications ranging from statistical physics over Monte Carlo and optimization algorithms to machine learning. We introduce a family of…

Quantum Physics · Physics 2021-09-08 Dominik S. Wild , Dries Sels , Hannes Pichler , Cristian Zanoci , Mikhail D. Lukin

Sampling techniques are used in many fields, including design of experiments, image processing, and graphics. The techniques in each field are designed to meet the constraints specific to that field such as uniform coverage of the range of…

Machine Learning · Computer Science 2023-06-08 Chandrika Kamath

Quality assessment algorithms measure the quality of a captured biometric sample. Since the sample quality strongly affects the recognition performance of a biometric system, it is essential to only process samples of sufficient quality and…

Computer Vision and Pattern Recognition · Computer Science 2024-08-22 André Dörsch , Torsten Schlett , Peter Munch , Christian Rathgeb , Christoph Busch

Random sampling is an essential tool in the processing and transmission of data. It is used to summarize data too large to store or manipulate and meet resource constraints on bandwidth or battery power. Estimators that are applied to the…

Databases · Computer Science 2015-03-19 Edith Cohen , Haim Kaplan

Incomplete pairwise comparison matrices offer a natural way of expressing preferences in decision making processes. Although ordinal information is crucial, there is a bias in the literature: cardinal models dominate. Ordinal models usually…

Optimization and Control · Mathematics 2020-12-15 Luca Faramondi , Gabriele Oliva , Sándor Bozóki

In this work, we analyze an efficient sampling-based algorithm for general-purpose reachability analysis, which remains a notoriously challenging problem with applications ranging from neural network verification to safety analysis of…

Systems and Control · Electrical Eng. & Systems 2022-04-15 Thomas Lew , Lucas Janson , Riccardo Bonalli , Marco Pavone

Cardinal scores (numeric ratings) collected from people are well known to suffer from miscalibrations. A popular approach to address this issue is to assume simplistic models of miscalibration (such as linear biases) to de-bias the scores.…

Machine Learning · Statistics 2018-09-14 Jingyan Wang , Nihar B. Shah

Societies often rely on human experts to take a wide variety of decisions affecting their members, from jail-or-release decisions taken by judges and stop-and-frisk decisions taken by police officers to accept-or-reject decisions taken by…

Machine Learning · Statistics 2018-05-29 Isabel Valera , Adish Singla , Manuel Gomez Rodriguez

Eliciting relevance judgments for ranking evaluation is labor-intensive and costly, motivating careful selection of which documents to judge. Unlike traditional approaches that make this selection deterministically, probabilistic sampling…

Information Retrieval · Computer Science 2016-04-26 Tobias Schnabel , Adith Swaminathan , Peter Frazier , Thorsten Joachims

In this paper we introduce a new sampling algorithm which has the potential to be adopted as a universal replacement to the Metropolis--Hastings algorithm. It is related to the slice sampler, and motivated by an algorithm which is…

Computation · Statistics 2020-10-19 Yanxin Li , Stephen G. Walker

Consider $K$ processes, each generating a sequence of identical and independent random variables. The probability measures of these processes have random parameters that must be estimated. Specifically, they share a parameter $\theta$…

Machine Learning · Computer Science 2022-10-12 Arpan Mukherjee , Ali Tajer , Pin-Yu Chen , Payel Das

Sampling is often a necessary evil to reduce the processing and storage costs of distributed tracing. In this work, we describe a scalable and adaptive sampling approach that can preserve events of interest better than the widely used…

Data Structures and Algorithms · Computer Science 2021-07-19 Otmar Ertl

In the fields of big data, AI, and streaming processing, we work with large amounts of data from multiple sources. Due to memory and network limitations, we process data streams on distributed systems to alleviate computational and network…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-06-18 József Dániel Gáspár , Martin Horváth , Győző Horváth , Zoltán Zvara

We study two classes of summary-based cardinality estimators that use statistics about input relations and small-size joins in the context of graph database management systems: (i) optimistic estimators that make uniformity and conditional…

Databases · Computer Science 2021-05-20 Jeremy Chen , Yuqing Huang , Mushi Wang , Semih Salihoglu , Ken Salem

When partitioning workflows in realistic scenarios, the knowledge of the processing units is often vague or unknown. A naive approach to addressing this issue is to perform many controlled experiments for different workloads, each…

Distributed, Parallel, and Cluster Computing · Computer Science 2015-11-03 Freddy C. Chua , Bernardo A. Huberman

Variational quantum circuits characterise the state of a quantum system through the use of parameters that are optimised using classical optimisation procedures that typically rely on gradient information. The circuit-execution complexity…

Quantum Physics · Physics 2023-07-28 Sayantan Pramanik , Chaitanya Murti , M Girish Chandra

Interest in the random-order model (ROM) leads us to initiate a study of utilizing random-order arrivals to extract random bits with the goal of derandomizing algorithms. Besides producing simple algorithms, simulating random bits through…

Data Structures and Algorithms · Computer Science 2026-03-27 Allan Borodin , Christodoulos Karavasilis , David Zhang

In the online bipartite matching with reassignments problem, an algorithm is initially given only one side of the vertex set of a bipartite graph; the vertices on the other side are revealed to the algorithm one by one, along with its…

Data Structures and Algorithms · Computer Science 2020-03-12 Yongho Shin , Kangsan Kim , Seungmin Lee , Hyung-Chan An