English
Related papers

Related papers: Deep Unsupervised Cardinality Estimation

200 papers

We propose to use deep neural networks for generating samples in Monte Carlo integration. Our work is based on non-linear independent components estimation (NICE), which we extend in numerous ways to improve performance and enable its…

Machine Learning · Computer Science 2019-09-04 Thomas Müller , Brian McWilliams , Fabrice Rousselle , Markus Gross , Jan Novák

Hamiltonian Monte Carlo has emerged as a standard tool for posterior computation. In this article, we present an extension that can efficiently explore target distributions with discontinuous densities. Our extension in particular enables…

Computation · Statistics 2020-06-09 Akihiko Nishimura , David Dunson , Jianfeng Lu

Modern Cardinality Estimators struggle with data updates. This research tackles this challenge within single-table. We introduce ICE, an Index-based Cardinality Estimator, the first data-driven estimator that enables instant, tuple-leveled…

Databases · Computer Science 2024-09-02 Yingze Li , Xianglong Liu , Hongzhi Wang , Kaixin Zhang , Zixuan Wang

In variational inference, the benefits of Bayesian models rely on accurately capturing the true posterior distribution. We propose using neural samplers that specify implicit distributions, which are well-suited for approximating complex…

Machine Learning · Computer Science 2023-11-10 Anshuk Uppal , Kristoffer Stensbo-Smidt , Wouter Boomsma , Jes Frellsen

We study two classes of summary-based cardinality estimators that use statistics about input relations and small-size joins in the context of graph database management systems: (i) optimistic estimators that make uniformity and conditional…

Databases · Computer Science 2021-05-20 Jeremy Chen , Yuqing Huang , Mushi Wang , Semih Salihoglu , Ken Salem

Monte Carlo integration is a commonly used technique to compute intractable integrals and is typically thought to perform poorly for very high-dimensional integrals. To show that this is not always the case, we examine Monte Carlo…

Methodology · Statistics 2023-05-26 Yanbo Tang

The Neural Autoregressive Distribution Estimator (NADE) and its real-valued version RNADE are competitive density models of multidimensional data across a variety of domains. These models use a fixed, arbitrary ordering of the data…

Machine Learning · Statistics 2014-01-14 Benigno Uria , Iain Murray , Hugo Larochelle

We describe a new deep learning approach to cardinality estimation. MSCN is a multi-set convolutional network, tailored to representing relational query plans, that employs set semantics to capture query features and true cardinalities.…

Databases · Computer Science 2018-12-19 Andreas Kipf , Thomas Kipf , Bernhard Radke , Viktor Leis , Peter Boncz , Alfons Kemper

Multifidelity Monte Carlo methods rely on a hierarchy of possibly less accurate but statistically correlated simplified or reduced models, in order to accelerate the estimation of statistics of high-fidelity models without compromising the…

Numerical Analysis · Mathematics 2020-10-29 Alessio Quaglino , Simone Pezzuto , Rolf Krause

This paper describes how to specify probability models for data analysis via a backward induction procedure. The new approach yields coherent, prior-free uncertainty assessment. After presenting some intuition-building examples, the new…

Methodology · Statistics 2015-02-24 P. Richard Hahn

Selectivity estimation - the problem of estimating the result size of queries - is a fundamental problem in databases. Accurate estimation of query selectivity involving multiple correlated attributes is especially challenging. Poor…

Databases · Computer Science 2019-06-19 Shohedul Hasan , Saravanan Thirumuruganathan , Jees Augustine , Nick Koudas , Gautam Das

Discrete diffusion models are a class of generative models that produce samples from an approximated data distribution within a discrete state space. Often, there is a need to target specific regions of the data distribution. Current…

Machine Learning · Computer Science 2025-09-03 Cheuk Kit Lee , Paul Jeha , Jes Frellsen , Pietro Lio , Michael Samuel Albergo , Francisco Vargas

We propose an adaptive importance sampling scheme for Gaussian approximations of intractable posteriors. Optimization-based approximations like variational inference can be too inaccurate while existing Monte Carlo methods can be too slow.…

Computation · Statistics 2025-02-04 Willem van den Boom , Andrea Cremaschi , Alexandre H. Thiery

Cardinality estimation algorithms receive a stream of elements whose order might be arbitrary, with possible repetitions, and return the number of distinct elements. Such algorithms usually seek to minimize the required storage and…

Data Structures and Algorithms · Computer Science 2015-08-26 Reuven Cohen , Liran Katzir , Aviv Yehezkel

Recent work has reemphasized the importance of cardinality estimates for query optimization. While new techniques have continuously improved in accuracy over time, they still generally allow for under-estimates which often lead optimizers…

Databases · Computer Science 2022-11-21 Kyle Deeds , Dan Suciu , Magda Balazinska

Multilevel sampling methods, such as multilevel and multifidelity Monte Carlo, multilevel stochastic collocation, or delayed acceptance Markov chain Monte Carlo, have become standard uncertainty quantification (UQ) tools for a wide class of…

Numerical Analysis · Mathematics 2025-10-01 Josef Martínek , Erin Carson , Robert Scheichl

To sample from a general target distribution $p_*\propto e^{-f_*}$ beyond the isoperimetric condition, Huang et al. (2023) proposed to perform sampling through reverse diffusion, giving rise to Diffusion-based Monte Carlo (DMC).…

Machine Learning · Statistics 2024-01-15 Xunpeng Huang , Difan Zou , Hanze Dong , Yian Ma , Tong Zhang

Autoregressive models are often employed to learn distributions of image data by decomposing the $D$-dimensional density function into a product of one-dimensional conditional distributions. Each conditional depends on preceding variables…

Image and Video Processing · Electrical Eng. & Systems 2025-07-08 Ambrose Emmett-Iwaniw , Nathan Kirk

Estimation of density derivatives is a versatile tool in statistical data analysis. A naive approach is to first estimate the density and then compute its derivative. However, such a two-step approach does not work well because a good…

Machine Learning · Statistics 2014-07-01 Hiroaki Sasaki , Yung-Kyun Noh , Masashi Sugiyama

Score based approaches to sampling have shown much success as a generative algorithm to produce new samples from a target density given a pool of initial samples. In this work, we consider if we have no initial samples from the target…

Machine Learning · Statistics 2022-12-08 Curtis McDonald , Andrew Barron