English
Related papers

Related papers: Deep Unsupervised Cardinality Estimation

200 papers

We study the high-dimensional linear regression problem with categorical predictors that have many levels. We propose a new estimation approach, which performs model compression via two mechanisms by simultaneously encouraging (a)…

Methodology · Statistics 2026-03-30 Kayhan Behdin , Riade Benbaki , Peter Radchenko , Rahul Mazumder

Recent progress in deep latent variable models has largely been driven by the development of flexible and scalable variational inference methods. Variational training of this type involves maximizing a lower bound on the log-likelihood,…

Machine Learning · Computer Science 2016-06-02 Andriy Mnih , Danilo J. Rezende

Deep learning models struggle with uncertainty estimation. Many approaches are either computationally infeasible or underestimate uncertainty. We investigate \textit{BatchEnsemble} as a general and scalable method for uncertainty estimation…

Machine Learning · Computer Science 2026-01-30 Morten Blørstad , Herman Jangsett Mostein , Nello Blaser , Pekka Parviainen

This work presents new cardinality estimation methods for data sets recorded by HyperLogLog sketches. A simple derivation of the original estimator was found, that also gives insight how to correct its deficiencies. The result is an…

Data Structures and Algorithms · Computer Science 2017-06-23 Otmar Ertl

Approximate Thompson sampling with Langevin Monte Carlo broadens its reach from Gaussian posterior sampling to encompass more general smooth posteriors. However, it still encounters scalability issues in high-dimensional problems when…

Machine Learning · Statistics 2024-06-24 Haoyang Zheng , Wei Deng , Christian Moya , Guang Lin

We develop a theoretical framework for studying numerical estimation of lower previsions, generally applicable to two-level Monte Carlo methods, importance sampling methods, and a wide range of other sampling methods one might devise. We…

Computation · Statistics 2018-07-12 Matthias C. M. Troffaes

We introduce a novel framework for efficient sampling from complex, unnormalised target distributions by exploiting multiscale dynamics. Traditional score-based sampling methods either rely on learned approximations of the score function or…

Computation · Statistics 2025-11-04 Paula Cordero-Encinar , Andrew B. Duncan , Sebastian Reich , O. Deniz Akyildiz

A key design constraint when implementing Monte Carlo and variational inference algorithms is that it must be possible to cheaply and exactly evaluate the marginal densities of proposal distributions and variational families. This takes…

Machine Learning · Computer Science 2022-11-22 Alexander K. Lew , Marco Cusumano-Towner , Vikash K. Mansinghka

Reflected diffusions in polyhedral domains are commonly used as approximate models for stochastic processing networks in heavy traffic. Stationary distributions of such models give useful information on the steady state performance of the…

Probability · Mathematics 2012-05-24 Amarjit Budhiraja , Jiang Chen , Sylvain Rubenthaler

Inspired by the latest developments in multilevel Monte Carlo (MLMC) methods and randomised sketching for linear algebra problems we propose a MLMC estimator for real-time processing of matrix structured random data. Our algorithm is…

Numerical Analysis · Mathematics 2020-04-30 Yue Wu , Nick Polydorides

We describe an embarrassingly parallel, anytime Monte Carlo method for likelihood-free models. The algorithm starts with the view that the stochasticity of the pseudo-samples generated by the simulator can be controlled externally by a…

Machine Learning · Computer Science 2015-12-03 Edward Meeds , Max Welling

It is desirable to have accurate uncertainty estimation from a single deterministic forward-pass model, as traditional methods for uncertainty quantification are computationally expensive. However, this is difficult because single…

Machine Learning · Computer Science 2023-08-22 Frederik Boe Hüttel , Filipe Rodrigues , Francisco Câmara Pereira

Diffusion models (DMs) have proven to be effective in modeling high-dimensional distributions, leading to their widespread adoption for representing complex priors in Bayesian inverse problems (BIPs). However, current DM-based posterior…

Machine Learning · Computer Science 2025-06-06 Haoxuan Chen , Yinuo Ren , Martin Renqiang Min , Lexing Ying , Zachary Izzo

For real symmetric matrices that are accessible only through matrix vector products, we present Monte Carlo estimators for computing the diagonal elements. Our probabilistic bounds for normwise absolute and relative errors apply to Monte…

Numerical Analysis · Mathematics 2022-03-18 Eric Hallman , Ilse C. F. Ipsen , Arvind Saibaba

The paper proposes a Riemannian Manifold Hamiltonian Monte Carlo sampler to resolve the shortcomings of existing Monte Carlo algorithms when sampling from target densities that may be high dimensional and exhibit strong correlations. The…

Computation · Statistics 2019-12-18 Mark Girolami , Ben Calderhead , Siu A. Chin

We evaluate two different methods for the integration of prediction uncertainty into diagnostic image classifiers to increase patient safety in deep learning. In the first method, Monte Carlo sampling is applied with dropout at test time to…

Image and Video Processing · Electrical Eng. & Systems 2019-08-05 Max-Heinrich Laves , Sontje Ihler , Tobias Ortmaier

Accurate simulation of complex physical systems enables the development, testing, and certification of control strategies before they are deployed into the real systems. As simulators become more advanced, the analytical tractability of the…

Robotics · Computer Science 2020-05-27 Lucas Barcelos , Rafael Oliveira , Rafael Possas , Lionel Ott , Fabio Ramos

This paper proposes a fast two-stage variational Bayesian (VB) algorithm to estimate unrestricted panel spatial autoregressive models. Using Dirichlet-Laplace priors, we are able to uncover the spatial relationships between cross-sectional…

Econometrics · Economics 2023-08-23 Deborah Gefang , Stephen G. Hall , George S. Tavlas

We consider the use of deep learning for covariance estimation. We propose to globally learn a neural network that will then be applied locally at inference time. Leveraging recent advancements in self-supervised foundational models, we…

Signal Processing · Electrical Eng. & Systems 2024-03-14 Tzvi Diskin , Ami Wiesel

Diffusion models have shown remarkable empirical success in sampling from rich multi-modal distributions. Their inference relies on numerically solving a certain differential equation. This differential equation cannot be solved in closed…

Machine Learning · Computer Science 2026-01-16 Khashayar Gatmiry , Sitan Chen , Adil Salim