English
Related papers

Related papers: Is the NUTS algorithm correct?

200 papers

This work is driven by the ubiquitous dissent over the abilities and contributions of the Metropolis-Hastings and reversible jump algorithm within the context of trans dimensional sampling. We demystify this topic by taking a deeper look…

Statistics Theory · Mathematics 2019-08-05 Tobias Siems , Lisa Koeppel

Hamiltonian Monte-Carlo (HMC) and its auto-tuned variant, the No U-Turn Sampler (NUTS) can struggle to accurately sample distributions with complex geometries, e.g., varying curvature, due to their constant step size for leapfrog…

Computation · Statistics 2024-10-30 Chirag Modi

We assess the usefulness of gradient-based samplers, such as the No-U-Turn Sampler (NUTS), by comparison with traditional Metropolis-Hastings algorithms, in tomographic $3 \times 2$ point analyses. Specifically, we use the DES Year 1 data…

Instrumentation and Methods for Astrophysics · Physics 2024-06-10 Arrykrishna Mootoovaloo , Jaime Ruiz-Zapatero , Carlos García-García , David Alonso

Achieving robust uncertainty quantification for deep neural networks represents an important requirement in many real-world applications of deep learning such as medical imaging where it is necessary to assess the reliability of a neural…

Machine Learning · Computer Science 2024-03-15 Tim Rensmeyer , Oliver Niggemann

arXiv:2206.10812v1 [stat.ME] proposes a useful algorithm, named generalized Diversity Subsampling (g-DS) algorithm, to select a subsample following some target probability distribution from a finite data set and demonstrates its…

Methodology · Statistics 2023-09-06 Boyang Shang

We revisit skip-gram negative sampling (SGNS), one of the most popular neural-network based approaches to learning distributed word representation. We first point out the ambiguity issue undermining the SGNS model, in the sense that the…

Computation and Language · Computer Science 2019-01-15 Cun Mu , Guang Yang , Zheng Yan

The Newton method is a powerful optimization algorithm, valued for its rapid local convergence and elegant geometric properties. However, its theoretical guarantees are usually limited to convex problems. In this work, we ask whether…

Optimization and Control · Mathematics 2025-10-01 Alexander Shestakov , Sushil Bohara , Samuel Horváth , Martin Takáč , Slavomír Hanzely

This paper studies probabilistic rates of convergence for consensus+innovations type of algorithms in random, generic networks. For each node, we find a lower and also a family of upper bounds on the large deviations rate function, thus…

Information Theory · Computer Science 2022-08-11 Dragana Bajovic

Analysts routinely use Bayesian hierarchical models to understand natural processes. The no-U-turn sampler (NUTS) is the most widely used algorithm to sample high-dimensional, continuously differentiable models. But NUTS is slowed by high…

Computation · Statistics 2026-03-04 Cole C. Monnahan , Kasper Kristensen , James T. Thorson , Bob Carpenter

The Gibbs sampler is one of the most popular algorithms for inference in statistical models. In this paper, we introduce a herding variant of this algorithm, called herded Gibbs, that is entirely deterministic. We prove that herded Gibbs…

Machine Learning · Computer Science 2013-03-19 Luke Bornn , Yutian Chen , Nando de Freitas , Mareija Eskelin , Jing Fang , Max Welling

As a problem in data science the inverse Ising (or Potts) problem is to infer the parameters of a Gibbs-Boltzmann distributions of an Ising (or Potts) model from samples drawn from that distribution. The algorithmic and computational…

Other Statistics · Statistics 2020-02-14 Hong-Li Zeng , Erik Aurell

Uncertainty sampling is a prevalent active learning algorithm that queries sequentially the annotations of data samples which the current prediction model is uncertain about. However, the usage of uncertainty sampling has been largely…

Machine Learning · Computer Science 2026-04-08 Shang Liu , Xiaocheng Li

Consider a randomized algorithm that draws samples exactly from a distribution using recursion. Such an algorithm is called a perfect simulation, and here a variety of methods for building this type of algorithm are shown to derive from the…

Data Structures and Algorithms · Computer Science 2019-07-17 Mark Huber

Languages for open-universe probabilistic models (OUPMs) can represent situations with an unknown number of objects and iden- tity uncertainty. While such cases arise in a wide range of important real-world appli- cations, existing general…

Artificial Intelligence · Computer Science 2012-03-19 Nimar S. Arora , Rodrigo de Salvo Braz , Erik B. Sudderth , Stuart Russell

The target measure $\mu$ is the distribution of a random vector in a box $\cB$, a Cartesian product of bounded intervals. The Gibbs sampler is a Markov chain with invariant measure $\mu$. A ``coupling from the past'' construction of the…

Probability · Mathematics 2007-09-25 Pedro J. Fernandez , Pablo A. Ferrari , Sebastian Grynberg

We consider estimating the edge-probability matrix of a network generated from a graphon model when the full network is not observed---only some overlapping subgraphs are. We extend the neighbourhood smoothing (NBS) algorithm of Zhang et…

Machine Learning · Statistics 2019-06-28 Soumendu Sundar Mukherjee , Sayak Chakrabarti

Tipping points occur in many real-world systems, at which the system shifts suddenly from one state to another. The ability to predict the occurrence of tipping points from time series data remains an outstanding challenge and a major…

Machine Learning · Computer Science 2024-12-10 Chengzuo Zhuge , Jiawei Li , Wei Chen

Sampling is often a necessary evil to reduce the processing and storage costs of distributed tracing. In this work, we describe a scalable and adaptive sampling approach that can preserve events of interest better than the widely used…

Data Structures and Algorithms · Computer Science 2021-07-19 Otmar Ertl

Assessing uncertainty is an important step towards ensuring the safety and reliability of machine learning systems. Existing uncertainty estimation techniques may fail when their modeling assumptions are not met, e.g. when the data…

Machine Learning · Computer Science 2017-01-24 Volodymyr Kuleshov , Stefano Ermon

This paper deals with Gibbs samplers that include high dimensional conditional Gaussian distributions. It proposes an efficient algorithm that avoids the high dimensional Gaussian sampling and relies on a random excursion along a small set…

Computation · Statistics 2016-04-20 Olivier Féron , François Orieux , Jean-François Giovannelli