English
Related papers

Related papers: A Hybrid NUTS-Gibbs Sampler with State Space Margi…

200 papers

Gibbs sampling methods are standard tools to perform posterior inference for mixture models. These have been broadly classified into two categories: marginal and conditional methods. While conditional samplers are more widely applicable…

Methodology · Statistics 2023-02-21 Pierpaolo De Blasi , María F. Gil-Leyva

In this paper we present a novel implementation of Bayesian CMB component separation. We sample from the full posterior distribution using the No-U-Turn Sampler (NUTS), a gradient-based sampling algorithm. Alongside this, we introduce new…

Cosmology and Nongalactic Astrophysics · Physics 2024-11-19 R. D. P. Grumitt , Luke R. P. Jew , C. Dickinson

Adapting the step size locally in the no-U-turn sampler (NUTS) is challenging because the step-size and path-length tuning parameters are interdependent. The determination of an optimal path length requires a predefined step size, while the…

Methodology · Statistics 2025-08-29 Nawaf Bou-Rabee , Bob Carpenter , Tore Selland Kleppe , Milo Marsden

In computed tomography, data consist of measurements of the attenuation of X-rays passing through an object. The goal is to reconstruct the linear attenuation coefficient of the object's interior. For each position of the X-ray source,…

Pre-trained diffusion models have been successfully used as priors in a variety of linear inverse problems, where the goal is to reconstruct a signal from noisy linear measurements. However, existing approaches require knowledge of the…

Machine Learning · Computer Science 2023-06-28 Naoki Murata , Koichi Saito , Chieh-Hsin Lai , Yuhta Takida , Toshimitsu Uesaka , Yuki Mitsufuji , Stefano Ermon

Integrating probability and nonprobability survey samples is an important problem in modern survey sampling. Nonprobability samples often contain rich outcome information but may lack population representativeness, whereas probability…

Statistics Theory · Mathematics 2026-05-28 Yufang Dai , Shihua Luo , Wendy Lou , Zilin Wang , Xuewen Lu

The generalized negative binomial distribution (GNB) is a new flexible family of discrete distributions that are mixed Poisson laws with the mixing generalized gamma (GG) distributions. This family of discrete distributions is very wide and…

Methodology · Statistics 2018-09-18 Andrey K. Gorshenin , Victor Yu. Korolev

The numerical representation of high-dimensional Gibbs distributions is challenging due to the curse of dimensionality manifesting through the intractable normalization constant calculations. This work addresses this challenge by performing…

Numerical Analysis · Mathematics 2025-01-30 Nan Sheng , Xun Tang , Haoxuan Chen , Lexing Ying

We introduce the concept of Hybrid Surrogate Models (HSMs) -- combining multivariate polynomials with Heavyside functions -- as approximates of functions with finitely many jump discontinuities. We exploit the HSMs for formulating a…

Numerical Analysis · Mathematics 2024-08-06 Juan-Esteban Suarez Cardona , Shashank Reddy , Michael Hecht

Stochastic neural networks such as Restricted Boltzmann Machines (RBMs) have been successfully used in applications ranging from speech recognition to image classification. Inference and learning in these algorithms use a Markov Chain Monte…

Neural and Evolutionary Computing · Computer Science 2016-11-17 Bruno U. Pedroni , Srinjoy Das , John V. Arthur , Paul A. Merolla , Bryan L. Jackson , Dharmendra S. Modha , Kenneth Kreutz-Delgado , Gert Cauwenberghs

A new dynamic latent space eigenmodel (LSM) is proposed for weighted temporal networks. The model accommodates integer-valued weights, excess of zeros, time-varying node positions (features), and time-varying network sparsity. The latent…

Methodology · Statistics 2026-04-15 Roberto Casarin , Matteo Iacopini , Antonio Peruzzi

Inferring time-varying networks is important to understand the development and evolution of interactions over time. However, the vast majority of currently used models assume direct measurements of node states, which are often difficult to…

Applications · Statistics 2014-05-06 Xin Wang , Ke Yuan , Christoph Hellmayr , Wei Liu , Florian Markowetz

Distributed Lag Models (DLMs) and similar regression approaches such as MIDAS have been used for many decades in econometrics and more recently to investigate how poor air quality adversely affects human health. In this paper we describe…

Methodology · Statistics 2025-01-30 Daniel Dempsey , Jason Wyse

Latent autoregressive processes are a popular choice to model time varying parameters. These models can be formulated as nonlinear state space models for which inference is not straightforward due to the high number of parameters. Therefore…

Computation · Statistics 2019-11-01 Alexander Kreuzer , Claudia Czado

As deep neural networks (DNNs) are applied to increasingly challenging problems, they will need to be able to represent their own uncertainty. Modeling uncertainty is one of the key features of Bayesian methods. Using Bernoulli dropout with…

Machine Learning · Computer Science 2019-09-19 Patrick McClure , Nikolaus Kriegeskorte

State space models (SSMs) are widely used to describe dynamic systems. However, when the likelihood of the observations is intractable, parameter inference for SSMs cannot be easily carried out using standard Markov chain Monte Carlo or…

Methodology · Statistics 2023-12-21 Zhaoran Hou , Samuel W. K. Wong

Identifying the dynamical state variables of a system from high-dimensional observations is a central problem across physical sciences. The challenge is that the state variables are not directly observable and must be inferred from raw…

Data Analysis, Statistics and Probability · Physics 2026-04-28 K. Michael Martini , Eslam Abdelaleem , Paarth Gulati , Ilya Nemenman

A fundamental task in machine learning and related fields is to perform inference on Bayesian networks. Since exact inference takes exponential time in general, a variety of approximate methods are used. Gibbs sampling is one of the most…

Machine Learning · Computer Science 2015-11-23 Daniel Seita , Haoyu Chen , John Canny

We study the convergence properties of the Gibbs Sampler in the context of posterior distributions arising from Bayesian analysis of conditionally Gaussian hierarchical models. We develop a multigrid approach to derive analytic expressions…

Computation · Statistics 2019-06-27 Giacomo Zanella , Gareth Roberts

Nonparametric Bayesian approaches to clustering, information retrieval, language modeling and object recognition have recently shown great promise as a new paradigm for unsupervised data analysis. Most contributions have focused on the…

Methodology · Statistics 2012-07-02 Ian Porteous , Alexander T. Ihler , Padhraic Smyth , Max Welling