English
Related papers

Related papers: Gibbs Sampling for (Coupled) Infinite Mixture Mode…

200 papers

The widespread popularity of replica exchange and expanded ensemble algorithms for simulating complex molecular systems in chemistry and biophysics has generated much interest in enhancing phase space mixing of these protocols, thus…

Statistical Mechanics · Physics 2011-12-06 John D. Chodera , Michael R. Shirts

Modeling complex physical systems such as they arise in civil engineering applications requires finding a trade-off between physical fidelity and practicality. Consequently, deviations of simulation from measurements are ubiquitous even…

Computational Engineering, Finance, and Science · Computer Science 2026-03-18 Paolo Villani , Daniel Andrés Arcones , Jörg F. Unger , Martin Weiser

We present a Gibbs sampling solution to the map-making problem for CMB measurements, building on existing destriping methodology. Gibbs sampling breaks the computationally heavy destriping problem into two separate steps; noise filtering…

In this paper, we investigate combining blocking and collapsing -- two widely used strategies for improving the accuracy of Gibbs sampling -- in the context of probabilistic graphical models (PGMs). We show that combining them is not…

Artificial Intelligence · Computer Science 2013-09-27 Deepak Venugopal , Vibhav Gogate

The latent Dirichlet allocation (LDA) model is a widely-used latent variable model in machine learning for text analysis. Inference for this model typically involves a single-site collapsed Gibbs sampling step for latent variables…

Computation · Statistics 2016-08-03 Xin Zhang , Scott A. Sisson

We characterise the convergence of the Gibbs sampler which samples from the joint posterior distribution of parameters and missing data in hierarchical linear models with arbitrary symmetric error distributions. We show that the convergence…

Methodology · Statistics 2007-10-24 Omiros Papaspiliopoulos , Gareth Roberts

Gibbs-type exchangeable random partitions, which is a class of multiplicative measures on the set of positive integer partitions, appear in various contexts, including Bayesian statistics, random combinatorial structures, and stochastic…

Statistics Theory · Mathematics 2017-06-14 Shuhei Mano

Enriched Dirichlet process mixture (EDPM) models are Bayesian nonparametric models which can be used for nonparametric regression and conditional density estimation and which overcome a key disadvantage of jointly modeling the response and…

Computation · Statistics 2023-05-03 Natalie Burns , Michael J. Daniels

Model-based clustering is a technique widely used to group a collection of units into mutually exclusive groups. There are, however, situations in which an observation could in principle belong to more than one cluster. In the context of…

Applications · Statistics 2016-05-13 Saverio Ranciati , Cinzia Viroli , Ernst Wit

Gibbs partition models are the largest class of infinite exchangeable partitions of the positive integers generalizing the product form of the probability function of the two-parameter Poisson-Dirichlet family. Recently those models have…

Probability · Mathematics 2013-12-23 Annalisa Cerquetti

Diffusion models have demonstrated exceptional performances in various fields of generative modeling, but suffer from slow sampling speed due to their iterative nature. While this issue is being addressed in continuous domains, discrete…

Machine Learning · Computer Science 2025-05-12 Satoshi Hayakawa , Yuhta Takida , Masaaki Imaizumi , Hiromi Wakaki , Yuki Mitsufuji

Hybrid Gibbs samplers represent a prominent class of approximated Gibbs algorithms that utilize Markov chains to approximate conditional distributions, with the Metropolis-within-Gibbs algorithm standing out as a well-known example. Despite…

Statistics Theory · Mathematics 2025-03-24 Qian Qin , Nianqiao Ju , Guanyang Wang

Ensembles of networks arise in many scientific fields, but there are few statistical tools for inferring their generative processes, particularly in the presence of both dyadic dependence and cross-graph heterogeneity. To fill in this gap,…

Methodology · Statistics 2020-04-23 Fan Yin , Weining Shen , Carter T. Butts

L1-ball-type priors are a recent generalization of the spike-and-slab priors. By transforming a continuous precursor distribution to the L1-ball boundary, it induces exact zeros with positive prior and posterior probabilities. With great…

Methodology · Statistics 2026-05-05 Yu Zheng , Leo L. Duan

Gibbs states (i.e., thermal states) can be used for several applications such as quantum simulation, quantum machine learning, quantum optimization, and the study of open quantum systems. Moreover, semi-definite programming, combinatorial…

Quantum Physics · Physics 2024-12-20 Norhan M. Eassa , Mahmoud M. Moustafa , Arnab Banerjee , Jeffrey Cohn

In this paper we describe how MAP inference can be used to sample efficiently from Gibbs distributions. Specifically, we provide means for drawing either approximate or unbiased samples from Gibbs' distributions by introducing low…

Machine Learning · Computer Science 2013-10-01 Tamir Hazan , Subhransu Maji , Tommi Jaakkola

In this paper we consider the problem of dynamic clustering, where cluster memberships may change over time and clusters may split and merge over time, thus creating new clusters and destroying existing ones. We propose a Bayesian…

Methodology · Statistics 2019-10-24 Maria De Iorio , Stefano Favaro , Alessandra Guglielmi , Lifeng Ye

Gibbs sampling is a Markov Chain Monte Carlo (MCMC) method often used in Bayesian learning. MCMC methods can be difficult to deploy on parallel and distributed systems due to their inherently sequential nature. We study asynchronous Gibbs…

Computation · Statistics 2020-03-03 Alexander Terenin , Daniel Simpson , David Draper

The mixture models have become widely used in clustering, given its probabilistic framework in which its based, however, for modern databases that are characterized by their large size, these models behave disappointingly in setting out the…

Machine Learning · Statistics 2017-02-01 Abdelghafour Talibi , Boujemâa Achchab , Rafik Lasri

A model-based approach is developed for clustering categorical data with no natural ordering. The proposed method exploits the Hamming distance to define a family of probability mass functions to model the data. The elements of this family…

Methodology · Statistics 2024-07-02 Raffaele Argiento , Edoardo Filippi-Mazzola , Lucia Paci