English
Related papers

Related papers: Gibbs-type Indian buffet processes

200 papers

Hyper-parameters play a major role in the learning and inference process of latent Dirichlet allocation (LDA). In order to begin the LDA latent variables learning process, these hyper-parameters values need to be pre-determined. We propose…

Machine Learning · Computer Science 2016-03-01 Osama Khalifa , David Wolfe Corne , Mike Chantler

Mixture models are commonly used in applications with heterogeneity and overdispersion in the population, as they allow the identification of subpopulations. In the Bayesian framework, this entails the specification of suitable prior…

Methodology · Statistics 2023-06-21 Andrea Cremaschi , Timothy M. Wertz , Maria De Iorio

A nonparametric Bayesian extension of Factor Analysis (FA) is proposed where observed data $\mathbf{Y}$ is modeled as a linear superposition, $\mathbf{G}$, of a potentially infinite number of hidden factors, $\mathbf{X}$. The Indian Buffet…

Applications · Statistics 2011-07-29 David Knowles , Zoubin Ghahramani

For a long time, the Dirichlet process has been the gold standard discrete random measure in Bayesian nonparametrics. The Pitman--Yor process provides a simple and mathematically tractable generalization, allowing for a very flexible…

Statistics Theory · Mathematics 2020-01-08 Caroline Lawless , Julyan Arbel

The analysis of comorbidity is an open and complex research field in the branch of psychiatry, where clinical experience and several studies suggest that the relation among the psychiatric disorders may have etiological and treatment…

Machine Learning · Statistics 2014-01-30 Francisco J. R. Ruiz , Isabel Valera , Carlos Blanco , Fernando Perez-Cruz

By developing data augmentation methods unique to the negative binomial (NB) distribution, we unite seemingly disjoint count and mixture models under the NB process framework. We develop fundamental properties of the models and derive…

Machine Learning · Statistics 2013-02-18 Mingyuan Zhou , Lawrence Carin

Dirichlet process mixtures are particularly sensitive to the value of the precision parameter controlling the behavior of the latent partition. Randomization of the precision through a prior distribution is a common solution, which leads to…

Methodology · Statistics 2024-09-04 Alessandro Zito , Tommaso Rigon , David B. Dunson

The hierarchical Pitman-Yor process is a discrete random measure used as a prior in Bayesian nonparametrics. It is motivated by the study of groups of clustered data exhibiting power law behavior. Our focus in this paper is on the Gaussian…

Probability · Mathematics 2026-05-13 Shui Feng , J. E. Paguyo

We introduce the microclustering Ewens--Pitman model for random partitions, obtained by scaling the strength parameter of the Ewens--Pitman model linearly with the sample size. The resulting random partition is shown to have the…

Methodology · Statistics 2025-07-25 Mario Beraha , Stefano Favaro

In this paper we study random partitions of 1,...n, where every cluster of size j can be in any of w\_j possible internal states. The Gibbs (n,k,w) distribution is obtained by sampling uniformly among such partitions with k clusters. We…

Probability · Mathematics 2007-05-23 Nathanael Berestycki , Jim Pitman

The Pitman-Yor, or Chinese Restaurant Process, is a stochastic process that generates distributions following a power-law with exponents lower than two, as found in a numerous physical, biological, technological and social systems. We…

Disordered Systems and Neural Networks · Physics 2015-05-13 Bruno Bassetti , Mina Zarei , Marco Cosentino Lagomarsino , Ginestra Bianconi

Deep belief networks are a powerful way to model complex probability distributions. However, learning the structure of a belief network, particularly one with hidden units, is difficult. The Indian buffet process has been used as a…

Machine Learning · Statistics 2010-08-20 Ryan Prescott Adams , Hanna M. Wallach , Zoubin Ghahramani

We introduce the Poisson Hierarchical Indian Buffet Process (PHIBP), a new class of species sampling models designed to address the challenges of complex, sparse count data by facilitating information sharing across and within groups. Our…

Machine Learning · Statistics 2025-08-26 Lancelot F. James , Juho Lee , Abhinav Pandey

Prior distributions play a crucial role in Bayesian approaches to clustering. Two commonly-used prior distributions are the Dirichlet and Pitman-Yor processes. In this paper, we investigate the predictive probabilities that underlie these…

Methodology · Statistics 2010-10-18 Hanna M. Wallach , Shane T. Jensen , Lee Dicker , Katherine A. Heller

Bayesian feature allocation models are a popular tool for modelling data with a combinatorial latent structure. Exact inference in these models is generally intractable and so practitioners typically apply Markov Chain Monte Carlo (MCMC)…

Computation · Statistics 2020-01-28 Alexandre Bouchard-Côté , Andrew Roth

Although discrete mixture modeling has formed the backbone of the literature on Bayesian density estimation, there are some well known disadvantages. We propose an alternative class of priors based on random nonlinear functions of a uniform…

Statistics Theory · Mathematics 2015-03-19 Suprateek Kundu , David B. Dunson

We extend classic characterisations of posterior distributions under Dirichlet process and gamma random measures priors to a dynamic framework. We consider the problem of learning, from indirect observations, two families of time-dependent…

Statistics Theory · Mathematics 2016-11-23 Omiros Papaspiliopoulos , Matteo Ruggiero , Dario Spanò

We analyze the problem of preparing quantum Gibbs states of lattice spin Hamiltonians with local and commuting terms on a quantum computer and in nature. Our central result is an equivalence between the behavior of correlations in the Gibbs…

Quantum Physics · Physics 2016-06-08 Michael J. Kastoryano , Fernando G. S. L. Brandao

This paper presents a novel algorithm, based upon the dependent Dirichlet process mixture model (DDPMM), for clustering batch-sequential data containing an unknown number of evolving clusters. The algorithm is derived via a low-variance…

Machine Learning · Computer Science 2013-11-04 Trevor Campbell , Miao Liu , Brian Kulis , Jonathan P. How , Lawrence Carin

Nonparametric mixture models based on the Pitman-Yor process represent a flexible tool for density estimation and clustering. Natural generalization of the popular class of Dirichlet process mixture models, they allow for more robust…

Computation · Statistics 2021-10-26 Antonio Canale , Riccardo Corradin , Bernardo Nipoti