English
Related papers

Related papers: Dependent Dirichlet processes via thinning

200 papers

Bayesian models based on the Dirichlet process and other stick-breaking priors have been proposed as core ingredients for clustering, topic modeling, and other unsupervised learning tasks. However, due to the flexibility of these models,…

Methodology · Statistics 2022-01-27 Ryan Giordano , Runjing Liu , Michael I. Jordan , Tamara Broderick

A new class of nonparametric prior distributions, termed Beta-Binomial stick-breaking process, is proposed. By allowing the underlying length random variables to be dependent through a Beta marginals Markov chain, an appealing discrete…

Statistics Theory · Mathematics 2020-08-12 María F. Gil-Leyva , Ramsés H. Mena , Theodoros Nicoleris

Bayesian models based on the Dirichlet process and other stick-breaking priors have been proposed as core ingredients for clustering, topic modeling, and other unsupervised learning tasks. Prior specification is, however, relatively…

Methodology · Statistics 2021-10-27 Ryan Giordano , Runjing Liu , Michael I. Jordan , Tamara Broderick

We begin by reviewing some probabilistic results about the Dirichlet Process and its close relatives, focussing on their implications for statistical modelling and analysis. We then introduce a class of simple mixture models in which…

Methodology · Statistics 2010-03-23 Peter J. Green

Consider a Dirichlet process mixture model (DPM) with random precision parameter $\alpha$, inducing $K_n$ clusters over $n$ observations through its latent random partition. Our goal is to specify the prior distribution…

Methodology · Statistics 2025-06-03 Carlo Vicentini , Ian Hyla Jermyn

A new approach on the joint estimation of partially exchangeable observations is presented by constructing pairwise dependence between $m$ random density functions, each of which is modeled as a mixture of geometric stick breaking…

Directional data require specialized probability models because of the non-Euclidean and periodic nature of their domain. When a directional variable is observed jointly with linear variables, modeling their dependence adds an additional…

Methodology · Statistics 2022-12-22 Tong Zou , Hal S. Stern

We study Dirichlet process-based models for sets of predictor-dependent probability distributions, where the domain and predictor space are general Polish spaces. We generalize the definition of dependent Dirichlet processes, originally…

Statistics Theory · Mathematics 2022-05-12 Andres Iturriaga , Carlos A. Sing Long , Alejandro Jara

We introduce Dirichlet pruning, a novel post-processing technique to transform a large neural network model into a compressed one. Dirichlet pruning is a form of structured pruning that assigns the Dirichlet distribution over each layer's…

Machine Learning · Computer Science 2021-03-10 Kamil Adamczewski , Mijung Park

This paper presents a novel algorithm, based upon the dependent Dirichlet process mixture model (DDPMM), for clustering batch-sequential data containing an unknown number of evolving clusters. The algorithm is derived via a low-variance…

Machine Learning · Computer Science 2013-11-04 Trevor Campbell , Miao Liu , Brian Kulis , Jonathan P. How , Lawrence Carin

In the present paper new insights into the study of the Non-central Dirichlet distribution are provided. This latter is the analogue of the Dirichlet distribution obtained by replacing the Chi-Squared random variables involved in its…

Statistics Theory · Mathematics 2021-08-23 Carlo Orsi

Network data are observed in various applications where the individual entities of the system interact with or are connected to each other, and often these interactions are defined by their associated strength or importance. Clustering is a…

Methodology · Statistics 2025-06-02 Iuliia Promskaia , Adrian O'Hagan , Michael Fop

While most Bayesian nonparametric models in machine learning have focused on the Dirichlet process, the beta process, or their variants, the gamma process has recently emerged as a useful nonparametric prior in its own right. Current…

Machine Learning · Statistics 2017-04-17 Anirban Roychowdhury , Brian Kulis

Bayesian hierarchical modeling is a natural framework to effectively integrate data and borrow information across groups. In this paper, we address problems related to density estimation and identifying clusters across related groups, by…

Methodology · Statistics 2025-10-29 Huizi Zhang , Sara Wade , Natalia Bochkina

The beta-Bernoulli process provides a Bayesian nonparametric prior for models involving collections of binary-valued features. A draw from the beta process yields an infinite collection of probabilities in the unit interval, and a draw from…

Methodology · Statistics 2011-09-16 Tamara Broderick , Michael I. Jordan , Jim Pitman

We present a general construction for dependent random measures based on thinning Poisson processes on an augmented space. The framework is not restricted to dependent versions of a specific nonparametric model, but can be applied to all…

Machine Learning · Statistics 2012-11-21 Nicholas J. Foti , Joseph D. Futoma , Daniel N. Rockmore , Sinead Williamson

For an observed response that is composed by a set - or vector - of positive values that sum up to 1, the Dirichlet distribution (Bol'shev, 2018) is a helpful mathematical construction for the quantification of the data-generating mechanics…

Methodology · Statistics 2018-08-21 Holger Sennhenn-Reulen

This article presents a novel method to sampling on manifolds based on the Dirichlet distribution. The proposed strategy allows to completely respect the underlying manifold around which data is observed, and to do massive samplings with…

Machine Learning · Statistics 2021-08-13 Luan S Prado , Thiago G Ritto

We develop a new Gibbs sampler for a linear mixed model with a Dirichlet process random effect term, which is easily extended to a generalized linear mixed model with a probit link function. Our Gibbs sampler exploits the properties of the…

Statistics Theory · Mathematics 2010-02-26 Minjung Kyung , Jeff Gill , George Casella

For general thinning procedures, its inverse operation, the condensing, is studied and a link to integration-by-parts formulas is established. This extends the recent results on that link for independent thinnings of point processes to…

Probability · Mathematics 2017-04-26 Mathias Rafler