English
Related papers

Related papers: Prior selection for the precision parameter of Dir…

200 papers

Determinantal point processes (DPPs) are a useful probabilistic model for selecting a small diverse subset out of a large collection of items, with applications in summarization, stochastic optimization, active learning and more. Given a…

Machine Learning · Computer Science 2020-07-01 Daniele Calandriello , Michał Dereziński , Michal Valko

The Dirichlet process (DP) is a fundamental mathematical tool for Bayesian nonparametric modeling, and is widely used in tasks such as density estimation, natural language processing, and time series modeling. Although MCMC inference…

Machine Learning · Statistics 2013-04-09 Dan Lovell , Jonathan Malmaud , Ryan P. Adams , Vikash K. Mansinghka

Bayesian models based on the Dirichlet process and other stick-breaking priors have been proposed as core ingredients for clustering, topic modeling, and other unsupervised learning tasks. Prior specification is, however, relatively…

Methodology · Statistics 2021-10-27 Ryan Giordano , Runjing Liu , Michael I. Jordan , Tamara Broderick

Finite mixture models are flexible methods that are commonly used for model-based clustering. A recent focus in the model-based clustering literature is to highlight the difference between the number of components in a mixture model and the…

Methodology · Statistics 2023-08-03 Garritt L. Page , Massimo Ventrucci , Maria Franco-Villoria

In this article we propose novel Bayesian nonparametric methods using Dirichlet Process Mixture (DPM) models for detecting pairwise dependence between random variables while accounting for uncertainty in the form of the underlying…

Methodology · Statistics 2016-04-28 Sarah Filippi , Chris C. Holmes , Luis E. Nieto-Barajas

A new approach on the joint estimation of partially exchangeable observations is presented by constructing pairwise dependence between $m$ random density functions, each of which is modeled as a mixture of geometric stick breaking…

The Hierarchical Dirichlet process is a discrete random measure serving as an important prior in Bayesian non-parametrics. It is motivated with the study of groups of clustered data. Each group is modelled through a level two Dirichlet…

Probability · Mathematics 2022-10-25 Shui Feng

In this paper, we provide an explicit probability distribution for classification purposes. It is derived from the Bayesian nonparametric mixture of Dirichlet process model, but with suitable modifications which remove unsuitable aspects of…

Applications · Statistics 2009-05-05 Ruth Fuentes-Garcia , Ramses H Mena , Stephen G Walker

Bayesian models based on the Dirichlet process and other stick-breaking priors have been proposed as core ingredients for clustering, topic modeling, and other unsupervised learning tasks. However, due to the flexibility of these models,…

Methodology · Statistics 2022-01-27 Ryan Giordano , Runjing Liu , Michael I. Jordan , Tamara Broderick

We introduce Dirichlet Process Posterior Sampling (DPPS), a Bayesian non-parametric algorithm for multi-arm bandits based on Dirichlet Process (DP) priors. Like Thompson-sampling, DPPS is a probability-matching algorithm, i.e., it plays an…

Machine Learning · Statistics 2025-07-14 Sumit Vashishtha , Odalric-Ambrym Maillard

The Dirichlet Process Gaussian Mixture Model (DPGMM) is often used to cluster data when the number of clusters is unknown. One main DPGMM inference paradigm relies on sampling. Here we consider a known state-of-art sampler (proposed by…

Machine Learning · Computer Science 2022-03-28 Vlad Winter , Or Dinari , Oren Freifeld

Directional data require specialized probability models because of the non-Euclidean and periodic nature of their domain. When a directional variable is observed jointly with linear variables, modeling their dependence adds an additional…

Methodology · Statistics 2022-12-22 Tong Zou , Hal S. Stern

We present a Dirichlet process mixture model over discrete incomplete rankings and study two Gibbs sampling inference techniques for estimating posterior clusterings. The first approach uses a slice sampling subcomponent for estimating…

Machine Learning · Computer Science 2012-03-19 Marina Meila , Harr Chen

Nonparametric mixture models based on the Dirichlet process are an elegant alternative to finite models when the number of underlying components is unknown, but inference in such models can be slow. Existing attempts to parallelize…

Machine Learning · Statistics 2012-12-03 Sinead A. Williamson , Avinava Dubey , Eric P. Xing

Dependent nonparametric processes extend distributions over measures, such as the Dirichlet process and the beta process, to give distributions over collections of measures, typically indexed by values in some covariate space. Such models…

Machine Learning · Statistics 2012-11-21 Nicholas J. Foti , Sinead Williamson

In model-based-clustering mixture models are used to group data points into clusters. A useful concept introduced for Gaussian mixtures by Malsiner Walli et al (2016) are sparse finite mixtures, where the prior distribution on the weight…

Methodology · Statistics 2018-08-23 Sylvia Frühwirth-Schnatter , Gertraud Malsiner-Walli

We extend classic characterisations of posterior distributions under Dirichlet process and gamma random measures priors to a dynamic framework. We consider the problem of learning, from indirect observations, two families of time-dependent…

Statistics Theory · Mathematics 2016-11-23 Omiros Papaspiliopoulos , Matteo Ruggiero , Dario Spanò

This paper introduces Dirichlet process mixtures of block $g$ priors for model selection and prediction in linear models. These priors are extensions of traditional mixtures of $g$ priors that allow for differential shrinkage for various…

Methodology · Statistics 2026-05-13 Anupreet Porwal , Abel Rodriguez

The Bayesian approach to inference stands out for naturally allowing borrowing information across heterogeneous populations, with different samples possibly sharing the same distribution. A popular Bayesian nonparametric model for…

Methodology · Statistics 2022-01-25 Antonio Lijoi , Igor Prünster , Giovanni Rebaudo

Exemplar-based clustering methods have been shown to produce state-of-the-art results on a number of synthetic and real-world clustering problems. They are appealing because they offer computational benefits over latent-mean models and can…

Machine Learning · Computer Science 2012-06-18 Daniel Tarlow , Richard S. Zemel , Brendan J. Frey