English
Related papers

Related papers: Hierarchical Dirichlet Process and Relative Entrop…

200 papers

We present the \textit{hierarchical Dirichlet scaling process} (HDSP), a Bayesian nonparametric mixed membership model. The HDSP generalizes the hierarchical Dirichlet process (HDP) to model the correlation structure between metadata in the…

Machine Learning · Computer Science 2017-07-10 Dongwoo Kim , Alice Oh

This paper explores large sample properties of the two-parameter $(\alpha,\theta)$ Poisson--Dirichlet Process in two contexts. In a Bayesian context of estimating an unknown probability measure, viewing this process as a natural extension…

Probability · Mathematics 2008-05-21 Lancelot F. James

Large deviation principles are established for the two-parameter Poisson-Dirichlet distribution and two-parameter Dirichlet process when parameter $\theta$ approaches infinity. The motivation for these results is to understand the…

Probability · Mathematics 2007-05-23 Shui Feng

We propose an effective method to solve the event sequence clustering problems based on a novel Dirichlet mixture model of a special but significant type of point processes --- Hawkes process. In this model, each event sequence belonging to…

Machine Learning · Computer Science 2017-09-22 Hongteng Xu , Hongyuan Zha

Tree structures are ubiquitous in data across many domains, and many datasets are naturally modelled by unobserved tree structures. In this paper, first we review the theory of random fragmentation processes [Bertoin, 2006], and a number of…

Machine Learning · Statistics 2015-09-17 Hong Ge , Yarin Gal , Zoubin Ghahramani

Time-varying mixture densities occur in many scenarios, for example, the distributions of keywords that appear in publications may evolve from year to year, video frame features associated with multiple targets may evolve in a sequence. Any…

Machine Learning · Statistics 2016-04-19 Cheng Luo , Yang Xiang , Richard Yi Da Xu

The cooperative hierarchical structure is a common and significant data structure observed in, or adopted by, many research areas, such as: text mining (author-paper-word) and multi-label classification (label-instance-feature). Renowned…

Machine Learning · Computer Science 2017-07-19 Junyu Xuan , Jie Lu , Guangquan Zhang , Richard Yi Da Xu

Bayesian hierarchical modeling is a natural framework to effectively integrate data and borrow information across groups. In this paper, we address problems related to density estimation and identifying clusters across related groups, by…

Methodology · Statistics 2025-10-29 Huizi Zhang , Sara Wade , Natalia Bochkina

In nonclinical pharmaceutical development, tolerance intervals are critical in ensuring product and process quality. They are statistical intervals designed to contain a specified proportion of the population with a given confidence level.…

Methodology · Statistics 2025-12-03 Seokjun Choi , Tony Pourmohamad , Bruno Sansó

We develop a Bayesian framework for tackling the supervised clustering problem, the generic problem encountered in tasks such as reference matching, coreference resolution, identity uncertainty and record linkage. Our clustering model is…

Machine Learning · Computer Science 2009-07-07 Hal Daumé , Daniel Marcu

Consider a Dirichlet process mixture model (DPM) with random precision parameter $\alpha$, inducing $K_n$ clusters over $n$ observations through its latent random partition. Our goal is to specify the prior distribution…

Methodology · Statistics 2025-06-03 Carlo Vicentini , Ian Hyla Jermyn

We present a Bayesian nonparametric framework for multilevel clustering which utilizes group-level context information to simultaneously discover low-dimensional structures of the group contents and partitions groups into clusters. Using…

Machine Learning · Computer Science 2014-01-30 Vu Nguyen , Dinh Phung , XuanLong Nguyen , Svetha Venkatesh , Hung Hai Bui

Dirichlet distribution and Dirichlet process as its infinite dimensional generalization are primarily used conjugate prior of categorical and multinomial distributions in Bayesian statistics. Extensions have been proposed to broaden…

Methodology · Statistics 2014-12-05 Xuenan Feng

We consider the sequential sampling of species, where observed samples are classified into the species they belong to. We are particularly interested in studying some quantities describing the sampling process when there is a new species…

Probability · Mathematics 2023-02-01 Servet Martínez , Javier Santibáñez

Nonparametric mixture models based on the Dirichlet process are an elegant alternative to finite models when the number of underlying components is unknown, but inference in such models can be slow. Existing attempts to parallelize…

Machine Learning · Statistics 2012-12-03 Sinead A. Williamson , Avinava Dubey , Eric P. Xing

The Lauricella theory of multiple hypergeometric functions is used to shed some light on certain distributional properties of the mean of a Dirichlet process. This approach leads to several results, which are illustrated here. Among these…

Probability · Mathematics 2016-09-07 Antonio Lijoi , Eugenio Regazzini

Biclustering is a class of techniques that simultaneously clusters the rows and columns of a matrix to sort heterogeneous data into homogeneous blocks. Although many algorithms have been proposed to find biclusters, existing methods suffer…

Machine Learning · Statistics 2020-02-11 Michelle N. Ngo , Dustin S. Pluta , Alexander N. Ngo , Babak Shahbaba

The two parameter Poisson-Dirichlet distribution $PD(\alpha,\theta)$ is the distribution of an infinite dimensional random discrete probability. It is a generalization of Kingman's Poisson-Dirichlet distribution. The two parameter Dirichlet…

Probability · Mathematics 2009-03-22 Shui Feng , Wei Sun

Dirichlet distributions are probability measures on the unit simplex. They are often used as prior distributions in modeling categorical data, such as in topic analysis of text data. Motivated by this application, we consider Monte Carlo…

Methodology · Statistics 2026-04-07 Ayeong Lee

Hierarchical Clustering is a popular unsupervised machine learning method with decades of history and numerous applications. We initiate the study of differentially private approximation algorithms for hierarchical clustering under the…

Machine Learning · Computer Science 2023-05-25 Jacob Imola , Alessandro Epasto , Mohammad Mahdian , Vincent Cohen-Addad , Vahab Mirrokni