English
Related papers

Related papers: Repulsive mixtures via the sparsity-inducing parti…

200 papers

Dirichlet process mixture models (DPMM) play a central role in Bayesian nonparametrics, with applications throughout statistics and machine learning. DPMMs are generally used in clustering problems where the number of clusters is not known…

Machine Learning · Statistics 2020-10-20 Chiao-Yu Yang , Eric Xia , Nhat Ho , Michael I. Jordan

Exemplar-based clustering methods have been shown to produce state-of-the-art results on a number of synthetic and real-world clustering problems. They are appealing because they offer computational benefits over latent-mean models and can…

Machine Learning · Computer Science 2012-06-18 Daniel Tarlow , Richard S. Zemel , Brendan J. Frey

Assigning weights to a large pool of objects is a fundamental task in a wide variety of applications. In this article, we introduce the concept of structured high-dimensional probability simplexes, in which most components are zero or near…

Methodology · Statistics 2022-09-19 Huiming Lin , Meng Li

In many scientific domains, clustering aims to reveal interpretable latent structure that reflects relevant subpopulations or processes. Widely used Bayesian mixture models for model-based clustering often produce overlapping or redundant…

Methodology · Statistics 2025-10-13 Ziyi Song , Federico Camerlenghi , Weining Shen , Michele Guindani , Mario Beraha

In this paper we propose a novel framework for the construction of sparsity-inducing priors. In particular, we define such priors as a mixture of exponential power distributions with a generalized inverse Gaussian density (EP-GIG). EP-GIG…

Machine Learning · Statistics 2012-04-20 Zhihua Zhang , Shusen Wang , Dehua Liu , Michael I. Jordan

In this paper, we provide an explicit probability distribution for classification purposes. It is derived from the Bayesian nonparametric mixture of Dirichlet process model, but with suitable modifications which remove unsuitable aspects of…

Applications · Statistics 2009-05-05 Ruth Fuentes-Garcia , Ramses H Mena , Stephen G Walker

Neural networks are the cornerstone of modern machine learning, yet can be difficult to interpret, give overconfident predictions and are vulnerable to adversarial attacks. Bayesian neural networks (BNNs) provide some alleviation of these…

Machine Learning · Statistics 2026-02-24 August Arnstad , Leiv Rønneberg , Geir Storvik

Dirichlet process mixtures are flexible non-parametric models, particularly suited to density estimation and probabilistic clustering. In this work we study the posterior distribution induced by Dirichlet process mixtures as the sample size…

Statistics Theory · Mathematics 2022-11-29 Filippo Ascolani , Antonio Lijoi , Giovanni Rebaudo , Giacomo Zanella

Probabilistic finite mixture models are widely used for unsupervised clustering. These models can often be improved by adapting them to the topology of the data. For instance, in order to classify spatially adjacent data points similarly,…

Computer Vision and Pattern Recognition · Computer Science 2022-02-09 Jonathan Vacher , Claire Launay , Ruben Coen-Cagli

In this work, we develop a novel Bayesian estimation method for the Dirichlet process (DP) mixture of the inverted Dirichlet distributions, which has been shown to be very flexible for modeling vectors with positive elements. The recently…

Machine Learning · Computer Science 2020-02-04 Zhanyu Ma , Yuping Lai

Stochastic models for collections of interacting populations have crucial roles in scientific fields such as epidemiology and ecology, yet the standard approach to extending an ordinary differential equation model to a Markov chain does not…

Methodology · Statistics 2022-10-04 Ning Ning , Edward L. Ionides

We introduce a new class of nonparametric prior distributions on the space of continuously varying densities, induced by Dirichlet process mixtures which diffuse in time. These select time-indexed random functions without jumps, whose…

Methodology · Statistics 2016-02-10 Ramsés H. Mena , Matteo Ruggiero

Mixtures of multivariate normal inverse Gaussian (MNIG) distributions can be used to cluster data that exhibit features such as skewness and heavy tails. However, for cluster analysis, using a traditional finite mixture model framework,…

Methodology · Statistics 2020-05-13 Yuan Fang , Dimitris Karlis , Sanjeena Subedi

We propose a novel semiparametric model for the joint distribution of a continuous longitudinal outcome and the baseline covariates using an enriched Dirichlet process (EDP) prior. This joint model decomposes into a linear mixed model for…

Methodology · Statistics 2018-06-08 Bret Zeldow , James Flory , Alisa Stephens-Shields , Marsha Raebel , Jason Roy

Random partition distribution is a crucial tool for model-based clustering. This study advances the field of random partition in the context of functional spatial data, focusing on the challenges posed by hourly population data across…

Methodology · Statistics 2025-06-05 Tomoya Wakayama , Shonosuke Sugasawa , Genya Kobayashi

Dirichlet process (DP) mixture models provide a flexible Bayesian framework for density estimation. Unfortunately, their flexibility comes at a cost: inference in DP mixture models is computationally expensive, even when conjugate…

Machine Learning · Computer Science 2009-07-13 Hal Daumé

We develop a flexible Erlang mixture model for survival analysis. The model for the survival density is built from a structured mixture of Erlang densities, mixing on the integer shape parameter with a common scale parameter. The mixture…

Methodology · Statistics 2022-11-17 Yunzhe Li , Juhee Lee , Athanasios Kottas

Penalized regression methods, such as $L_1$ regularization, are routinely used in high-dimensional applications, and there is a rich literature on optimality properties under sparsity assumptions. In the Bayesian paradigm, sparsity is…

Statistics Theory · Mathematics 2012-12-27 Anirban Bhattacharya , Debdeep Pati , Natesh S. Pillai , David B. Dunson

Repulsive mixture models have recently gained popularity for Bayesian cluster detection. Compared to more traditional mixture models, repulsive mixture models produce a smaller number of well separated clusters. The most commonly used…

Methodology · Statistics 2021-04-20 Mario Beraha , Raffaele Argiento , Jesper Møller , Alessandra Guglielmi

To identify novel dynamic patterns of gene expression, we develop a statistical method to cluster noisy measurements of gene expression collected from multiple replicates at multiple time points, with an unknown number of clusters. We…

Applications · Statistics 2013-12-02 Audrey Qiuyan Fu , Steven Russell , Sarah J. Bray , Simon Tavaré