English
Related papers

Related papers: Finite mixture models do not reliably learn the nu…

200 papers

For data assumed to come from a finite mixture with an unknown number of components, it has become common to use Dirichlet process mixtures (DPMs) not only for density estimation, but also for inferences about the number of components. The…

Statistics Theory · Mathematics 2013-01-15 Jeffrey W. Miller , Matthew T. Harrison

In many applications, a finite mixture is a natural model, but it can be difficult to choose an appropriate number of components. To circumvent this choice, investigators are increasingly turning to Dirichlet process mixtures (DPMs), and…

Statistics Theory · Mathematics 2013-09-03 Jeffrey W. Miller , Matthew T. Harrison

Finite mixture models are a useful statistical model class for clustering and density approximation. In the Bayesian framework finite mixture models require the specification of suitable priors in addition to the data model. These priors…

Methodology · Statistics 2024-07-09 Bettina Grün , Gertraud Malsiner-Walli

Mixture models are widely used in modeling heterogeneous data populations. A standard approach of mixture modeling assumes that the mixture component takes a parametric kernel form. In many applications, making parametric assumptions on the…

Methodology · Statistics 2026-03-06 Yilei Zhang , Yun Wei , Aritra Guha , XuanLong Nguyen

This work introduces a new method for selecting the number of components in finite mixture models (FMMs) using variational Bayes, inspired by the large-sample properties of the Evidence Lower Bound (ELBO) derived from mean-field (MF)…

Methodology · Statistics 2026-04-23 Chenyang Wang , Yun Yang

A natural Bayesian approach for mixture models with an unknown number of components is to take the usual finite mixture model with Dirichlet weights, and put a prior on the number of components---that is, to use a mixture of finite mixtures…

Methodology · Statistics 2015-02-24 Jeffrey W. Miller , Matthew T. Harrison

The posterior distribution of the number of components k in a finite mixture satisfies a set of inequality constraints. The result holds irrespective of the parametric form of the mixture components and under assumptions on the prior…

Statistics Theory · Mathematics 2007-06-13 Agostino Nobile

Finite mixture models are statistical models which appear in many problems in statistics and machine learning. In such models it is assumed that data are drawn from random probability measures, called mixture components, which are…

Machine Learning · Statistics 2022-04-05 Robert A. Vandermeulen , Clayton D. Scott

This article establishes general conditions for posterior consistency of Bayesian finite mixture models with a prior on the number of components. That is, we provide sufficient conditions under which the posterior concentrates on…

Statistics Theory · Mathematics 2022-05-09 Jeffrey W. Miller

We propose and develop a novel and effective perfect sampling methodology for simulating from posteriors corresponding to mixtures with either known (fixed) or unknown number of components. For the latter we consider the Dirichlet…

Computation · Statistics 2012-03-14 Sabyasachi Mukhopadhyay , Sourabh Bhattacharya

We propose a prior distribution for the number of components of a finite mixture model. The novelty is that the prior distribution is obtained by considering the loss one would incur if the true value representing the number of components…

Methodology · Statistics 2018-09-05 Clara Grazian , Cristiano Villa , Brunero Liseo

Estimating the model evidence - or mariginal likelihood of the data - is a notoriously difficult task for finite and infinite mixture models and we reexamine here different Monte Carlo techniques advocated in the recent literature, as well…

Computation · Statistics 2022-05-12 Adrien Hairault , Christian P. Robert , Judith Rousseau

We consider the Bayesian mixture of finite mixtures (MFMs) and Dirichlet process mixture (DPM) models for clustering. Recent asymptotic theory has established that DPMs overestimate the number of clusters for large samples and that…

In Bayesian inference for mixture models with an unknown number of components, a finite mixture model is usually employed that assumes prior distributions for mixing weights and the number of components. This model is called a mixture of…

Methodology · Statistics 2025-12-25 Fumiya Iwashige , Shintaro Hashimoto

Finite mixture models are flexible methods that are commonly used for model-based clustering. A recent focus in the model-based clustering literature is to highlight the difference between the number of components in a mixture model and the…

Methodology · Statistics 2023-08-03 Garritt L. Page , Massimo Ventrucci , Maria Franco-Villoria

Dirichlet process mixture models (DPMM) play a central role in Bayesian nonparametrics, with applications throughout statistics and machine learning. DPMMs are generally used in clustering problems where the number of clusters is not known…

Machine Learning · Statistics 2020-10-20 Chiao-Yu Yang , Eric Xia , Nhat Ho , Michael I. Jordan

Mixture models are one of the most widely used statistical tools when dealing with data from heterogeneous populations. This paper considers the long-standing debate over finite mixture and infinite mixtures and brings the two modelling…

Methodology · Statistics 2019-04-23 Raffaele Argiento , Maria De Iorio

Diffusion models have excellent capacity to model complex distributions of natural data, which has made them a popular and effective choice for posterior sampling in imaging inverse problems. Existing methods can incorporate any measurement…

Machine Learning · Computer Science 2026-05-29 Benjamin A. Burns , Sara Fridovich-Keil

Bayesian nonparametric mixture models are common for modeling complex data. While these models are well-suited for density estimation, recent results proved posterior inconsistency of the number of clusters when the true number of…

Statistics Theory · Mathematics 2024-05-31 Louise Alamichel , Daria Bystrova , Julyan Arbel , Guillaume Kon Kam King

In finite mixture models, apart from underlying mixing measure, true kernel density function of each subpopulation in the data is, in many scenarios, unknown. Perhaps the most popular approach is to choose some kernel functions that we…

Statistics Theory · Mathematics 2017-09-26 Nhat Ho , XuanLong Nguyen , Ya'acov Ritov
‹ Prev 1 2 3 10 Next ›