English
Related papers

Related papers: Anchored Bayesian Gaussian Mixture Models

200 papers

Feature selection can facilitate the learning of mixtures of discrete random variables as they arise, e.g. in crowdsourcing tasks. Intuitively, not all workers are equally reliable but, if the less reliable ones could be eliminated, then…

Machine Learning · Statistics 2017-11-28 Vincent Zhao , Steven W. Zucker

This paper addresses the problem of full model estimation for non-parametric finite mixture models. It presents an approach for selecting the number of components and the subset of discriminative variables (i.e., the subset of variables…

Statistics Theory · Mathematics 2021-12-13 Marie Du Roy de Chaumaray , Matthieu Marbac

Mixture models have been around for over 150 years, as an intuitively simple and practical tool for enriching the collection of probability distributions available for modelling data. In this chapter we describe the basic ideas of the…

Methodology · Statistics 2018-05-08 Peter J. Green

Repulsive mixture models have recently gained popularity for Bayesian cluster detection. Compared to more traditional mixture models, repulsive mixture models produce a smaller number of well separated clusters. The most commonly used…

Methodology · Statistics 2021-04-20 Mario Beraha , Raffaele Argiento , Jesper Møller , Alessandra Guglielmi

This paper proposes a flexible Bayesian approach to multiple imputation using conditional Gaussian mixtures. We introduce novel shrinkage priors for covariate-dependent mixing proportions in the mixture models to automatically select the…

Methodology · Statistics 2022-08-17 Shonosuke Sugasawa , Jae Kwang Kim , Kosuke Morikawa

Within a Bayesian framework, a comprehensive investigation of mixtures of finite mixtures (MFMs), i.e., finite mixtures with a prior on the number of components, is performed. This model class has applications in model-based clustering as…

Methodology · Statistics 2025-09-15 Sylvia Frühwirth-Schnatter , Gertraud Malsiner-Walli , Bettina Grün

Semisupervised methods are techniques for using labeled data $(X_1,Y_1),\ldots,(X_n,Y_n)$ together with unlabeled data $X_{n+1},\ldots,X_N$ to make predictions. These methods invoke some assumptions that link the marginal distribution $P_X$…

Statistics Theory · Mathematics 2013-05-27 Martin Azizyan , Aarti Singh , Larry Wasserman

Discrete mixture models are routinely used for density estimation and clustering. While conducting inferences on the cluster-specific parameters, current frequentist and Bayesian methods often encounter problems when clusters are placed too…

Methodology · Statistics 2012-09-21 Francesca Petralia , Vinayak Rao , David B. Dunson

Predictive recursion is an accurate and computationally efficient algorithm for nonparametric estimation of mixing densities in mixture models. In semiparametric mixture models, however, the algorithm fails to account for any uncertainty in…

Methodology · Statistics 2015-03-19 Ryan Martin , Surya T. Tokdar

In recent years, there has been a growing demand to discern clusters of subjects in datasets characterized by a large set of features. Often, these clusters may be highly variable in size and present partial hierarchical structures. In this…

Methodology · Statistics 2024-07-01 Lorenzo Schiavon , Mattia Stival

Mixture models are commonly used in applications with heterogeneity and overdispersion in the population, as they allow the identification of subpopulations. In the Bayesian framework, this entails the specification of suitable prior…

Methodology · Statistics 2023-06-21 Andrea Cremaschi , Timothy M. Wertz , Maria De Iorio

This paper presents a general and efficient framework for probabilistic inference and learning from arbitrary uncertain information. It exploits the calculation properties of finite mixture models, conjugate families and factorization. Both…

Artificial Intelligence · Computer Science 2011-05-19 M. C. Garrido , P. E. Lopez-de-Teruel , A. Ruiz

We investigate the problem of reliably assessing group fairness when labeled examples are few but unlabeled examples are plentiful. We propose a general Bayesian framework that can augment labeled data with unlabeled data to produce more…

Machine Learning · Statistics 2020-10-21 Disi Ji , Padhraic Smyth , Mark Steyvers

Unsupervised models can provide supplementary soft constraints to help classify new target data under the assumption that similar objects in the target set are more likely to share the same class label. Such models can also help detect…

Machine Learning · Computer Science 2015-03-13 Ayan Acharya , Eduardo R. Hruschka , Joydeep Ghosh , Badrul Sarwar , Jean-David Ruvini

This paper proposes a heterogenous density fusion approach to scalable multisensor multitarget tracking where the inter-connected sensors run different types of random finite set (RFS) filters according to their respective capacity and…

Systems and Control · Electrical Eng. & Systems 2025-02-25 Tiancheng Li , Ruibo Yan , Kai Da , Hongqi Fan

Recent work has shown that finite mixture models with $m$ components are identifiable, while making no assumptions on the mixture components, so long as one has access to groups of samples of size $2m-1$ which are known to come from the…

Statistics Theory · Mathematics 2022-07-25 Robert A. Vandermeulen , René Saitenmacher

This paper considers binary classification of high-dimensional features under a postulated model with a low-dimensional latent Gaussian mixture structure and non-vanishing noise. A generalized least squares estimator is used to estimate the…

Machine Learning · Statistics 2023-03-30 Xin Bing , Marten Wegkamp

Semiparametric mixture models are parametric models with latent variables. They are defined kernel, $p_\theta(x | z)$, where z is the unknown latent variable, and $\theta$ is the parameter of interest. We assume that the latent variables…

Statistics Theory · Mathematics 2024-12-03 Stefan Franssen , Jeanne Nguyen , Aad van der Vaart

This work introduces a new method for selecting the number of components in finite mixture models (FMMs) using variational Bayes, inspired by the large-sample properties of the Evidence Lower Bound (ELBO) derived from mean-field (MF)…

Methodology · Statistics 2026-04-23 Chenyang Wang , Yun Yang

This article extends the literature on copulas with discrete or continuous marginals to the case where some of the marginals are a mixture of discrete and continuous components. We do so by carefully defining the likelihood as the density…

Methodology · Statistics 2017-09-05 David Gunawan , Mohamad A. Khaled , Robert Kohn