English
Related papers

Related papers: Overfitting Bayesian Mixture Models with an Unknow…

200 papers

We study Bayesian estimation of finite mixture models in a general setup where the number of components is unknown and allowed to grow with the sample size. An assumption on growing number of components is a natural one as the degree of…

Statistics Theory · Mathematics 2022-03-18 Ilsang Ohn , Lizhen Lin

This paper outlines a Bayesian approach to estimate finite mixtures of Tobit models. The method consists of an MCMC approach that combines Gibbs sampling with data augmentation and is simple to implement. I show through simulations that the…

Econometrics · Economics 2024-11-18 Caio Waisman

We consider a two-component mixture model with one known component. We develop methods for estimating the mixing proportion and the unknown distribution nonparametrically, given i.i.d.~data from the mixture model, using ideas from shape…

Methodology · Statistics 2015-11-10 Rohit Kumar Patra , Bodhisattva Sen

Given a mixed hyperspectral data set, linear unmixing aims at estimating the reference spectral signatures composing the data - referred to as endmembers - their abundance fractions and their number. In practice, the identified endmembers…

Methodology · Statistics 2016-01-20 Pierre-Antoine Thouvenin , Nicolas Dobigeon , Jean-Yves Tourneret

This paper deals with Bayesian inference of a mixture of Gaussian distributions. A novel formulation of the mixture model is introduced, which includes the prior constraint that each Gaussian component is always assigned a minimal number of…

Methodology · Statistics 2014-05-21 Colin J. Stoneking

Hyperspectral unmixing is a blind source separation problem which consists in estimating the reference spectral signatures contained in a hyperspectral image, as well as their relative contribution to each pixel according to a given mixture…

Data Analysis, Statistics and Probability · Physics 2017-11-21 Pierre-Antoine Thouvenin , Nicolas Dobigeon , Jean-Yves Tourneret

Despite being robust to small amounts of label noise, convolutional neural networks trained with stochastic gradient methods have been shown to easily fit random labels. When there are a mixture of correct and mislabelled targets, networks…

Computer Vision and Pattern Recognition · Computer Science 2019-06-06 Eric Arazo , Diego Ortego , Paul Albert , Noel E. O'Connor , Kevin McGuinness

The BayesBinMix package offers a Bayesian framework for clustering binary data with or without missing values by fitting mixtures of multivariate Bernoulli distributions with an unknown number of components. It allows the joint estimation…

Computation · Statistics 2017-07-03 Panagiotis Papastamoulis , Magnus Rattray

This paper is concerned with learning of mixture regression models for individuals that are measured repeatedly. The adjective "unsupervised" implies that the number of mixing components is unknown and has to be determined, ideally by data…

Methodology · Statistics 2018-01-09 Peirong Xu , Heng Peng , Tao Huang

Mixture models, such as Gaussian mixture models, are widely used in machine learning to represent complex data distributions. A key challenge, especially in high-dimensional settings, is to determine the mixture order and estimate the…

Optimization and Control · Mathematics 2025-09-30 Srećko Đurašinović , Jean-Bernard Lasserre , Victor Magron

In this paper, we develop a Bayesian multiscale approach based on a multiscale finite element method. Because of scale disparity in many multiscale applications, computational models can not resolve all scales. Various subgrid models are…

Numerical Analysis · Mathematics 2017-02-13 Y. Efendiev , W. T. Leung , S. W. Cheung , N. Guha , V. H. Hoang , B. Mallick

This paper presents a new Bayesian model and algorithm for nonlinear unmixing of hyperspectral images. The model proposed represents the pixel reflectances as linear combinations of the endmembers, corrupted by nonlinear (with respect to…

Methodology · Statistics 2015-10-06 Yoann Altmann , Marcelo Pereyra , Stephen McLaughlin

This paper presents an unsupervised Bayesian algorithm for hyperspectral image unmixing accounting for endmember variability. The pixels are modeled by a linear combination of endmembers weighted by their corresponding abundances. However,…

Methodology · Statistics 2015-10-28 Abderrahim Halimi , Nicolas Dobigeon , Jean-Yves Tourneret

Finite element model updating is challenging because 1) the problem is oftentimes underdetermined while the measurements are limited and/or incomplete; 2) many combinations of parameters may yield responses that are similar with respect to…

Applications · Statistics 2021-07-28 Kai Zhou , Jiong Tang

Financial studies require volatility based models which provides useful insights on risks related to investments. Stochastic volatility models are one of the most popular approaches to model volatility in such studies. The asset returns…

Methodology · Statistics 2021-10-26 Soham Mukherjee

Reliable Bayesian predictive inference has long been an open problem under unidentified transformation models, since the Markov Chain Monte Carlo (MCMC) chains of posterior predictive distribution (PPD) values are generally poorly mixed. We…

Methodology · Statistics 2025-08-28 Chong Zhong , Jin Yang , Junshan Shen , Zhaohai Li , Catherine C. Liu

We study the problem of learning mixtures of low-rank models, i.e. reconstructing multiple low-rank matrices from unlabelled linear measurements of each. This problem enriches two widely studied settings -- low-rank matrix sensing and mixed…

Machine Learning · Statistics 2021-03-10 Yanxi Chen , Cong Ma , H. Vincent Poor , Yuxin Chen

We consider the problem of inferring an unknown number of clusters in replicated multinomial data. Under a model based clustering point of view, this task can be treated by estimating finite mixtures of multinomial distributions with or…

Methodology · Statistics 2023-07-07 Panagiotis Papastamoulis

Estimation of the number of components (or order) of a finite mixture model is a long standing and challenging problem in statistics. We propose the Group-Sort-Fuse (GSF) procedure -- a new penalized likelihood approach for simultaneous…

Methodology · Statistics 2021-08-06 Tudor Manole , Abbas Khalili

Estimating the model evidence - or mariginal likelihood of the data - is a notoriously difficult task for finite and infinite mixture models and we reexamine here different Monte Carlo techniques advocated in the recent literature, as well…

Computation · Statistics 2022-05-12 Adrien Hairault , Christian P. Robert , Judith Rousseau