English
Related papers

Related papers: Mixture models with a prior on the number of compo…

200 papers

Robust statistical data modelling under potential model mis-specification often requires leaving the parametric world for the nonparametric. In the latter, parameters are infinite dimensional objects such as functions, probability…

Dirichlet Process Mixtures (DPMs) are a popular class of statistical models to perform density estimation and clustering. However, when the data available have a distribution evolving over time, such models are inadequate. We introduce here…

Methodology · Statistics 2012-06-26 Francois Caron , Manuel Davy , Arnaud Doucet

A new method for multinomial inference is proposed by representing the cell probabilities as unordered segments on the unit interval and following Dempster-Shafer (DS) theory. The resulting DS posterior is then strengthened to improve…

Methodology · Statistics 2024-10-10 Earl C. Lawrence , Alexander C. Murph , Scott A. Vander Wiel , Chaunhai Liu

This paper focuses on variational inference with intractable likelihood functions that can be unbiasedly estimated. A flexible variational approximation based on Gaussian mixtures is developed, by adopting the mixture population Monte Carlo…

Numerical Analysis · Mathematics 2021-12-02 Zhijian He , Shifeng Huo , Tianhui Yang

We study posterior contraction behaviors for parameters of interest in the context of Bayesian mixture modeling, where the number of mixing components is unknown while the model itself may or may not be correctly specified. Two…

Statistics Theory · Mathematics 2019-01-17 Aritra Guha , Nhat Ho , XuanLong Nguyen

Normalized random measures (NRMs) provide a broad class of discrete random measures that are often used as priors for Bayesian nonparametric models. Dirichlet process is a well-known example of NRMs. Most of posterior inference methods for…

Machine Learning · Statistics 2015-11-19 Juho Lee , Seungjin Choi

Mixtures of product distributions are a powerful device for learning about heterogeneity within data populations. In this class of latent structure models, de Finetti's mixing measure plays the central role for describing the uncertainty…

Statistics Theory · Mathematics 2021-09-27 Yun Wei , XuanLong Nguyen

The modelling of empirically observed data is commonly done using mixtures of probability distributions. In order to model angular data, directional probability distributions such as the bivariate von Mises (BVM) is typically used. The…

Machine Learning · Statistics 2016-09-27 Parthan Kasarapu

The prediction of crack initiation and propagation in ductile failure processes are challenging tasks for the design and fabrication of metallic materials and structures on a large scale. Numerical aspects of ductile failure dictate a…

Numerical Analysis · Mathematics 2021-04-23 Nima Noii , Amirreza Khodadadian , Jacinto Ulloa , Fadi Aldakheel , Thomas Wick , Stijn Francois , Peter Wriggers

When we use simulation to assess the performance of stochastic systems, the input models used to drive simulation experiments are often estimated from finite real-world data. There exist both input model and simulation estimation…

Methodology · Statistics 2021-08-10 Wei Xie , Cheng Li , Yuefeng Wu , Pu Zhang

Thanks to the reparameterization trick, deep latent Gaussian models have shown tremendous success recently in learning latent representations. The ability to couple them however with nonparamet-ric priors such as the Dirichlet Process (DP)…

Machine Learning · Statistics 2020-07-28 Amine Echraibi , Joachim Flocon-Cholet , Stéphane Gosselin , Sandrine Vaton

A mixture of experts models the conditional density of a response variable using a mixture of regression models with covariate-dependent mixture weights. We extend the finite mixture of experts model by allowing the parameters in both the…

Computation · Statistics 2022-10-14 Parfait Munezero , Mattias Villani , Robert Kohn

We propose Dirichlet Process mixtures of Generalized Linear Models (DP-GLM), a new method of nonparametric regression that accommodates continuous and categorical inputs, and responses that can be modeled by a generalized linear model. We…

Machine Learning · Statistics 2010-07-16 Lauren A. Hannah , David M. Blei , Warren B. Powell

Diffusion models (DMs) have emerged as powerful image priors in Bayesian computational imaging. Two primary strategies have been proposed for leveraging DMs in this context: Plug-and-Play methods, which are zero-shot and highly flexible but…

Computer Vision and Pattern Recognition · Computer Science 2025-11-19 Charlesquin Kemajou Mbakam , Jonathan Spence , Marcelo Pereyra

We present an algorithm for learning mixtures of Markov chains and Markov decision processes (MDPs) from short unlabeled trajectories. Specifically, our method handles mixtures of Markov chains with optional control input by going through a…

Machine Learning · Statistics 2023-02-07 Chinmaya Kausik , Kevin Tan , Ambuj Tewari

Missingness in categorical data is a common problem in various real applications. Traditional approaches either utilize only the complete observations or impute the missing data by some ad hoc methods rather than the true conditional…

Methodology · Statistics 2019-07-12 Chaojie Wang , Linghao Shen , Han Li , Xiaodan Fan

There is an increasingly rich literature about Bayesian nonparametric models for clustering functional observations. However, most of the recent proposals rely on infinite-dimensional characterizations that might lead to overly complex…

Methodology · Statistics 2019-07-05 Tommaso Rigon

Mixture models have found uses in many areas. To list a few: unsupervised learning, empirical Bayes, latent class and trait models. The current applications of mixture models to empirical data is limited to computing a mixture model from…

Computation · Statistics 2015-09-23 Andrew Clark

We introduce the multivariate decomposition finite element method (MDFEM) for solving elliptic PDEs with uniform random diffusion coefficients. We show that the MDFEM can be used to reduce the computational complexity of estimating the…

Numerical Analysis · Mathematics 2021-07-28 Dong T. P. Nguyen , Dirk Nuyens

We use the theory of normal variance-mean mixtures to derive a data augmentation scheme for models that include gamma functions. Our methodology applies to many situations in statistics and machine learning, including Multinomial-Dirichlet…

Methodology · Statistics 2021-06-22 Jingyu He , Nicholas Polson , Jianeng Xu