English
Related papers

Related papers: Exact Bayesian Analysis of Mixtures

200 papers

We present a new nonparametric mixture-of-experts model for multivariate regression problems, inspired by the probabilistic k-nearest neighbors algorithm. Using a conditionally specified model, predictions for out-of-sample inputs are based…

Machine Learning · Statistics 2022-08-05 Tianfang Zhang , Rasmus Bokrantz , Jimmy Olsson

We propose a novel approach for estimating conditional or parametric expectations in the setting where obtaining samples or evaluating integrands is costly. Through the framework of probabilistic numerical methods (such as Bayesian…

Machine Learning · Statistics 2024-06-25 Zonghao Chen , Masha Naslidnyk , Arthur Gretton , François-Xavier Briol

Recent work on overfitting Bayesian mixtures of distributions offers a powerful framework for clustering multivariate data using a latent Gaussian model which resembles the factor analysis model. The flexibility provided by overfitting…

Methodology · Statistics 2019-08-29 Panagiotis Papastamoulis

Comparing competing mathematical models of complex natural processes is a shared goal among many branches of science. The Bayesian probabilistic framework offers a principled way to perform model comparison and extract useful metrics for…

We describe an expert system, MAIES, developed for analysing forensic identification problems involving DNA mixture traces using quantitative peak area information. Peak area information is represented by conditional Gaussian distributions,…

Artificial Intelligence · Computer Science 2012-07-02 Robert G. Cowell , Steffen L. Lauritzen , Julia Mortera

In Bayesian machine learning, conjugate priors are popular, mostly due to mathematical convenience. In this paper, we show that there are deeper reasons for choosing a conjugate prior. Specifically, we formulate the conjugate prior in the…

Machine Learning · Computer Science 2010-05-04 Arvind Agarwal , Hal Daume

We consider the Bayesian mixture of finite mixtures (MFMs) and Dirichlet process mixture (DPM) models for clustering. Recent asymptotic theory has established that DPMs overestimate the number of clusters for large samples and that…

In Bayesian statistics, the choice of prior distribution is often debatable, especially if prior knowledge is limited or data are scarce. In imprecise probability, sets of priors are used to accurately model and reflect prior knowledge.…

Methodology · Statistics 2016-10-25 Gero Walter , Frank P. A. Coolen

Background: Many mathematical models have now been employed across every area of systems biology. These models increasingly involve large numbers of unknown parameters, have complex structure which can result in substantial evaluation time…

Molecular Networks · Quantitative Biology 2018-01-15 Ian Vernon , Junli Liu , Michael Goldstein , James Rowe , Jen Topping , Keith Lindsey

We propose a novel Bayesian model selection technique on linear mixed-effects models to compare multiple treatments with a control. A fully Bayesian approach is implemented to estimate the marginal inclusion probabilities that provide a…

Applications · Statistics 2015-09-28 Lei Gong , James M. Flegal , Stephen R. Spindler , Patricia L. Mote

Bayesian probabilistic numerical methods are a set of tools providing posterior distributions on the output of numerical methods. The use of these methods is usually motivated by the fact that they can represent our uncertainty due to…

Computation · Statistics 2018-08-01 Xiaoyue Xi , François-Xavier Briol , Mark Girolami

We consider the problem of Bayesian density estimation on the positive semiline for possibly unbounded densities. We propose a hierarchical Bayesian estimator based on the gamma mixture prior which can be viewed as a location mixture. We…

Statistics Theory · Mathematics 2020-02-25 Natalia Bochkina , Judith Rousseau

Bayesian inference allows machine learning models to express uncertainty. Current machine learning models use only a single learnable parameter combination when making predictions, and as a result are highly overconfident when their…

Machine Learning · Computer Science 2022-02-23 Andrew Wood , Moshik Hershcovitch , Daniel Waddington , Sarel Cohen , Peter Chin

We introduce a density basis of the trigonometric polynomials that is suitable to mixture modelling. Statistical and geometric properties are derived, suggesting it as a circular analogue to the Bernstein polynomial densities. Nonparametric…

Methodology · Statistics 2019-02-26 Olivier Binette , Simon Guillotte

Finite mixture models are widely used in econometric analyses to capture unobserved heterogeneity. This paper shows that maximum likelihood estimation of finite mixtures of parametric densities can suffer from substantial finite-sample bias…

Methodology · Statistics 2026-02-04 Raphaël Langevin

The study of almost surely discrete random probability measures is an active line of research in Bayesian nonparametrics. The idea of assuming interaction across the atoms of the random probability measure has recently spurred significant…

Statistics Theory · Mathematics 2025-04-25 Mario Beraha , Raffaele Argiento , Federico Camerlenghi , Alessandra Guglielmi

We describe a new method for evaluating Bayes factors. The key idea is to introduce a hypermodel in which the competing models are components of a mixture distribution. Inference for the mixing probabilities then yields estimates of the…

Methodology · Statistics 2016-02-16 Philip D. O'Neill , Theodore Kypraios

For exchangeable data, mixture models are an extremely useful tool for density estimation due to their attractive balance between smoothness and flexibility. When additional covariate information is present, mixture models can be extended…

Methodology · Statistics 2023-08-01 Sara Wade , Vanda Inacio , Sonia Petrone

We consider statistical procedures for hypothesis testing of real valued functionals of matched pairs with missing values. In order to improve the accuracy of existing methods, we propose a novel multiplication combination procedure.…

Statistics Theory · Mathematics 2018-01-29 Lubna Amro , Frank Konietschke , Markus Pauly

Humans are routinely exposed to mixtures of chemical and other environmental factors, making the quantification of health effects associated with environmental mixtures a critical goal for establishing environmental policy sufficiently…