English
Related papers

Related papers: Finite mixture models do not reliably learn the nu…

200 papers

Finite mixture models have been a very important tool for exploring complex data structures in many scientific areas, for example, economics, epidemiology, finance. In the past decade, semiparametric techniques have been popularly…

Methodology · Statistics 2018-11-15 Sijia Xiang , Weixin Yao , Guangren Yang

Finite mixture models are useful in applied econometrics. They can be used to model unobserved heterogeneity, which plays major roles in labor economics, industrial organization and other fields. Mixtures are also convenient in dealing with…

Econometrics · Economics 2018-11-08 Yuichi Kitamura , Louise Laage

In the bayesian analysis of Inverse Problems most relevant cases the forward maps (FM, or regressor function) are defined in terms of a system of (O, P)DE's with intractable solutions. These necessarily involve a numerical method to find…

Computation · Statistics 2017-08-31 J. Andrés Christen , Marcos A. Capistrán , Miguel Ángel Moreles

Finite mixture models are used in statistics and other disciplines, but inference for mixture models is challenging due, in part, to the multimodality of the likelihood function and the so-called label switching problem. We propose…

Methodology · Statistics 2020-11-03 Umberto Simola , Jessi Cisewski-Kehe , Robert L. Wolpert

We provide finite-sample distribution approximations, that are uniform in the parameter, for inference in linear mixed models. Focus is on variances and covariances of random effects in cases where existing theory fails because their…

Statistics Theory · Mathematics 2025-07-29 Karl Oskar Ekvall , Matteo Bottai

Finite mixtures of regression models offer a flexible framework for investigating heterogeneity in data with functional dependencies. These models can be conveniently used for unsupervised learning on data with clear regression…

Methodology · Statistics 2013-12-03 Utkarsh J. Dang , Paul D. McNicholas

We propose a novel estimator for the number of components (denoted by $M$) in a K-variate non-parametric finite mixture model, where the analyst has repeated observations of $K\geq2$ variables that are independent given a finitely supported…

Methodology · Statistics 2020-07-07 Caleb Kwon , Eric Mbakop

Copulas are now frequently used to construct or estimate multivariate distributions because of their ability to take into account the multivariate dependence of the different variables while separately specifying marginal distributions.…

Methodology · Statistics 2023-02-02 Mohamad A. Khaled , Robert Kohn

We provide novel probabilistic portrayals of two multivariate models designed to handle zero-inflation in count-compositional data. We develop a new unifying framework that represents both as finite mixture distributions. One of these…

Methodology · Statistics 2026-03-31 André F. B. Menezes , Andrew C. Parnell , Keefe Murphy

Real-world measurements often comprise a dominant signal contaminated by a noisy background. Robustly estimating the dominant signal in practice has been a fundamental statistical problem. Classically, mixture models have been used to…

Computation · Statistics 2026-05-20 Ananyabrata Barua , Ayanendranath Basu

Finite mixtures of multivariate normal distributions have been widely used in empirical applications in diverse fields such as statistical genetics and statistical finance. Testing the number of components in multivariate normal mixture…

Statistics Theory · Mathematics 2019-02-11 Hiroyuki Kasahara , Katsumi Shimotsu

The determination of the number of mixture components (the order) of a finite mixture model has been an enduring problem in statistical inference. We prove that the closed testing principle leads to a sequential testing procedure (STP) that…

Methodology · Statistics 2022-09-27 Hien D Nguyen , Daniel Fryer , Geoffrey McLachlan

In this paper, we approach the problem of uncertainty quantification in deep learning through a predictive framework, which captures uncertainty in model parameters by specifying our assumptions about the predictive distribution of unseen…

Machine Learning · Statistics 2024-03-20 Luhuan Wu , Sinead Williamson

How to forecast next year's portfolio-wide credit default rate based on last year's default observations and the current score distribution? A classical approach to this problem consists of fitting a mixture of the conditional score…

Machine Learning · Statistics 2014-11-21 Dirk Tasche

Mixture models have received a great deal of attention in statistics due to the wide range of applications found in recent years. This paper discusses a finite mixture model of Birnbaum- Saunders distributions with G components, as an…

Methodology · Statistics 2017-08-03 Luis Benites , Rocío Maehara , Filidor Vilca , Fernando Marmolejo-Ramos

Imprecise probability is concerned with uncertainty about which probability distributions to use. It has applications in robust statistics and machine learning. We look at programming language models for imprecise probability. Our…

Programming Languages · Computer Science 2024-10-31 Jack Liell-Cock , Sam Staton

Uncertainties in a structure is inevitable, which generally lead to variation in dynamic response predictions. For a complex structure, brute force Monte Carlo simulation for response variation analysis is infeasible since one single run…

Machine Learning · Statistics 2020-05-08 Kai Zhou , Jiong Tang

Hyperspectral unmixing while considering endmember variability is usually performed by the normal compositional model (NCM), where the endmembers for each pixel are assumed to be sampled from unimodal Gaussian distributions. However, in…

Computer Vision and Pattern Recognition · Computer Science 2018-03-14 Yuan Zhou , Anand Rangarajan , Paul D. Gader

We consider a two-component mixture model with one known component. We develop methods for estimating the mixing proportion and the unknown distribution nonparametrically, given i.i.d.~data from the mixture model, using ideas from shape…

Methodology · Statistics 2015-11-10 Rohit Kumar Patra , Bodhisattva Sen

Existing score-based methods for inverse problems often resort to approximate minimization of the KL divergence between the inversion distribution and the Bayesian posterior. Such an approximation leads to severe mode collapse and…

Computer Vision and Pattern Recognition · Computer Science 2026-05-26 Weimin Bai , Yuxuan Gu , Yifei Wang , Weijian Luo , He Sun