English
Related papers

Related papers: A note on the geometry of the MAP partition in Con…

200 papers

Mixture models, such as Gaussian mixture models, are widely used in machine learning to represent complex data distributions. A key challenge, especially in high-dimensional settings, is to determine the mixture order and estimate the…

Optimization and Control · Mathematics 2025-09-30 Srećko Đurašinović , Jean-Bernard Lasserre , Victor Magron

We consider Bayesian estimation of a $p\times p$ precision matrix, when $p$ can be much larger than the available sample size $n$. It is well known that consistent estimation in such ultra-high dimensional situations requires regularization…

Statistics Theory · Mathematics 2014-11-07 Sayantan Banerjee , Subhashis Ghosal

Finite mixtures of matrix normal distributions are a powerful tool for classifying three-way data in unsupervised problems. The distribution of each component is assumed to be a matrix variate normal density. The mixture model can be…

Methodology · Statistics 2013-03-07 Cinzia Viroli

Compared to mean regression and quantile regression, the literature on modal regression is very sparse. A unifying framework for Bayesian modal regression is proposed, based on a family of unimodal distributions indexed by the mode, along…

Methodology · Statistics 2024-07-02 Qingyang Liu , Xianzheng Huang , Rai Bai

We present a probabilistic graphical model formulation for the graph clustering problem. This enables to locally represent uncertainty of image partitions by approximate marginal distributions in a mathematically substantiated way, and to…

Computer Vision and Pattern Recognition · Computer Science 2016-01-12 Jörg Hendrik Kappes , Paul Swoboda , Bogdan Savchynskyy , Tamir Hazan , Christoph Schnörr

Motivated by problems in data clustering, we establish general conditions under which families of nonparametric mixture models are identifiable, by introducing a novel framework involving clustering overfitted \emph{parametric} (i.e.…

Statistics Theory · Mathematics 2020-02-19 Bryon Aragam , Chen Dan , Eric P. Xing , Pradeep Ravikumar

With the advent of ubiquitous monitoring and measurement protocols, studies have started to focus more and more on complex, multivariate and heterogeneous datasets. In such studies, multivariate response variables are drawn from a…

Methodology · Statistics 2023-03-03 Saverio Ranciati , Veronica Vinciotti , Ernst C. Wit , Giuliano Galimberti

Spectral clustering views the similarity matrix as a weighted graph, and partitions the data by minimizing a graph-cut loss. Since it minimizes the across-cluster similarity, there is no need to model the distribution within each cluster.…

Methodology · Statistics 2023-04-14 Leo L. Duan , Arkaprava Roy

We introduce a novel Bayesian approach for both covariate selection and sparse precision matrix estimation in the context of high-dimensional Gaussian graphical models involving multiple responses. Our approach provides a sparse estimation…

Methodology · Statistics 2024-09-25 Anwesha Chakravarti , Naveen N. Narishetty , Feng Liang

The mixture extension of exponential family principal component analysis (EPCA) was designed to encode much more structural information about data distribution than the traditional EPCA does. For example, due to the linearity of EPCA's…

Machine Learning · Computer Science 2020-04-08 Maoying Qiao , Tongliang Liu , Jun Yu , Wei Bian , Dacheng Tao

Maximum a posteriori (MAP) estimation, like all Bayesian methods, depends on prior assumptions. These assumptions are often chosen to promote specific features in the recovered estimate. The form of the chosen prior determines the shape of…

Methodology · Statistics 2022-11-15 Zilai Si , Yucong Liu , Alexander Strang

We present a novel framework for concomitant dimension reduction and clustering. This framework is based on a novel class of Bayesian clustering factor models. These models assume a factor model structure where the vectors of common factors…

Methodology · Statistics 2025-05-09 Hwasoo Shin , Marco A. R. Ferreira , Allison N. Tegge

Parameter estimation for model-based clustering using a finite mixture of normal inverse Gaussian (NIG) distributions is achieved through variational Bayes approximations. Univariate NIG mixtures and multivariate NIG mixtures are…

Methodology · Statistics 2017-10-09 Sanjeena Subedi , Paul D. McNicholas

We address the new problem of estimating a piece-wise constant signal with the purpose of detecting its change points and the levels of clusters. Our approach is to model it as a nonparametric penalized least square model selection on a…

Machine Learning · Statistics 2019-12-04 Othmane Mazhar , Cristian R. Rojas , Carlo Fischione , Mohammad R. Hesamzadeh

We study Bayesian estimation of mixture models and argue in favor of fitting the marginal posterior distribution over component assignments directly, rather than Gibbs sampling from the joint posterior on components and parameters as is…

Computation · Statistics 2025-11-03 M. E. J. Newman

The posterior probability distribution for a set of model parameters encodes all that the data have to tell us in the context of a given model; it is the fundamental quantity for Bayesian parameter estimation. In order to infer the…

Instrumentation and Methods for Astrophysics · Physics 2015-06-16 Rupert Allison , Joanna Dunkley

We prove general mixing theorems for sequences of meromorphic maps on compact K\"ahler manifolds. We deduce that the bifurcation measure is exponentially mixing for a family of rational maps of $\mathbb{P}^q(\mathbb{C})$ endowed with…

Dynamical Systems · Mathematics 2024-05-06 Henry de Thelin

Covariance matrix estimation arises in multivariate problems including multivariate normal sampling models and regression models where random effects are jointly modeled, e.g. random-intercept, random-slope models. A Bayesian analysis of…

Methodology · Statistics 2016-07-14 Ignacio Alvarez , Jarad Niemi , Matt Simpson

From neuroscience and genomics to systems biology and ecology, researchers rely on clustering similarity data to uncover modular structure. Yet widely used clustering methods, such as hierarchical clustering, k-means, and WGCNA, lack…

Machine Learning · Statistics 2025-10-20 Magnus Neuman , Jelena Smiljanić , Martin Rosvall

We study the clustering problem for mixtures of bounded covariance distributions, under a fine-grained separation assumption. Specifically, given samples from a $k$-component mixture distribution $D = \sum_{i =1}^k w_i P_i$, where each $w_i…

Machine Learning · Computer Science 2023-12-20 Ilias Diakonikolas , Daniel M. Kane , Jasper C. H. Lee , Thanasis Pittas