English
Related papers

Related papers: Exact and Efficient Parallel Inference for Nonpara…

200 papers

Although discrete mixture modeling has formed the backbone of the literature on Bayesian density estimation, there are some well known disadvantages. We propose an alternative class of priors based on random nonlinear functions of a uniform…

Statistics Theory · Mathematics 2015-03-19 Suprateek Kundu , David B. Dunson

Nonparametric Bayesian approaches to clustering, information retrieval, language modeling and object recognition have recently shown great promise as a new paradigm for unsupervised data analysis. Most contributions have focused on the…

Methodology · Statistics 2012-07-02 Ian Porteous , Alexander T. Ihler , Padhraic Smyth , Max Welling

Mixtures of multivariate normal inverse Gaussian (MNIG) distributions can be used to cluster data that exhibit features such as skewness and heavy tails. However, for cluster analysis, using a traditional finite mixture model framework,…

Methodology · Statistics 2020-05-13 Yuan Fang , Dimitris Karlis , Sanjeena Subedi

Over the past decades, linear mixed models have attracted considerable attention in various fields of applied statistics. They are popular whenever clustered, hierarchical or longitudinal data are investigated. Nonetheless, statistical…

Methodology · Statistics 2021-09-20 Katarzyna Reluga , María José Lombardía , Stefan Andreas Sperlich

In this paper, an alternative approximation to the innovation method is introduced for the parameter estimation of diffusion processes from partial and noisy observations. This is based on a convergent approximation to the first two…

Optimization and Control · Mathematics 2013-12-19 J. C. Jimenez

We develop stochastic variational inference, a scalable algorithm for approximating posterior distributions. We develop this technique for a large class of probabilistic models and we demonstrate it with two probabilistic topic models,…

Machine Learning · Statistics 2013-04-24 Matt Hoffman , David M. Blei , Chong Wang , John Paisley

The increased availability of massive data sets provides a unique opportunity to discover subtle patterns in their distributions, but also imposes overwhelming computational challenges. To fully utilize the information contained in big…

Statistics Theory · Mathematics 2018-04-12 Stanislav Volgushev , Shih-Kang Chao , Guang Cheng

During the semiconductor manufacturing process, predicting the yield of the semiconductor is an important problem. Early detection of defective product production in the manufacturing process can save huge production cost. The data…

Applications · Statistics 2021-08-03 Sewon Park , Kyeongwon Lee , Da-Eun Jeong , Heung-Kook Ko , Jaeyong Lee

We describe a nonparametric topic model for labeled data. The model uses a mixture of random measures (MRM) as a base distribution of the Dirichlet process (DP) of the HDP framework, so we call it the DP-MRM. To model labeled data, we…

Machine Learning · Computer Science 2012-06-22 Dongwoo Kim , Suin Kim , Alice Oh

Model checking procedures are considered based on the use of the Dirichlet process and relative belief. This combination is seen to lead to some unique advantages for this problem. In particular, it avoids double use of the data and…

Methodology · Statistics 2016-06-28 Luai Al-Labadi , Michael Evans

Motivated by the simultaneous association analysis with the presence of latent confounders, this paper studies the large-scale hypothesis testing problem for the high-dimensional confounded linear models with both non-asymptotic and…

Methodology · Statistics 2023-08-24 Yinrui Sun , Li Ma , Yin Xia

We propose Dirichlet Process Mixture (DPM) models for prediction and cluster-wise variable selection, based on two choices of shrinkage baseline prior distributions for the linear regression coefficients, namely the Horseshoe prior and…

Methodology · Statistics 2021-02-26 Dawei Ding , George Karabatsos

Compositional data, representing proportions constrained to the simplex, arise in diverse fields such as geosciences, ecology, genomics, and microbiome research. Existing nonparametric density estimation methods often rely on…

Methodology · Statistics 2025-10-10 Jiajin Xie , Yong Wang , Eduardo García-Portugués

Thanks to the reparameterization trick, deep latent Gaussian models have shown tremendous success recently in learning latent representations. The ability to couple them however with nonparamet-ric priors such as the Dirichlet Process (DP)…

Machine Learning · Statistics 2020-07-28 Amine Echraibi , Joachim Flocon-Cholet , Stéphane Gosselin , Sandrine Vaton

In many applications, a finite mixture is a natural model, but it can be difficult to choose an appropriate number of components. To circumvent this choice, investigators are increasingly turning to Dirichlet process mixtures (DPMs), and…

Statistics Theory · Mathematics 2013-09-03 Jeffrey W. Miller , Matthew T. Harrison

In this paper we propose a new methodology for solving a discrete time stochastic Markovian control problem under model uncertainty. By utilizing the Dirichlet process, we model the unknown distribution of the underlying stochastic process…

Optimization and Control · Mathematics 2022-03-29 Tao Chen , Jiyoun Myung

Existing works on large language model (LLM) decomposition mainly focus on improving performance on downstream tasks, but they ignore the poor parallel inference performance when trying to scale up the model size. To mitigate this important…

Computation and Language · Computer Science 2026-04-21 You-Liang Huang , Xinhao Huang , Chengxi Liao , Zeyi Wen

The Dirichlet Process Mixture Model (DPMM) is a Bayesian non-parametric approach widely used for density estimation and clustering. In this manuscript, we study the choice of prior for the variance or precision matrix when Gaussian kernels…

Methodology · Statistics 2022-02-09 Wei Jing , Michail Papathomas , Silvia Liverani

Nested nonparametric processes are vectors of random probability measures widely used in the Bayesian literature to model the dependence across distinct, though related, groups of observations. These processes allow a two-level clustering,…

Methodology · Statistics 2024-10-10 Federico Camerlenghi , Riccardo Corradin , Andrea Ongaro

In this paper, we propose a nonparametric Bayesian approach for Lindsey and penalized Gaussian mixtures methods. We compare these methods with the Dirichlet process mixture model. Our approach is a Bayesian nonparametric method not based…

Methodology · Statistics 2020-11-30 Adel Bedoui , Ori Rosen