English
Related papers

Related papers: IID Sampling from Posterior Dirichlet Process Mixt…

200 papers

We consider generalized Bayesian inference on stochastic processes and dynamical systems with potentially long-range dependency. Given a sequence of observations, a class of parametrized model processes with a prior distribution, and a loss…

Statistics Theory · Mathematics 2023-04-26 Langxuan Su , Sayan Mukherjee

Dirichlet processes (DP) are widely applied in Bayesian nonparametric modeling. However, in their basic form they do not directly integrate dependency information among data arising from space and time. In this paper, we propose location…

Machine Learning · Statistics 2017-07-04 Shiliang Sun , John Paisley , Qiuyang Liu

This paper introduces and studies a new class of nonparametric prior distributions. Random probability distribution functions are constructed via normalization of random measures driven by increasing additive processes. In particular, we…

Statistics Theory · Mathematics 2007-06-13 Luis E. Nieto-Barajas , Igor Prunster , Stephen G. Walker

We propose a general modeling framework for marked Poisson processes observed over time or space. The modeling approach exploits the connection of the nonhomogeneous Poisson process intensity with a density function. Nonparametric Dirichlet…

Methodology · Statistics 2011-11-02 Matthew A. Taddy , Athanasios Kottas

Time-varying mixture densities occur in many scenarios, for example, the distributions of keywords that appear in publications may evolve from year to year, video frame features associated with multiple targets may evolve in a sequence. Any…

Machine Learning · Statistics 2016-04-19 Cheng Luo , Yang Xiang , Richard Yi Da Xu

Bayesian inverse problems often involve sampling posterior distributions on infinite-dimensional function spaces. Traditional Markov chain Monte Carlo (MCMC) algorithms are characterized by deteriorating mixing times upon mesh-refinement,…

Computation · Statistics 2017-03-08 Alexandros Beskos , Mark Girolami , Shiwei Lan , Patrick E. Farrell , Andrew M. Stuart

Consider a Dirichlet process mixture model (DPM) with random precision parameter $\alpha$, inducing $K_n$ clusters over $n$ observations through its latent random partition. Our goal is to specify the prior distribution…

Methodology · Statistics 2025-06-03 Carlo Vicentini , Ian Hyla Jermyn

We consider the problem of estimating Shannon's entropy $H$ from discrete data, in cases where the number of possible symbols is unknown or even countably infinite. The Pitman-Yor process, a generalization of Dirichlet process, provides a…

Information Theory · Computer Science 2014-04-11 Evan Archer , Il Memming Park , Jonathan Pillow

We study the rates of convergence of the posterior distribution for Bayesian density estimation with Dirichlet mixtures of normal distributions as the prior. The true density is assumed to be twice continuously differentiable. The bandwidth…

Statistics Theory · Mathematics 2009-09-29 Subhashis Ghosal , Aad van der Vaart

Flow cytometry is a high-throughput technology used to quantify multiple surface and intracellular markers at the level of a single cell. This enables to identify cell sub-types, and to determine their relative proportions. Improvements of…

Machine Learning · Statistics 2022-11-10 Boris P. Hejblum , Chariff Alkhassim , Raphael Gottardo , François Caron , Rodolphe Thiébaut

Dataset distillation plays a crucial role in creating compact datasets with similar training performance compared with original large-scale ones. This is essential for addressing the challenges of data storage and training costs. Prevalent…

Computer Vision and Pattern Recognition · Computer Science 2023-10-24 Yanqing Liu , Jianyang Gu , Kai Wang , Zheng Zhu , Kaipeng Zhang , Wei Jiang , Yang You

Forecast combination integrates information from various sources by consolidating multiple forecast results from the target time series. Instead of the need to select a single optimal forecasting model, this paper introduces a deep learning…

Machine Learning · Computer Science 2023-11-27 Yinuo Ren , Feng Li , Yanfei Kang , Jue Wang

Many exact Markov chain Monte Carlo algorithms have been developed for posterior inference in Bayesian nonparametric models which involve infinite-dimensional priors. However, these methods are not generic and special methodology must be…

Computation · Statistics 2014-05-22 Jim E. Griffin

In this article we propose novel Bayesian nonparametric methods using Dirichlet Process Mixture (DPM) models for detecting pairwise dependence between random variables while accounting for uncertainty in the form of the underlying…

Methodology · Statistics 2016-04-28 Sarah Filippi , Chris C. Holmes , Luis E. Nieto-Barajas

Finite mixture models are flexible methods that are commonly used for model-based clustering. A recent focus in the model-based clustering literature is to highlight the difference between the number of components in a mixture model and the…

Methodology · Statistics 2023-08-03 Garritt L. Page , Massimo Ventrucci , Maria Franco-Villoria

We propose a method for estimating the posterior distribution of a standard geostatistical model. After choosing the model formulation and specifying a prior, we use normal mixture densities to approximate the posterior distribution. The…

Methodology · Statistics 2014-09-10 Zepu Zhang

In Bayesian statistics, many problems can be expressed as the evaluation of the expectation of a quantity of interest with respect to the posterior distribution. Standard Monte Carlo method is often not applicable because the encountered…

Computation · Statistics 2011-10-11 James L. Beck , Konstantin M. Zuev

We give a new integral characterization of the Dirichlet process on a general phase space. To do so we first prove a characterization of the nonsymmetric Beta distribution via size-biased sampling. Two applications are a new…

Probability · Mathematics 2018-04-02 Günter Last

Doubly intractable problems occur when both the likelihood and the posterior are available only in unnormalised form, with computationally intractable normalisation constants. Bayesian inference then typically requires direct approximation…

We propose a Bayesian nonparametric approach to the problem of jointly modeling multiple related time series. Our approach is based on the discovery of a set of latent, shared dynamical behaviors. Using a beta process prior, the size of the…

Methodology · Statistics 2011-11-21 Emily B. Fox , Erik B. Sudderth , Michael I. Jordan , Alan S. Willsky