English
Related papers

Related papers: Gamma Processes, Stick-Breaking, and Variational I…

200 papers

Bayesian models based on the Dirichlet process and other stick-breaking priors have been proposed as core ingredients for clustering, topic modeling, and other unsupervised learning tasks. Prior specification is, however, relatively…

Methodology · Statistics 2021-10-27 Ryan Giordano , Runjing Liu , Michael I. Jordan , Tamara Broderick

The beta-Bernoulli process provides a Bayesian nonparametric prior for models involving collections of binary-valued features. A draw from the beta process yields an infinite collection of probabilities in the unit interval, and a draw from…

Methodology · Statistics 2011-09-16 Tamara Broderick , Michael I. Jordan , Jim Pitman

Bayesian models based on the Dirichlet process and other stick-breaking priors have been proposed as core ingredients for clustering, topic modeling, and other unsupervised learning tasks. However, due to the flexibility of these models,…

Methodology · Statistics 2022-01-27 Ryan Giordano , Runjing Liu , Michael I. Jordan , Tamara Broderick

The nonparametric view of Bayesian inference has transformed statistics and many of its applications. The canonical Dirichlet process and other more general families of nonparametric priors have served as a gateway to solve frontier…

Statistics Theory · Mathematics 2025-05-13 José A. Perusquía , Mario Diaz , Ramsés H. Mena

We show that the stick-breaking construction of the beta process due to Paisley, et al. (2010) can be obtained from the characterization of the beta process as a Poisson process. Specifically, we show that the mean measure of the underlying…

Statistics Theory · Mathematics 2012-04-20 John Paisley , David Blei , Michael I. Jordan

We derive a construction of the beta process that allows for the atoms with significant measure to be drawn first. Our representation is based on an extension of the Sethuraman (1994) construction of the Dirichlet process, and therefore we…

Statistics Theory · Mathematics 2016-04-05 John Paisley , Michael I Jordan

A new class of nonparametric prior distributions, termed Beta-Binomial stick-breaking process, is proposed. By allowing the underlying length random variables to be dependent through a Beta marginals Markov chain, an appealing discrete…

Statistics Theory · Mathematics 2020-08-12 María F. Gil-Leyva , Ramsés H. Mena , Theodoros Nicoleris

Beta process is the standard nonparametric Bayesian prior for latent factor model. In this paper, we derive a structured mean-field variational inference algorithm for a beta process non-negative matrix factorization (NMF) model with…

Machine Learning · Statistics 2014-12-03 Dawen Liang , Matthew D. Hoffman

We introduce a new dynamical system for sequentially observed multivariate count data. This model is based on the gamma--Poisson construction---a natural choice for count data---and relies on a novel Bayesian nonparametric prior that ties…

Machine Learning · Statistics 2017-01-23 Aaron Schein , Mingyuan Zhou , Hanna Wallach

Markov chains provide a foundational framework for modeling sequential stochastic processes, with the transition probability matrix characterizing the dynamics of state evolution. While classical estimation methods such as maximum…

Methodology · Statistics 2025-07-11 Agamani Saha , Souvik Roy

When analyzing data from multiple sources, it is often convenient to strike a careful balance between two goals: capturing the heterogeneity of the samples and sharing information across them. We introduce a novel framework to model a…

Methodology · Statistics 2026-03-02 Laura D'Angelo , Bernardo Nipoti , Andrea Ongaro

We study a nonparametric Bayesian approach to estimation of the volatility function of a stochastic differential equation driven by a gamma process. The volatility function is modelled a priori as piecewise constant, and we specify a gamma…

Statistics Theory · Mathematics 2023-10-18 Denis Belomestny , Shota Gugushvili , Moritz Schauer , Peter Spreij

In this paper we introduce a novel framework for making exact nonparametric Bayesian inference on latent functions, that is particularly suitable for Big Data tasks. Firstly, we introduce a class of stochastic processes we refer to as…

Machine Learning · Statistics 2016-08-22 Yves-Laurent Kom Samo , Stephen Roberts

Stick-breaking has a long history and is one of the most popular procedures for constructing random discrete distributions in Statistics and Machine Learning. In particular, due to their intuitive construction and computational tractability…

Statistics Theory · Mathematics 2026-01-26 María F. Gil-Leyva , Antonio Lijoi , Ramsés H. Mena , Igor Prünster

In this paper we propose the first non-parametric Bayesian model using Gaussian Processes to make inference on Poisson Point Processes without resorting to gridding the domain or to introducing latent thinning points. Unlike competing…

Machine Learning · Statistics 2015-06-30 Yves-Laurent Kom Samo , Stephen Roberts

Dependent nonparametric processes extend distributions over measures, such as the Dirichlet process and the beta process, to give distributions over collections of measures, typically indexed by values in some covariate space. Such models…

Machine Learning · Statistics 2012-11-21 Nicholas J. Foti , Sinead Williamson

We present a non-parametric Bayesian latent variable model capable of learning dependency structures across dimensions in a multivariate setting. Our approach is based on flexible Gaussian process priors for the generative mappings and…

Machine Learning · Statistics 2018-07-16 Andrew R. Lawrence , Carl Henrik Ek , Neill D. F. Campbell

The gamma process is a natural model for monotonic degradation processes. In practice, it is desirable to extend the single gamma process to incorporate measurement error and to construct models for the degradation of several nominally…

Methodology · Statistics 2024-06-18 Ryan Leadbetter , Gabriel Gonzalez Caceres , Aloke Phatak

While stochastic variational inference is relatively well known for scaling inference in Bayesian probabilistic models, related methods also offer ways to circumnavigate the approximation of analytically intractable expectations. The key…

Machine Learning · Statistics 2015-09-08 David A. Knowles

A gamma process dynamic Poisson factor analysis model is proposed to factorize a dynamic count matrix, whose columns are sequentially observed count vectors. The model builds a novel Markov chain that sends the latent gamma random variables…

Machine Learning · Statistics 2015-12-31 Ayan Acharya , Joydeep Ghosh , Mingyuan Zhou
‹ Prev 1 2 3 10 Next ›