English
Related papers

Related papers: The convergent Indian buffet process

200 papers

A nonparametric Bayesian extension of Factor Analysis (FA) is proposed where observed data $\mathbf{Y}$ is modeled as a linear superposition, $\mathbf{G}$, of a potentially infinite number of hidden factors, $\mathbf{X}$. The Indian Buffet…

Applications · Statistics 2011-07-29 David Knowles , Zoubin Ghahramani

We place an Indian Buffet process (IBP) prior over the structure of a Bayesian Neural Network (BNN), thus allowing the complexity of the BNN to increase and decrease automatically. We further extend this model such that the prior on the…

Machine Learning · Statistics 2021-08-03 Samuel Kessler , Vu Nguyen , Stefan Zohren , Stephen Roberts

Feature allocation models are popular models used in different applications such as unsupervised learning or network modeling. In particular, the Indian buffet process is a flexible and simple one-parameter feature allocation model where…

Machine Learning · Statistics 2020-03-31 Giuseppe Di Benedetto , François Caron , Yee Whye Teh

We investigate a class of feature allocation models that generalize the Indian buffet process and are parameterized by Gibbs-type random measures. Two existing classes are contained as special cases: the original two-parameter Indian buffet…

Machine Learning · Statistics 2019-11-12 Creighton Heaukulani , Daniel M. Roy

Naively trained neural networks tend to experience catastrophic forgetting in sequential task settings, where data from previous tasks are unavailable. A number of methods, using various model expansion strategies, have been proposed…

Machine Learning · Computer Science 2021-04-29 Nikhil Mehta , Kevin J Liang , Vinay K Verma , Lawrence Carin

The three-parameter Indian buffet process is generalized. The possibly different role played by customers is taken into account by suitable (random) weights. Various limit theorems are also proved for such generalized Indian buffet process.…

Probability · Mathematics 2015-03-18 Patrizia Berti , Irene Crimaldi , Luca Pratelli , Pietro Rigo

Deep generative models (DGMs) have brought about a major breakthrough, as well as renewed interest, in generative latent variable models. However, DGMs do not allow for performing data-driven inference of the number of latent features…

Machine Learning · Computer Science 2018-04-03 Sotirios P. Chatzis

We characterize the combinatorial structure of conditionally-i.i.d. sequences of negative binomial processes with a common beta process base measure. In Bayesian nonparametric applications, such processes have served as models for latent…

Statistics Theory · Mathematics 2016-06-24 Creighton Heaukulani , Daniel M. Roy

The analysis of comorbidity is an open and complex research field in the branch of psychiatry, where clinical experience and several studies suggest that the relation among the psychiatric disorders may have etiological and treatment…

Machine Learning · Statistics 2014-01-30 Francisco J. R. Ruiz , Isabel Valera , Carlos Blanco , Fernando Perez-Cruz

A collaborative filtering recommender system predicts user preferences by discovering common features among users and items. We implement such inference using a Bayesian double feature allocation model, that is, a model for random pairs of…

Methodology · Statistics 2022-02-03 Qiaohui Lin , Peter Mueller

We propose a nonparametric Bayesian factor regression model that accounts for uncertainty in the number of factors, and the relationship between factors. To accomplish this, we propose a sparse variant of the Indian Buffet Process and…

Machine Learning · Computer Science 2009-08-06 Piyush Rai , Hal Daumé

In many applications, observed data are influenced by some combination of latent causes. For example, suppose sensors are placed inside a building to record responses such as temperature, humidity, power consumption and noise levels. These…

Machine Learning · Statistics 2020-07-16 Sinead A. Williamson , Michael Minyi Zhang , Paul Damien

Bayesian nonparametric (BNP) models provide elegant methods for discovering underlying latent features within a data set, but inference in such models can be slow. We exploit the fact that completely random measures, which commonly used…

Machine Learning · Statistics 2020-07-17 Avinava Dubey , Michael Minyi Zhang , Eric P. Xing , Sinead A. Williamson

One of the focal points of the modern literature on Bayesian nonparametrics has been the problem of clustering, or partitioning, where each data point is modeled as being associated with one and only one of some collection of groups called…

Statistics Theory · Mathematics 2013-10-02 Tamara Broderick , Michael I. Jordan , Jim Pitman

Multi-output Gaussian processes have received increasing attention during the last few years as a natural mechanism to extend the powerful flexibility of Gaussian processes to the setup of multiple output variables. The key point here is…

Machine Learning · Statistics 2015-03-24 Cristian Guarnizo , Mauricio A. Álvarez

Nonparametric Bayesian models are often based on the assumption that the objects being modeled are exchangeable. While appropriate in some applications (e.g., bag-of-words models for documents), exchangeability is sometimes assumed simply…

Machine Learning · Computer Science 2012-06-18 Kurt T. Miller , Thomas Griffiths , Michael I. Jordan

Distributions over exchangeable matrices with infinitely many columns, such as the Indian buffet process, are useful in constructing nonparametric latent variable models. However, the distribution implied by such models over the number of…

Methodology · Statistics 2012-09-07 Sinead Williamson , Zoubin Ghahramani , Steven N. MacEachern , Eric P. Xing

Modeling sparse count data, which arise across numerous scientific fields, presents significant statistical challenges. This chapter addresses these challenges in the context of infectious disease prediction, with a focus on predicting…

Machine Learning · Statistics 2026-02-05 Edwin Fong , Lancelot F. James , Juho Lee

We introduce an Indian-buffet-type model for multi-factorial innovation in which each arriving agent may exhibit both previously observed and new features. The number of new features follows a power-law behavior, while the probability of…

Statistics Theory · Mathematics 2026-05-29 Giacomo Aletti , Irene Crimaldi , Andrea Ghiglietti

Indian Buffet Process based models are an elegant way for discovering underlying features within a data set, but inference in such models can be slow. Inferring underlying features using Markov chain Monte Carlo either relies on an…

Machine Learning · Statistics 2017-03-13 Michael M. Zhang , Avinava Dubey , Sinead A. Williamson