English
Related papers

Related papers: The combinatorial structure of beta negative binom…

200 papers

Beta process is the standard nonparametric Bayesian prior for latent factor model. In this paper, we derive a structured mean-field variational inference algorithm for a beta process non-negative matrix factorization (NMF) model with…

Machine Learning · Statistics 2014-12-03 Dawen Liang , Matthew D. Hoffman

We place an Indian Buffet process (IBP) prior over the structure of a Bayesian Neural Network (BNN), thus allowing the complexity of the BNN to increase and decrease automatically. We further extend this model such that the prior on the…

Machine Learning · Statistics 2021-08-03 Samuel Kessler , Vu Nguyen , Stefan Zohren , Stephen Roberts

We develop a new stochastic process called spatially-dependent Indian buffet processes (SIBP) for spatially correlated binary matrices and propose general spatial factor models for various multivariate response variables. We introduce…

Methodology · Statistics 2024-09-04 Shonosuke Sugasawa , Daichi Mochihashi

We build upon probabilistic models for Boolean Matrix and Boolean Tensor factorisation that have recently been shown to solve these problems with unprecedented accuracy and to enable posterior inference to scale to Billions of observation.…

Machine Learning · Statistics 2019-07-02 Tammo Rukat , Christopher Yau

One of the focal points of the modern literature on Bayesian nonparametrics has been the problem of clustering, or partitioning, where each data point is modeled as being associated with one and only one of some collection of groups called…

Statistics Theory · Mathematics 2013-10-02 Tamara Broderick , Michael I. Jordan , Jim Pitman

The Indian buffet process (IBP) and phylogenetic Indian buffet process (pIBP) can be used as prior models to infer latent features in a data set. The theoretical properties of these models are under-explored, however, especially in high…

Applications · Statistics 2019-09-23 Tong Li , Tianjian Zhou , Kam-Wah Tsui , Lin Wei , Yuan Ji

Latent feature models are widely used to decompose data into a small number of components. Bayesian nonparametric variants of these models, which use the Indian buffet process (IBP) as a prior over latent features, allow the number of…

Machine Learning · Statistics 2012-09-11 Samuel J. Gershman , Peter I. Frazier , David M. Blei

Bayesian nonparametric (BNP) models provide elegant methods for discovering underlying latent features within a data set, but inference in such models can be slow. We exploit the fact that completely random measures, which commonly used…

Machine Learning · Statistics 2020-07-17 Avinava Dubey , Michael Minyi Zhang , Eric P. Xing , Sinead A. Williamson

This paper presents a Bayesian nonparametric latent feature model specially suitable for exploratory analysis of high-dimensional count data. We perform a non-negative doubly sparse matrix factorization that has two main advantages: not…

Machine Learning · Computer Science 2018-07-02 Melanie F. Pradier , Viktor Stojkoski , Zoran Utkovski , Ljupco Kocarev , Fernando Perez-Cruz

Multi-output Gaussian processes have received increasing attention during the last few years as a natural mechanism to extend the powerful flexibility of Gaussian processes to the setup of multiple output variables. The key point here is…

Machine Learning · Statistics 2015-03-24 Cristian Guarnizo , Mauricio A. Álvarez

A nonparametric Bayesian extension of Factor Analysis (FA) is proposed where observed data $\mathbf{Y}$ is modeled as a linear superposition, $\mathbf{G}$, of a potentially infinite number of hidden factors, $\mathbf{X}$. The Indian Buffet…

Applications · Statistics 2011-07-29 David Knowles , Zoubin Ghahramani

Bayesian nonparametric hierarchical priors are highly effective in providing flexible models for latent data structures exhibiting sharing of information between and across groups. Most prominent is the Hierarchical Dirichlet Process (HDP),…

Statistics Theory · Mathematics 2021-03-23 Lancelot F. James , Juho Lee , Abhinav Pandey

Nonnegative Matrix Factorization (NMF) aims to factorize a matrix into two optimized nonnegative matrices appropriate for the intended applications. The method has been widely used for unsupervised learning tasks, including recommender…

Machine Learning · Statistics 2015-07-14 Junyu Xuan , Jie Lu , Guangquan Zhang , Richard Yi Da Xu , Xiangfeng Luo

A common approach to analyze a covariate-sample count matrix, an element of which represents how many times a covariate appears in a sample, is to factorize it under the Poisson likelihood. We show its limitation in capturing the tendency…

Methodology · Statistics 2017-10-06 Mingyuan Zhou

Analyzing multivariate time series data is important to predict future events and changes of complex systems in finance, manufacturing, and administrative decisions. The expressiveness power of Gaussian Process (GP) regression methods has…

Machine Learning · Statistics 2019-05-23 Anh Tong , Jaesik Choi

In this paper we use the framework of algebraic effects from programming language theory to analyze the Beta-Bernoulli process, a standard building block in Bayesian models. Our analysis reveals the importance of abstract data types, and…

Programming Languages · Computer Science 2018-09-11 Sam Staton , Dario Stein , Hongseok Yang , Nathanael L. Ackerman , Cameron E. Freer , Daniel M. Roy

We propose the attraction Indian buffet distribution (AIBD), a distribution for binary feature matrices influenced by pairwise similarity information. Binary feature matrices are used in Bayesian models to uncover latent variables (i.e.,…

Methodology · Statistics 2021-07-19 Richard L. Warr , David B. Dahl , Jeremy M. Meyer , Arthur Lui

The beta-Bernoulli process provides a Bayesian nonparametric prior for models involving collections of binary-valued features. A draw from the beta process yields an infinite collection of probabilities in the unit interval, and a draw from…

Methodology · Statistics 2011-09-16 Tamara Broderick , Michael I. Jordan , Jim Pitman

We investigate a class of feature allocation models that generalize the Indian buffet process and are parameterized by Gibbs-type random measures. Two existing classes are contained as special cases: the original two-parameter Indian buffet…

Machine Learning · Statistics 2019-11-12 Creighton Heaukulani , Daniel M. Roy

Modeling count-valued time series has been receiving increasing attention since count time series naturally arise in physical and social domains. Poisson gamma dynamical systems (PGDSs) are newly-developed methods, which can well capture…

Machine Learning · Computer Science 2024-03-01 Rui Huang , Sikun Yang , Heinz Koeppl