English
Related papers

Related papers: Learning the Structure of Deep Sparse Graphical Mo…

200 papers

We present the Wright-Fisher Indian buffet process (WF-IBP), a probabilistic model for time-dependent data assumed to have been generated by an unknown number of latent features. This model is suitable as a prior in Bayesian nonparametric…

Machine Learning · Statistics 2016-11-23 Valerio Perrone , Paul A. Jenkins , Dario Spano , Yee Whye Teh

Analyzing multivariate time series data is important to predict future events and changes of complex systems in finance, manufacturing, and administrative decisions. The expressiveness power of Gaussian Process (GP) regression methods has…

Machine Learning · Statistics 2019-05-23 Anh Tong , Jaesik Choi

Modeling sparse count data, which arise across numerous scientific fields, presents significant statistical challenges. This chapter addresses these challenges in the context of infectious disease prediction, with a focus on predicting…

Machine Learning · Statistics 2026-02-05 Edwin Fong , Lancelot F. James , Juho Lee

Indian Buffet Process based models are an elegant way for discovering underlying features within a data set, but inference in such models can be slow. Inferring underlying features using Markov chain Monte Carlo either relies on an…

Machine Learning · Statistics 2017-03-13 Michael M. Zhang , Avinava Dubey , Sinead A. Williamson

We propose a non-linear, Bayesian non-parametric latent variable model where the latent space is assumed to be sparse and infinite dimensional a priori using an Indian buffet process prior. A posteriori, the number of instantiated…

Machine Learning · Statistics 2022-05-30 Michael Minyi Zhang

A nonparametric Bayesian extension of Factor Analysis (FA) is proposed where observed data $\mathbf{Y}$ is modeled as a linear superposition, $\mathbf{G}$, of a potentially infinite number of hidden factors, $\mathbf{X}$. The Indian Buffet…

Applications · Statistics 2011-07-29 David Knowles , Zoubin Ghahramani

We present the nested Chinese restaurant process (nCRP), a stochastic process which assigns probability distributions to infinitely-deep, infinitely-branching trees. We show how this stochastic process can be used as a prior distribution in…

Machine Learning · Statistics 2009-08-27 David M. Blei , Thomas L. Griffiths , Michael I. Jordan

Multi-output Gaussian processes have received increasing attention during the last few years as a natural mechanism to extend the powerful flexibility of Gaussian processes to the setup of multiple output variables. The key point here is…

Machine Learning · Statistics 2015-03-24 Cristian Guarnizo , Mauricio A. Álvarez

Contagion processes are strongly linked to the network structures on which they propagate, and learning these structures is essential for understanding and intervention on complex network processes such as epidemics and (mis)information…

Social and Information Networks · Computer Science 2019-08-12 Caitlin Gray , Lewis Mitchell , Matthew Roughan

Relational data-like graphs, networks, and matrices-is often dynamic, where the relational structure evolves over time. A fundamental problem in the analysis of time-varying network data is to extract a summary of the common structure and…

Social and Information Networks · Computer Science 2013-11-12 Myunghwan Kim , Jure Leskovec

Nonnegative Matrix Factorization (NMF) aims to factorize a matrix into two optimized nonnegative matrices appropriate for the intended applications. The method has been widely used for unsupervised learning tasks, including recommender…

Machine Learning · Statistics 2015-07-14 Junyu Xuan , Jie Lu , Guangquan Zhang , Richard Yi Da Xu , Xiangfeng Luo

Thanks to the availability of large scale digital datasets and massive amounts of computational power, deep learning algorithms can learn representations of data by exploiting multiple levels of abstraction. These machine learning methods…

Disordered Systems and Neural Networks · Physics 2018-10-01 Alberto Testolin , Michele Piccolini , Samir Suweis

Deep Learning has a hierarchical network architecture to represent the complicated feature of input patterns. The adaptive structural learning method of Deep Belief Network (DBN) has been developed. The method can discover an optimal number…

Neural and Evolutionary Computing · Computer Science 2018-08-28 Shin Kamada , Takumi Ichimura , Toshihide Harada

Traditional approaches to Bayes net structure learning typically assume little regularity in graph structure other than sparseness. However, in many cases, we expect more systematicity: variables in real-world systems often group into…

Machine Learning · Computer Science 2012-07-02 Vikash Mansinghka , Charles Kemp , Thomas Griffiths , Joshua Tenenbaum

DenseNets have been shown to be a competitive model among recent convolutional network architectures. These networks utilize Dense Blocks, which are groups of densely connected layers where the output of a hidden layer is fed in as the…

Computer Vision and Pattern Recognition · Computer Science 2018-08-28 Joseph Chuang , Eric Tsai , Kevin Huang , Jay Fetter

Bayesian structure learning allows inferring Bayesian network structure from data while reasoning about the epistemic uncertainty -- a key element towards enabling active causal discovery and designing interventions in real world systems.…

Machine Learning · Computer Science 2021-12-17 Lars Lorch , Jonas Rothfuss , Bernhard Schölkopf , Andreas Krause

A principled approach to characterize the hidden structure of networks is to formulate generative models, and then infer their parameters from data. When the desired structure is composed of modules or "communities", a suitable choice for…

Data Analysis, Statistics and Probability · Physics 2018-08-23 Tiago P. Peixoto

We present a differentiable approach to learn the probabilistic factors used for inference by a nonparametric belief propagation algorithm. Existing nonparametric belief propagation methods rely on domain-specific features encoded in the…

The framework of statistical inference has been successfully used to detect the meso-scale structures in complex networks, such as community structure, core-periphery (CP) structure. The main principle is that the stochastic block model…

Physics and Society · Physics 2018-08-29 Chuang Ma , Bing-Bing Xiang , Han-Shuang Chen , Hai-Feng Zhang

Deep NLP models benefit from underlying structures in the data---e.g., parse trees---typically extracted using off-the-shelf parsers. Recent attempts to jointly learn the latent structure encounter a tradeoff: either make factorization…

Computation and Language · Computer Science 2018-09-05 Vlad Niculae , André F. T. Martins , Claire Cardie