English
Related papers

Related papers: Mixed-Variate Restricted Boltzmann Machines

200 papers

A restricted Boltzmann machine (RBM) is a generative neural-network model with many novel applications such as collaborative filtering and acoustic modeling. An RBM lacks the capacity to retain memory, making it inappropriate for dynamic…

Machine Learning · Statistics 2018-05-01 Jefferson Hernandez , Andres G. Abad

Conditional Restricted Boltzmann Machines (CRBMs) are rich probabilistic models that have recently been applied to a wide range of problems, including collaborative filtering, classification, and modeling motion capture data. While much…

Machine Learning · Computer Science 2012-02-20 Volodymyr Mnih , Hugo Larochelle , Geoffrey E. Hinton

Restricted Boltzmann machines (RBM) and its variants have become hot research topics recently, and widely applied to many classification problems, such as character recognition and document categorization. Often, classification RBM ignores…

Machine Learning · Computer Science 2015-04-21 Gang Chen , Sargur H. Srihari

Datasets containing both categorical and continuous variables are frequently encountered in many areas, and with the rapid development of modern measurement technologies, the dimensions of these variables can be very high. Despite the…

Methodology · Statistics 2024-01-03 Binyan Jiang , Chenlei Leng , Cheng Wang , Zhongqing Yang , Xinyang Yu

The paper proposes a latent variable model for binary data coming from an unobserved heterogeneous population. The heterogeneity is taken into account by replacing the traditional assumption of Gaussian distributed factors by a finite…

Methodology · Statistics 2010-10-13 Silvia Cagnone , Cinzia Viroli

We consider the problem of classification when inputs correspond to sets of vectors. This setting occurs in many problems such as the classification of pieces of mail containing several pages, of web sites with several sections or of images…

Machine Learning · Computer Science 2011-03-28 Jérôme Louradour , Hugo Larochelle

Conventional methods of estimating latent behaviour generally use attitudinal questions which are subjective and these survey questions may not always be available. We hypothesize that an alternative approach can be used for latent variable…

Machine Learning · Computer Science 2018-09-18 Melvin Wong , Bilal Farooq , Guillaume-Alexandre Bilodeau

The Restricted Boltzmann Machine (RBM), an important tool used in machine learning in particular for unsupervized learning tasks, is investigated from the perspective of its spectral properties. Starting from empirical observations, we…

Disordered Systems and Neural Networks · Physics 2018-01-17 Aurélien Decelle , Giancarlo Fissore , Cyril Furtlehner

Marginally specified models have recently become a popular tool for discrete longitudinal data analysis. Nonetheless, they introduce complex constraint equations and model fitting algorithms. Moreover, there is a lack of available software…

Methodology · Statistics 2014-05-15 Ozgur Asar , Ozlem Ilk

The restricted Boltzmann machine (RBM) is a flexible tool for modeling complex data, however there have been significant computational difficulties in using RBMs to model high-dimensional multinomial observations. In natural language…

Machine Learning · Computer Science 2012-07-06 George E. Dahl , Ryan P. Adams , Hugo Larochelle

In a standard multi-output classification scenario, both features and labels of training data are partially observed. This challenging issue is widely witnessed due to sensor or database failures, crowd-sourcing and noisy communication…

Machine Learning · Computer Science 2019-12-20 Giancarlo Fissore , Aurélien Decelle , Cyril Furtlehner , Yufei Han

Restricted Boltzmann Machines (RBMs) offer a versatile architecture for unsupervised machine learning that can in principle approximate any target probability distribution with arbitrary accuracy. However, the RBM model is usually not…

Machine Learning · Computer Science 2022-09-27 Lennart Dabelow , Masahito Ueda

A Restricted Boltzmann Machine (RBM) is an unsupervised machine-learning bipartite graphical model that jointly learns a probability distribution over data and extracts their relevant statistical features. As such, RBM were recently…

Machine Learning · Computer Science 2019-02-19 Jérôme Tubiana , Simona Cocco , Rémi Monasson

We propose a method for obtaining maximum likelihood estimates in a model with continuous and binary outcomes. Combinations of left and right censored observations are also naturally modeled in this framework. The model and estimation…

Methodology · Statistics 2015-07-07 Klaus K. Holst , Esben Budtz-Jørgensen , Gitte Moos Knudsen

In this study, a novel machine learning algorithm, restricted Boltzmann machine (RBM), is introduced. The algorithm is applied for the spectral classification in astronomy. RBM is a bipartite generative graphical model with two separate…

Machine Learning · Computer Science 2013-10-15 Fuqiang Chen , Yan Wu , Yude Bu , Guodong Zhao

We propose a new method for multivariate response regression and covariance estimation when elements of the response vector are of mixed types, for example some continuous and some discrete. Our method is based on a model which assumes the…

Methodology · Statistics 2022-03-04 Karl Oskar Ekvall , Aaron J. Molstad

We present a theoretical analysis of Gaussian-binary restricted Boltzmann machines (GRBMs) from the perspective of density models. The key aspect of this analysis is to show that GRBMs can be formulated as a constrained mixture of…

Neural and Evolutionary Computing · Computer Science 2017-02-06 Nan Wang , Jan Melchior , Laurenz Wiskott

Building a good generative model for image has long been an important topic in computer vision and machine learning. Restricted Boltzmann machine (RBM) is one of such models that is simple but powerful. However, its restricted form also has…

Machine Learning · Computer Science 2016-11-24 Hengyuan Hu , Lisheng Gao , Quanbin Ma

This review deals with Restricted Boltzmann Machine (RBM) under the light of statistical physics. The RBM is a classical family of Machine learning (ML) models which played a central role in the development of deep learning. Viewing it as a…

Disordered Systems and Neural Networks · Physics 2023-07-17 Aurélien Decelle , Cyril Furtlehner

The possibility of employing restricted Boltzmann machine (RBM) for collaborative filtering has been known for about a decade. However, there has been hardly any work on this topic since 2007. This work revisits the application of RBM in…

Machine Learning · Computer Science 2019-10-18 Sagar Verma , Prince Patel , Angshul Majumdar