English
Related papers

Related papers: Learning Restricted Boltzmann Machines with Arbitr…

200 papers

This review deals with Restricted Boltzmann Machine (RBM) under the light of statistical physics. The RBM is a classical family of Machine learning (ML) models which played a central role in the development of deep learning. Viewing it as a…

Disordered Systems and Neural Networks · Physics 2023-07-17 Aurélien Decelle , Cyril Furtlehner

We set up Restricted Boltzmann Machines (RBM) to reproduce the Long Range Ising (LRI) models of the Ohmic type in one dimension. The RBM parameters are tuned by using the standard machine learning procedure with an additional method of…

Statistical Mechanics · Physics 2017-01-03 Ken-Ichi Aoki , Tamao Kobayashi

We are interested in exploring the possibility and benefits of structure learning for deep models. As the first step, this paper investigates the matter for Restricted Boltzmann Machines (RBMs). We conduct the study with Replicated Softmax,…

Machine Learning · Computer Science 2018-08-07 Zhourong Chen , Nevin L. Zhang , Dit-Yan Yeung , Peixian Chen

The restricted Boltzmann machine (RBM) is a flexible tool for modeling complex data, however there have been significant computational difficulties in using RBMs to model high-dimensional multinomial observations. In natural language…

Machine Learning · Computer Science 2012-07-06 George E. Dahl , Ryan P. Adams , Hugo Larochelle

Restricted Boltzmann Machine (RBM) is a particular type of random neural network models modeling vector data based on the assumption of Bernoulli distribution. For multi-dimensional and non-binary data, it is necessary to vectorize and…

Computer Vision and Pattern Recognition · Computer Science 2016-09-28 Simeng Liu , Yanfeng Sun , Yongli Hu , Junbin Gao , Baocai Yin

We consider the problem of discriminatively learning restricted Boltzmann machines in the presence of relational data. Unlike previous approaches that employ a rule learner (for structure learning) and a weight learner (for parameter…

Machine Learning · Computer Science 2020-01-29 Navdeep Kaur , Gautam Kunapuli , Sriraam Natarajan

In this study, a novel machine learning algorithm, restricted Boltzmann machine (RBM), is introduced. The algorithm is applied for the spectral classification in astronomy. RBM is a bipartite generative graphical model with two separate…

Machine Learning · Computer Science 2013-10-15 Fuqiang Chen , Yan Wu , Yude Bu , Guodong Zhao

Distributions of data or sensory stimuli often enjoy underlying invariances. How and to what extent those symmetries are captured by unsupervised learning methods is a relevant question in machine learning and in computational neuroscience.…

Disordered Systems and Neural Networks · Physics 2020-06-24 Moshir Harsh , Jérôme Tubiana , Simona Cocco , Remi Monasson

Restricted Boltzmann Machines (RBMs) are general unsupervised learning devices to ascertain generative models of data distributions. RBMs are often trained using the Contrastive Divergence learning algorithm (CD), an approximation to the…

Neural and Evolutionary Computing · Computer Science 2015-07-27 E. Romero , F. Mazzanti , J. Delgado

Statistical analysis of evolutionary-related protein sequences provides insights about their structure, function, and history. We show that Restricted Boltzmann Machines (RBM), designed to learn complex high-dimensional data and their…

Quantitative Methods · Quantitative Biology 2019-02-28 Jérôme Tubiana , Simona Cocco , Rémi Monasson

Restricted Boltzmann machines (RBMs) with low-precision synapses are much appealing with high energy efficiency. However, training RBMs with binary synapses is challenging due to the discrete nature of synapses. Recently Huang proposed one…

Machine Learning · Computer Science 2020-07-10 Xiangming Meng

Restricted Boltzmann machines (RBM) are generative models capable to learn data with a rich underlying structure. We study the teacher-student setting where a student RBM learns structured data generated by a teacher RBM. The amount of…

Machine Learning · Computer Science 2025-05-21 Robin Thériault , Francesco Tosello , Daniele Tantari

We define a message-passing algorithm for computing magnetizations in Restricted Boltzmann machines, which are Ising models on bipartite graphs introduced as neural network models for probability distributions over spin configurations. To…

Machine Learning · Computer Science 2020-12-02 Burak Çakmak , Manfred Opper

Restricted Boltzmann Machines (RBMs) are general unsupervised learning devices to ascertain generative models of data distributions. RBMs are often trained using the Contrastive Divergence learning algorithm (CD), an approximation to the…

Machine Learning · Computer Science 2014-04-10 David Buchaca , Enrique Romero , Ferran Mazzanti , Jordi Delgado

We present a mathematical construction for the restricted Boltzmann machine (RBM) that doesn't require specifying the number of hidden units. In fact, the hidden layer size is adaptive and can grow during training. This is obtained by first…

Machine Learning · Computer Science 2016-03-21 Marc-Alexandre Côté , Hugo Larochelle

A Gaussian restricted Boltzmann machine (GRBM) is a Boltzmann machine defined on a bipartite graph and is an extension of usual restricted Boltzmann machines. A GRBM consists of two different layers: a visible layer composed of continuous…

Machine Learning · Statistics 2016-03-21 Chako Takahashi , Muneki Yasuda

Conventional methods of estimating latent behaviour generally use attitudinal questions which are subjective and these survey questions may not always be available. We hypothesize that an alternative approach can be used for latent variable…

Machine Learning · Computer Science 2018-09-18 Melvin Wong , Bilal Farooq , Guillaume-Alexandre Bilodeau

Generative modeling with machine learning has provided a new perspective on the data-driven task of reconstructing quantum states from a set of qubit measurements. As increasingly large experimental quantum devices are built in…

Restricted Boltzmann machines are undirected neural networks which have been shown to be effective in many applications, including serving as initializations for training deep multi-layer neural networks. One of the main reasons for their…

Disordered Systems and Neural Networks · Physics 2016-02-11 Marylou Gabrié , Eric W. Tramel , Florent Krzakala

This study investigates the efficacy of Conditional Restricted Boltzmann Machines (CRBMs) for modeling high-dimensional financial time series and detecting systemic risk regimes. We extend the classical application of static Restricted…

Statistical Finance · Quantitative Finance 2026-01-01 Siddhartha Srinivas Rentala