English
Related papers

Related papers: Restricted Boltzmann Machines: Introduction and Re…

200 papers

We propose a novel quantum model for the restricted Boltzmann machine (RBM), in which the visible units remain classical whereas the hidden units are quantized as noninteracting fermions. The free motion of the fermions is parametrically…

Disordered Systems and Neural Networks · Physics 2021-02-15 Ya. S. Lyakhova , E. A. Polyakov , A. N. Rubtsov

Modern datasets are becoming heterogeneous. To this end, we present in this paper Mixed-Variate Restricted Boltzmann Machines for simultaneously modelling variables of multiple types and modalities, including binary and continuous…

Machine Learning · Statistics 2014-08-07 Truyen Tran , Dinh Phung , Svetha Venkatesh

Finding suitable features has been an essential problem in computer vision. We focus on Restricted Boltzmann Machines (RBMs), which, despite their versatility, cannot accommodate transformations that may occur in the scene. As a result,…

Computer Vision and Pattern Recognition · Computer Science 2016-11-15 Mario Valerio Giuffrida , Sotirios A. Tsaftaris

We consider restricted Boltzmann machines with a binary visible layer and a Gaussian hidden layer trained by an unlabelled dataset composed of noisy realizations of a single ground pattern. We develop a statistical mechanics framework to…

Disordered Systems and Neural Networks · Physics 2024-06-17 Alberto Fachechi , Elena Agliari , Miriam Aquaro , Anthony Coolen , Menno Mulder

Hopfield networks (HNs) and Restricted Boltzmann Machines (RBMs) are two important models at the interface of statistical physics, machine learning, and neuroscience. Recently, there has been interest in the relationship between HNs and…

Machine Learning · Computer Science 2021-03-09 Matthew Smart , Anton Zilman

Restricted Boltzmann Machines (RBM) are simple statistical models defined on a bipartite graph which have been successfully used in studying more complicated many-body systems, both classical and quantum. In this work, we exploit the…

Nuclear Theory · Physics 2021-01-13 Ermal Rrapaj , Alessandro Roggero

The Boltzmann Machine (BM) is a neural network composed of stochastically firing neurons that can learn complex probability distributions by adapting the synaptic interactions between the neurons. BMs represent a very generic class of…

Mesoscale and Nanoscale Physics · Physics 2021-09-16 Brian Kiraly , Elze J. Knol , Hilbert J. Kappen , Alexander A. Khajetoorians

Restricted Boltzmann machine (RBM) provide a general framework for modeling physical systems, but their behavior is dependent on hyperparameters such as the learning rate, the number of hidden nodes and the form of the threshold function.…

Computational Physics · Physics 2020-04-28 David Yevick , Roger Melko

In this study, a novel machine learning algorithm, restricted Boltzmann machine (RBM), is introduced. The algorithm is applied for the spectral classification in astronomy. RBM is a bipartite generative graphical model with two separate…

Machine Learning · Computer Science 2013-10-15 Fuqiang Chen , Yan Wu , Yude Bu , Guodong Zhao

We review Boltzmann machines and energy-based models. A Boltzmann machine defines a probability distribution over binary-valued patterns. One can learn parameters of a Boltzmann machine via gradient based approaches in a way that log…

Neural and Evolutionary Computing · Computer Science 2019-01-21 Takayuki Osogami

The restricted Boltzmann machine (RBM) is a flexible tool for modeling complex data, however there have been significant computational difficulties in using RBMs to model high-dimensional multinomial observations. In natural language…

Machine Learning · Computer Science 2012-07-06 George E. Dahl , Ryan P. Adams , Hugo Larochelle

Restricted Boltzmann Machines (RBMs) are well-known tools used in Machine Learning to learn probability distribution functions from data. We analyse RBMs with scalar fields on the nodes from the perspective of lattice field theory. Starting…

High Energy Physics - Lattice · Physics 2024-03-04 Gert Aarts , Biagio Lucini , Chanju Park

Restricted Boltzmann machines (RBMs) are endowed with the universal power of modeling (binary) joint distributions. Meanwhile, as a result of their confining network structure, training RBMs confronts less difficulties (compared with more…

Machine Learning · Computer Science 2015-10-22 Sai Zhang

We define a message-passing algorithm for computing magnetizations in Restricted Boltzmann machines, which are Ising models on bipartite graphs introduced as neural network models for probability distributions over spin configurations. To…

Machine Learning · Computer Science 2020-12-02 Burak Çakmak , Manfred Opper

Generative models offer a direct way of modeling complex data. Energy-based models attempt to encode the statistical correlations observed in the data at the level of the Boltzmann weight associated with an energy function in the form of a…

Disordered Systems and Neural Networks · Physics 2024-04-10 Aurélien Decelle , Cyril Furtlehner , Alfonso De Jesus Navas Gómez , Beatriz Seoane

The deep Boltzmann machine (DBM) has been an important development in the quest for powerful "deep" probabilistic models. To date, simultaneous or joint training of all layers of the DBM has been largely unsuccessful with existing training…

Neural and Evolutionary Computing · Computer Science 2012-03-21 Guillaume Desjardins , Aaron Courville , Yoshua Bengio

Many computer vision applications involve modeling complex spatio-temporal patterns in high-dimensional motion data. Recently, restricted Boltzmann machines (RBMs) have been widely used to capture and represent spatial patterns in a single…

Computer Vision and Pattern Recognition · Computer Science 2017-10-24 Siqi Nie , Ziheng Wang , Qiang Ji

Restricted Boltzmann machines (RBMs) and their variants are usually trained by contrastive divergence (CD) learning, but the training procedure is an unsupervised learning approach, without any guidances of the background knowledge. To…

Machine Learning · Computer Science 2018-12-06 Jielei Chu , Hongjun Wang , Hua Meng , Peng Jin , Tianrui Li

The restricted Boltzmann machine (RBM) is a two-layer energy-based model that uses its hidden-visible connections to learn the underlying distribution of visible units, whose interactions are often complicated by high-order correlations.…

Statistical Mechanics · Physics 2022-12-07 Jing Gu , Kai Zhang

Large-scale electrophysiological recordings now allow simultaneous monitoring of thousands of neurons across multiple brain regions, revealing structured variability in neural population activity. Understanding how these collective patterns…

Neurons and Cognition · Quantitative Biology 2026-03-12 Nicolas Béreux , Giovanni Catania , Aurélien Decelle , Francesca Mignacco , Alfonso de Jesús Navas Gómez , Beatriz Seoane