English
Related papers

Related papers: Gaussian-binary Restricted Boltzmann Machines on M…

200 papers

Restricted Boltzmann machines (RBMs) with low-precision synapses are much appealing with high energy efficiency. However, training RBMs with binary synapses is challenging due to the discrete nature of synapses. Recently Huang proposed one…

Machine Learning · Computer Science 2020-07-10 Xiangming Meng

The restricted Boltzmann machine (RBM) is a representative generative model based on the concept of statistical mechanics. In spite of the strong merit of interpretability, unavailability of backpropagation makes it less competitive than…

Computer Vision and Pattern Recognition · Computer Science 2020-11-30 Juno Hwang , Wonseok Hwang , Junghyo Jo

The infinite restricted Boltzmann machine (iRBM) is an extension of the classic RBM. It enjoys a good property of automatically deciding the size of the hidden layer according to specific training data. With sufficient training, the iRBM…

Machine Learning · Computer Science 2018-07-30 Xuan Peng , Xunzhang Gao , Xiang Li

Conditional generative models are capable of using contextual information as input to create new imaginative outputs. Conditional Restricted Boltzmann Machines (CRBMs) are one class of conditional generative models that have proven to be…

Machine Learning · Computer Science 2023-05-16 Alex H. Lang , Anton D. Loukianov , Charles K. Fisher

Restricted Boltzmann machines (RBM) and deep Boltzmann machines (DBM) are important models in machine learning, and recently found numerous applications in quantum many-body physics. We show that there are fundamental connections between…

Statistical Mechanics · Physics 2021-09-01 Sujie Li , Feng Pan , Pengfei Zhou , Pan Zhang

Restricted Boltzmann Machines (RBMs) are a common family of undirected graphical models with latent variables. An RBM is described by a bipartite graph, with all observed variables in one layer and all latent variables in the other. We…

Machine Learning · Computer Science 2020-10-20 Guy Bresler , Rares-Darius Buhai

Restricted Boltzmann Machines (RBMs) are one of the fundamental building blocks of deep learning. Approximate maximum likelihood training of RBMs typically necessitates sampling from these models. In many training scenarios, computationally…

Machine Learning · Computer Science 2014-10-02 Guillaume Desjardins , Heng Luo , Aaron Courville , Yoshua Bengio

Restricted Boltzmann machines (RBMs) are a powerful class of generative models, but their training requires computing a gradient that, unlike supervised backpropagation on typical loss functions, is notoriously difficult even to…

Machine Learning · Computer Science 2020-11-03 Haik Manukian , Yan Ru Pei , Sean R. B. Bearden , Massimiliano Di Ventra

Generative models offer a direct way of modeling complex data. Energy-based models attempt to encode the statistical correlations observed in the data at the level of the Boltzmann weight associated with an energy function in the form of a…

Disordered Systems and Neural Networks · Physics 2024-04-10 Aurélien Decelle , Cyril Furtlehner , Alfonso De Jesus Navas Gómez , Beatriz Seoane

The restricted Boltzmann machine (RBM) is a neural network based on the Ising model, well known for its ability to learn probability distributions and stochastically generate new content. However, the high computational cost of Gibbs…

Optics · Physics 2026-03-13 Li Luo , Yisheng Fang , Wanyi Zhang , Zhichao Ruan

We present transductive Boltzmann machines (TBMs), which firstly achieve transductive learning of the Gibbs distribution. While exact learning of the Gibbs distribution is impossible by the family of existing Boltzmann machines due to…

Machine Learning · Statistics 2018-05-22 Mahito Sugiyama , Koji Tsuda , Hiroyuki Nakahara

Restricted Boltzmann Machines (RBM) are bi-layer neural networks used for the unsupervised learning of model distributions from data. The bipartite architecture of RBM naturally defines an elegant sampling procedure, called Alternating…

Disordered Systems and Neural Networks · Physics 2021-10-27 Clément Roussel , Simona Cocco , Rémi Monasson

Restricted Boltzmann machines (RBMs) are powerful machine learning models, but learning and some kinds of inference in the model require sampling-based approximations, which, in classical digital computers, are implemented using expensive…

Machine Learning · Statistics 2014-10-27 Vincent Dumoulin , Ian J. Goodfellow , Aaron Courville , Yoshua Bengio

Restricted Boltzmann Machines are key tools in Machine Learning and are described by the energy function of bipartite spin-glasses. From a statistical mechanical perspective, they share the same Gibbs measure of Hopfield networks for…

Mathematical Physics · Physics 2017-08-02 Elena Agliari , Adriano Barra , Chiara Longo , Daniele Tantari

Classification of sequence data is the topic of interest for dynamic Bayesian models and Recurrent Neural Networks (RNNs). While the former can explicitly model the temporal dependencies between class variables, the latter have a capability…

Machine Learning · Computer Science 2018-03-12 Son N. Tran , Srikanth Cherla , Artur Garcez , Tillman Weyde

Restricted Boltzmann Machines are simple yet powerful neural networks. They can be used for learning structure in data, and are used as a building block of more complex neural architectures. At the same time, their simplicity makes them…

Disordered Systems and Neural Networks · Physics 2025-01-09 Giovanni di Sarra , Barbara Bravi , Yasser Roudi

A Restricted Boltzmann Machine (RBM) is an unsupervised machine-learning bipartite graphical model that jointly learns a probability distribution over data and extracts their relevant statistical features. As such, RBM were recently…

Machine Learning · Computer Science 2019-02-19 Jérôme Tubiana , Simona Cocco , Rémi Monasson

Restricted Boltzmann Machines (RBMs) are general unsupervised learning devices to ascertain generative models of data distributions. RBMs are often trained using the Contrastive Divergence learning algorithm (CD), an approximation to the…

Machine Learning · Computer Science 2014-04-10 David Buchaca , Enrique Romero , Ferran Mazzanti , Jordi Delgado

Generative modeling with machine learning has provided a new perspective on the data-driven task of reconstructing quantum states from a set of qubit measurements. As increasingly large experimental quantum devices are built in…

Modern datasets are becoming heterogeneous. To this end, we present in this paper Mixed-Variate Restricted Boltzmann Machines for simultaneously modelling variables of multiple types and modalities, including binary and continuous…

Machine Learning · Statistics 2014-08-07 Truyen Tran , Dinh Phung , Svetha Venkatesh