English
Related papers

Related papers: On better training the infinite restricted Boltzma…

200 papers

Restricted Boltzmann Machines (RBMs) and models derived from them have been successfully used as basic building blocks in deep artificial neural networks for automatic features extraction, unsupervised weights initialization, but also as…

Neural and Evolutionary Computing · Computer Science 2016-07-20 Decebal Constantin Mocanu , Elena Mocanu , Phuong H. Nguyen , Madeleine Gibescu , Antonio Liotta

Learning invariant representations is a critical task in computer vision. In this paper, we propose the Theta-Restricted Boltzmann Machine ({\theta}-RBM in short), which builds upon the original RBM formulation and injects the notion of…

Computer Vision and Pattern Recognition · Computer Science 2016-06-30 Mario Valerio Giuffrida , Sotirios A. Tsaftaris

Restricted Boltzmann Machines (RBMs) are a common family of undirected graphical models with latent variables. An RBM is described by a bipartite graph, with all observed variables in one layer and all latent variables in the other. We…

Machine Learning · Computer Science 2020-10-20 Guy Bresler , Rares-Darius Buhai

Restricted Boltzmann machines are undirected neural networks which have been shown to be effective in many applications, including serving as initializations for training deep multi-layer neural networks. One of the main reasons for their…

Disordered Systems and Neural Networks · Physics 2016-02-11 Marylou Gabrié , Eric W. Tramel , Florent Krzakala

Generative modeling with machine learning has provided a new perspective on the data-driven task of reconstructing quantum states from a set of qubit measurements. As increasingly large experimental quantum devices are built in…

Understanding the representational power of Restricted Boltzmann Machines (RBMs) with multiple layers is an ill-understood problem and is an area of active research. Motivated from the approach of \emph{Inherent Structure formalism}…

Machine Learning · Statistics 2018-06-13 Abhishek Bansal , Abhinav Anand , Chiranjib Bhattacharyya

We present a theoretical analysis of Gaussian-binary restricted Boltzmann machines (GRBMs) from the perspective of density models. The key aspect of this analysis is to show that GRBMs can be formulated as a constrained mixture of…

Neural and Evolutionary Computing · Computer Science 2017-02-06 Nan Wang , Jan Melchior , Laurenz Wiskott

Restricted Boltzmann machines (RBM) and deep Boltzmann machines (DBM) are important models in machine learning, and recently found numerous applications in quantum many-body physics. We show that there are fundamental connections between…

Statistical Mechanics · Physics 2021-09-01 Sujie Li , Feng Pan , Pengfei Zhou , Pan Zhang

Restricted Boltzmann Machines are generative models that consist of a layer of hidden variables connected to another layer of visible units, and they are used to model the distribution over visible variables. In order to gain a higher…

Computer Vision and Pattern Recognition · Computer Science 2023-06-20 Arkaitz Bidaurrazaga , Aritz Pérez , Roberto Santana

Restricted Boltzmann Machines (RBMs) are generative models which can learn useful representations from samples of a dataset in an unsupervised fashion. They have been widely employed as an unsupervised pre-training method in machine…

Machine Learning · Statistics 2013-09-13 Chris Häusler , Alex Susemihl , Martin P Nawrot , Manfred Opper

We propose a new approach to combine Restricted Boltzmann Machines (RBMs) that can be used to solve combinatorial optimization problems. This allows synthesis of larger models from smaller RBMs that have been pretrained, thus effectively…

Machine Learning · Computer Science 2019-09-10 Saavan Patel , Sayeef Salahuddin

The possibility of employing restricted Boltzmann machine (RBM) for collaborative filtering has been known for about a decade. However, there has been hardly any work on this topic since 2007. This work revisits the application of RBM in…

Machine Learning · Computer Science 2019-10-18 Sagar Verma , Prince Patel , Angshul Majumdar

We developed an adaptive structure learning method of Restricted Boltzmann Machine (RBM) which can generate/annihilate neurons by self-organizing learning method according to input patterns. Moreover, the adaptive Deep Belief Network (DBN)…

Neural and Evolutionary Computing · Computer Science 2018-07-12 Shin Kamada , Takumi Ichimura

Understanding the results of deep neural networks is an essential step towards wider acceptance of deep learning algorithms. Many approaches address the issue of interpreting artificial neural networks, but often provide divergent…

Machine Learning · Computer Science 2021-11-16 Vadim Borisov , Johannes Meier , Johan van den Heuvel , Hamed Jalali , Gjergji Kasneci

A specific type of neural network, the Restricted Boltzmann Machine (RBM), is implemented for classification and feature detection in machine learning. RBM is characterized by separate layers of visible and hidden units, which are able to…

Disordered Systems and Neural Networks · Physics 2012-01-11 Adriano Barra , Alberto Bernacchia , Enrica Santucci , Pierluigi Contucci

Restricted Boltzmann Machine (RBM) is a generative stochastic neural network that can be applied to collaborative filtering technique used by recommendation systems. Prediction accuracy of the RBM model is usually better than that of other…

Machine Learning · Computer Science 2019-10-16 Pei Yang , Srinivas Varadharajan , Lucas A. Wilson , Don D. Smith , John A Lockman , Vineet Gundecha , Quy Ta

The subspace Restricted Boltzmann Machine (subspaceRBM) is a third-order Boltzmann machine where multiplicative interactions are between one visible and two hidden units. There are two kinds of hidden units, namely, gate units and subspace…

Machine Learning · Computer Science 2014-07-17 Jakub M. Tomczak , Adam Gonczarek

The restricted Boltzmann machine (RBM) is a two-layer energy-based model that uses its hidden-visible connections to learn the underlying distribution of visible units, whose interactions are often complicated by high-order correlations.…

Statistical Mechanics · Physics 2022-12-07 Jing Gu , Kai Zhang

Restricted Boltzmann Machines (RBMs) are powerful tools for modeling complex systems and extracting insights from data, but their training is hindered by the slow mixing of Markov Chain Monte Carlo (MCMC) processes, especially with highly…

Machine Learning · Computer Science 2025-12-09 Nicolas Béreux , Aurélien Decelle , Cyril Furtlehner , Lorenzo Rosset , Beatriz Seoane

Graphical models are powerful tools for modeling high-dimensional data, but learning graphical models in the presence of latent variables is well-known to be difficult. In this work we give new results for learning Restricted Boltzmann…

Machine Learning · Computer Science 2020-07-28 Surbhi Goel , Adam Klivans , Frederic Koehler