English
Related papers

Related papers: Emergence of Compositional Representations in Rest…

200 papers

Most accurate recommender systems are black-box models, hiding the reasoning behind their recommendations. Yet explanations have been shown to increase the user's trust in the system in addition to providing other benefits such as…

Machine Learning · Statistics 2016-06-24 Behnoush Abdollahi , Olfa Nasraoui

Restricted Boltzmann Machines (RBMs) are a class of generative neural network that are typically trained to maximize a log-likelihood objective function. We argue that likelihood-based training strategies may fail because the objective does…

Machine Learning · Statistics 2018-04-25 Charles K. Fisher , Aaron M. Smith , Jonathan R. Walsh

A restricted Boltzmann machine (RBM) learns a probability distribution over its input samples and has numerous uses like dimensionality reduction, classification and generative modeling. Conventional RBMs accept vectorized data that…

Computer Vision and Pattern Recognition · Computer Science 2018-11-13 Cong Chen , Kim Batselier , Ching-Yun Ko , Ngai Wong

A restricted Boltzmann machine (RBM) is a generative neural-network model with many novel applications such as collaborative filtering and acoustic modeling. An RBM lacks the capacity to retain memory, making it inappropriate for dynamic…

Machine Learning · Statistics 2018-05-01 Jefferson Hernandez , Andres G. Abad

The restricted Boltzmann machine (RBM) is a representative generative model based on the concept of statistical mechanics. In spite of the strong merit of interpretability, unavailability of backpropagation makes it less competitive than…

Computer Vision and Pattern Recognition · Computer Science 2020-11-30 Juno Hwang , Wonseok Hwang , Junghyo Jo

The possibility of employing restricted Boltzmann machine (RBM) for collaborative filtering has been known for about a decade. However, there has been hardly any work on this topic since 2007. This work revisits the application of RBM in…

Machine Learning · Computer Science 2019-10-18 Sagar Verma , Prince Patel , Angshul Majumdar

The restricted Boltzmann machine (RBM) is a neural network based on the Ising model, well known for its ability to learn probability distributions and stochastically generate new content. However, the high computational cost of Gibbs…

Optics · Physics 2026-03-13 Li Luo , Yisheng Fang , Wanyi Zhang , Zhichao Ruan

In this work, we introduce a new procedure for applying Restricted Boltzmann Machines (RBMs) to missing data inference tasks, based on linearization of the effective energy function governing the distribution of observations. We compare the…

Machine Learning · Computer Science 2019-10-22 Chris Cannella , Jie Ding , Mohammadreza Soltani , Vahid Tarokh

Restricted Boltzmann machine (RBM) provide a general framework for modeling physical systems, but their behavior is dependent on hyperparameters such as the learning rate, the number of hidden nodes and the form of the threshold function.…

Computational Physics · Physics 2020-04-28 David Yevick , Roger Melko

We propose a data-driven approach using a Restricted Boltzmann Machine (RBM) to solve the Schr\"odinger equation in configuration space. Traditional Configuration Interaction (CI) methods construct the wavefunction as a linear combination…

We consider restricted Boltzmann machines with a binary visible layer and a Gaussian hidden layer trained by an unlabelled dataset composed of noisy realizations of a single ground pattern. We develop a statistical mechanics framework to…

Disordered Systems and Neural Networks · Physics 2024-06-17 Alberto Fachechi , Elena Agliari , Miriam Aquaro , Anthony Coolen , Menno Mulder

Estimation of the large $Q$-matrix in Cognitive Diagnosis Models (CDMs) with many items and latent attributes from observational data has been a huge challenge due to its high computational cost. Borrowing ideas from deep learning…

Methodology · Statistics 2021-11-30 Chengcheng Li , Chenchen Ma , Gongjun Xu

Restricted Boltzmann machines (RBMs) are a class of neural networks that have been successfully employed as a variational ansatz for quantum many-body wave functions. Here, we develop an analytic method to study quantum many-body spin…

Quantum Physics · Physics 2022-10-06 Xiao-Qi Sun , Tamra Nebabu , Xizhi Han , Michael O. Flynn , Xiao-Liang Qi

We are interested in exploring the possibility and benefits of structure learning for deep models. As the first step, this paper investigates the matter for Restricted Boltzmann Machines (RBMs). We conduct the study with Replicated Softmax,…

Machine Learning · Computer Science 2018-08-07 Zhourong Chen , Nevin L. Zhang , Dit-Yan Yeung , Peixian Chen

The restricted Boltzmann machine is a basic machine learning tool able, in principle, to model the distribution of some arbitrary dataset. Its standard training procedure appears however delicate and obscure in many respects. We bring some…

Disordered Systems and Neural Networks · Physics 2021-11-18 Aurélien Decelle , Cyril Furtlehner

We consider the problem of classification when inputs correspond to sets of vectors. This setting occurs in many problems such as the classification of pieces of mail containing several pages, of web sites with several sections or of images…

Machine Learning · Computer Science 2011-03-28 Jérôme Louradour , Hugo Larochelle

The infinite restricted Boltzmann machine (iRBM) is an extension of the classic RBM. It enjoys a good property of automatically deciding the size of the hidden layer according to specific training data. With sufficient training, the iRBM…

Machine Learning · Computer Science 2018-07-30 Xuan Peng , Xunzhang Gao , Xiang Li

Estimation of Distribution Algorithms (EDAs) require flexible probability models that can be efficiently learned and sampled. Restricted Boltzmann Machines (RBMs) are generative neural networks with these desired properties. We integrate an…

Neural and Evolutionary Computing · Computer Science 2014-12-01 Malte Probst , Franz Rothlauf , Jörn Grahl

We consider a special type of Restricted Boltzmann machine (RBM), namely a Gaussian-spherical RBM where the visible units have Gaussian priors while the vector of hidden variables is constrained to stay on an ${\mathbbm L}_2$ sphere. The…

Disordered Systems and Neural Networks · Physics 2023-07-17 Aurélien Decelle , Cyril Furtlehner

Restricted Boltzmann Machines are simple yet powerful neural networks. They can be used for learning structure in data, and are used as a building block of more complex neural architectures. At the same time, their simplicity makes them…

Disordered Systems and Neural Networks · Physics 2025-01-09 Giovanni di Sarra , Barbara Bravi , Yasser Roudi