English
Related papers

Related papers: Nonnegative Restricted Boltzmann Machines for Part…

200 papers

We study the problem of learning graphical models with latent variables. We give the first algorithm for learning locally consistent (ferromagnetic or antiferromagnetic) Restricted Boltzmann Machines (or RBMs) with {\em arbitrary} external…

Machine Learning · Computer Science 2019-06-18 Surbhi Goel

Restricted Boltzmann machines~(RBMs) and conditional RBMs~(CRBMs) are popular models for a wide range of applications. In previous work, learning on such models has been dominated by contrastive divergence~(CD) and its variants. Belief…

Machine Learning · Computer Science 2017-03-06 Wei Ping , Alexander Ihler

We present a novel theoretical result that generalises the Discriminative Restricted Boltzmann Machine (DRBM). While originally the DRBM was defined assuming the {0, 1}-Bernoulli distribution in each of its hidden units, this result makes…

Machine Learning · Computer Science 2016-04-08 Srikanth Cherla , Son N Tran , Tillman Weyde , Artur d'Avila Garcez

Restricted Boltzmann machines are undirected neural networks which have been shown to be effective in many applications, including serving as initializations for training deep multi-layer neural networks. One of the main reasons for their…

Disordered Systems and Neural Networks · Physics 2016-02-11 Marylou Gabrié , Eric W. Tramel , Florent Krzakala

Restricted Boltzmann machines (RBMs) and their variants are usually trained by contrastive divergence (CD) learning, but the training procedure is an unsupervised learning approach, without any guidances of the background knowledge. To…

Machine Learning · Computer Science 2018-12-06 Jielei Chu , Hongjun Wang , Hua Meng , Peng Jin , Tianrui Li

Generative modeling with machine learning has provided a new perspective on the data-driven task of reconstructing quantum states from a set of qubit measurements. As increasingly large experimental quantum devices are built in…

The Gaussian-Bernoulli restricted Boltzmann machine (GB-RBM) is a useful generative model that captures meaningful features from the given $n$-dimensional continuous data. The difficulties associated with learning GB-RBM are reported…

Machine Learning · Computer Science 2021-02-15 Vidyadhar Upadhya , P S Sastry

Restricted Boltzmann Machines (RBMs) and Deep Belief Networks have been demonstrated to perform efficiently in a variety of applications, such as dimensionality reduction, feature learning, and classification. Their implementation on…

Neural and Evolutionary Computing · Computer Science 2015-11-17 Emre Neftci , Srinjoy Das , Bruno Pedroni , Kenneth Kreutz-Delgado , Gert Cauwenberghs

Estimation of Distribution Algorithms (EDAs) require flexible probability models that can be efficiently learned and sampled. Deep Boltzmann Machines (DBMs) are generative neural networks with these desired properties. We integrate a DBM…

Neural and Evolutionary Computing · Computer Science 2016-08-09 Malte Probst , Franz Rothlauf

The estimation of probability density functions is a non trivial task that over the last years has been tackled with machine learning techniques. Successful applications can be obtained using models inspired by the Boltzmann machine (BM)…

Machine Learning · Statistics 2024-01-15 Andrea Pasquale , Daniel Krefl , Stefano Carrazza , Frank Nielsen

Non-negative Matrix Factorization (NMF) is one of the most popular techniques for data representation and clustering, and has been widely used in machine learning and data analysis. NMF concentrates the features of each sample into a…

Image and Video Processing · Electrical Eng. & Systems 2021-03-26 Mulin Chen , Maoguo Gong , Xuelong Li

We consider restricted Boltzmann machine (RBMs) trained over an unstructured dataset made of blurred copies of definite but unavailable ``archetypes'' and we show that there exists a critical sample size beyond which the RBM can learn…

Disordered Systems and Neural Networks · Physics 2021-09-02 Elena Agliari , Francesco Alemanno , Adriano Barra , Giordano De Marzo

We demonstrate quantum many-body state reconstruction from experimental data generated by a programmable quantum simulator, by means of a neural network model incorporating known experimental errors. Specifically, we extract restricted…

We discuss probabilistic neural networks with a fixed internal representation as models for machine understanding. Here understanding is intended as mapping data to an already existing representation which encodes an {\em a priori}…

Disordered Systems and Neural Networks · Physics 2023-12-07 Rongrong Xie , Matteo Marsili

Restricted Boltzmann machine (RBM) provide a general framework for modeling physical systems, but their behavior is dependent on hyperparameters such as the learning rate, the number of hidden nodes and the form of the threshold function.…

Computational Physics · Physics 2020-04-28 David Yevick , Roger Melko

Deep learning builds deep architectures such as multi-layered artificial neural networks to effectively represent multiple features of input patterns. The adaptive structural learning method of Deep Belief Network (DBN) can realize a high…

Neural and Evolutionary Computing · Computer Science 2019-10-01 Shin Kamada , Takumi Ichimura

Restricted Boltzmann Machine (RBM) is a bipartite graphical model that is used as the building block in energy-based deep generative models. Due to numerical stability and quantifiability of the likelihood, RBM is commonly used with…

Machine Learning · Statistics 2016-11-15 Chun-Liang Li , Siamak Ravanbakhsh , Barnabas Poczos

This paper describes two applications of conditional restricted Boltzmann machines (CRBMs) to the task of autotagging music. The first consists of training a CRBM to predict tags that a user would apply to a clip of a song based on tags…

Machine Learning · Computer Science 2011-03-16 Michael Mandel , Razvan Pascanu , Hugo Larochelle , Yoshua Bengio

Non-negative matrix factorization (NMF) is one of the most popular decomposition techniques for multivariate data. NMF is a core method for many machine-learning related computational problems, such as data compression, feature extraction,…

Numerical Analysis · Computer Science 2017-12-07 Gabriele Torre , Michael Graber

Hopfield networks (HNs) and Restricted Boltzmann Machines (RBMs) are two important models at the interface of statistical physics, machine learning, and neuroscience. Recently, there has been interest in the relationship between HNs and…

Machine Learning · Computer Science 2021-03-09 Matthew Smart , Anton Zilman