English
Related papers

Related papers: Emergence of Compositional Representations in Rest…

200 papers

The Boltzmann model for the random generation of "decomposable" combinatorial structures is a set of techniques that allows for efficient random sampling algorithms for a large class of families of discrete objects. The usual requirement of…

Data Structures and Algorithms · Computer Science 2011-12-23 Philippe Duchon

Unsupervised feature learning has shown impressive results for a wide range of input modalities, in particular for object classification tasks in computer vision. Using a large amount of unlabeled data, unsupervised feature learning methods…

Computer Vision and Pattern Recognition · Computer Science 2013-04-26 Christian Osendorfer , Justin Bayer , Sebastian Urban , Patrick van der Smagt

Restricted Boltzmann Machines (RBMs) are one of the fundamental building blocks of deep learning. Approximate maximum likelihood training of RBMs typically necessitates sampling from these models. In many training scenarios, computationally…

Machine Learning · Computer Science 2014-10-02 Guillaume Desjardins , Heng Luo , Aaron Courville , Yoshua Bengio

Magnetic Random-Access Memory (MRAM) based p-bit neuromorphic computing devices are garnering increasing interest as a means to compactly and efficiently realize machine learning operations in Restricted Boltzmann Machines (RBMs). When…

Emerging Technologies · Computer Science 2020-02-04 Paul Wood , Hossein Pourmeidani , Ronald F. DeMara

We present the application of Restricted Boltzmann Machines (RBMs) to the task of astronomical image classification using a quantum annealer built by D-Wave Systems. Morphological analysis of galaxies provides critical information for…

Quantum Physics · Physics 2020-02-17 João Caldeira , Joshua Job , Steven H. Adachi , Brian Nord , Gabriel N. Perdue

Geometric frustration gives rise to emergent quantum phenomena and exotic phases of matter. While Monte Carlo methods are traditionally used to simulate such systems, their sampling efficiency is limited by the complexity of interactions…

Statistical Mechanics · Physics 2025-11-27 Pratik Brahma , Junghoon Han , Tamzid Razzaque , Saavan Patel , Sayeef Salahuddin

Hopfield networks (HNs) and Restricted Boltzmann Machines (RBMs) are two important models at the interface of statistical physics, machine learning, and neuroscience. Recently, there has been interest in the relationship between HNs and…

Machine Learning · Computer Science 2021-03-09 Matthew Smart , Anton Zilman

Training Restricted Boltzmann Machines (RBMs) has been challenging for a long time due to the difficulty of computing precisely the log-likelihood gradient. Over the past decades, many works have proposed more or less successful training…

Machine Learning · Computer Science 2022-12-07 Aurélien Decelle , Cyril Furtlehner , Beatriz Seoane

Deep Boltzmann machines (DBMs), one of the first ``deep'' learning methods ever studied, are multi-layered probabilistic models governed by a pairwise energy function that describes the likelihood of all variables/nodes in the network. In…

Machine Learning · Computer Science 2023-07-12 Zhili Feng , Ezra Winston , J. Zico Kolter

In this study, we address the challenge of using energy-based models to produce high-quality, label-specific data in complex structured datasets, such as population genetics, RNA or protein sequences data. Traditional training methods…

Machine Learning · Computer Science 2025-02-07 Alessandra Carbone , Aurélien Decelle , Lorenzo Rosset , Beatriz Seoane

In this work, we analyze the nonequilibrium thermodynamics of a class of neural networks known as Restricted Boltzmann Machines (RBMs) in the context of unsupervised learning. We show how the network is described as a discrete Markov…

Statistical Mechanics · Physics 2017-08-23 Domingos S. P. Salazar

Restricted Boltzmann machines (RBMs) are energy-based neural-networks which are commonly used as the building blocks for deep architectures neural architectures. In this work, we derive a deterministic framework for the training,…

Machine Learning · Computer Science 2018-10-17 Eric W. Tramel , Marylou Gabrié , Andre Manoel , Francesco Caltagirone , Florent Krzakala

Deep learning methods relying on multi-layered networks have been actively studied in a wide range of fields in recent years, and deep Boltzmann machines(DBMs) is one of them. In this study, a model of DBMs with some properites of weight…

Disordered Systems and Neural Networks · Physics 2022-10-06 Yuma Ichikawa , Koji Hukushima

Restricted Boltzmann machines (RBMs) and their variants are usually trained by contrastive divergence (CD) learning, but the training procedure is an unsupervised learning approach, without any guidances of the background knowledge. To…

Machine Learning · Computer Science 2018-12-06 Jielei Chu , Hongjun Wang , Hua Meng , Peng Jin , Tianrui Li

Restricted Boltzmann machines~(RBMs) and conditional RBMs~(CRBMs) are popular models for a wide range of applications. In previous work, learning on such models has been dominated by contrastive divergence~(CD) and its variants. Belief…

Machine Learning · Computer Science 2017-03-06 Wei Ping , Alexander Ihler

In this paper, we first present a new variant of Gaussian restricted Boltzmann machine (GRBM) called multivariate Gaussian restricted Boltzmann machine (MGRBM), with its definition and learning algorithm. Then we propose using a learned…

Computation and Language · Computer Science 2013-09-25 Xin Zheng , Zhiyong Wu , Helen Meng , Weifeng Li , Lianhong Cai

A specific type of neural network, the Restricted Boltzmann Machine (RBM), is implemented for classification and feature detection in machine learning. RBM is characterized by separate layers of visible and hidden units, which are able to…

Disordered Systems and Neural Networks · Physics 2012-01-11 Adriano Barra , Alberto Bernacchia , Enrica Santucci , Pierluigi Contucci

Restricted Boltzmann machines (RBMs) are energy-based models analogous to the Ising model and are widely applied in statistical machine learning. The standard inverse Ising problem with a complete dataset requires computing both data and…

Machine Learning · Statistics 2025-09-01 Kaiji Sekimoto , Muneki Yasuda

Deep learning techniques have been paramount in the last years, mainly due to their outstanding results in a number of applications, that range from speech recognition to face-based user identification. Despite other techniques employed for…

Machine Learning · Computer Science 2016-09-06 Leandro Aparecido Passos Junior , Joao Paulo Papa

An artificial neural network (ANN) with the restricted Boltzmann machine (RBM) architecture was recently proposed as a versatile variational quantum many-body wave function. In this work we provide physical insights into the performance of…

Disordered Systems and Neural Networks · Physics 2020-06-02 Artem Borin , Dmitry A. Abanin