English
Related papers

Related papers: Photonic restricted Boltzmann machine for content …

200 papers

Graphical models are powerful tools for modeling high-dimensional data, but learning graphical models in the presence of latent variables is well-known to be difficult. In this work we give new results for learning Restricted Boltzmann…

Machine Learning · Computer Science 2020-07-28 Surbhi Goel , Adam Klivans , Frederic Koehler

We pursue an early stopping technique that helps Gaussian Restricted Boltzmann Machines (GRBMs) to gain good natural image representations in terms of overcompleteness and data fitting. GRBMs are widely considered as an unsuitable model for…

Machine Learning · Statistics 2014-01-07 Taichi Kiwaki , Takaki Makino , Kazuyuki Aihara

Restricted Boltzmann machines (RBMs) are energy-based models analogous to the Ising model and are widely applied in statistical machine learning. The standard inverse Ising problem with a complete dataset requires computing both data and…

Machine Learning · Statistics 2025-09-01 Kaiji Sekimoto , Muneki Yasuda

We train a set of Restricted Boltzmann Machines (RBMs) on one- and two-dimensional Ising spin configurations at various values of temperature, generated using Monte Carlo simulations. We validate the training procedure by monitoring several…

Computational Physics · Physics 2019-08-14 Guido Cossu , Luigi Del Debbio , Tommaso Giani , Ava Khamseh , Michael Wilson

Restricted Boltzmann Machines (RBMs) are a class of generative neural network that are typically trained to maximize a log-likelihood objective function. We argue that likelihood-based training strategies may fail because the objective does…

Machine Learning · Statistics 2018-04-25 Charles K. Fisher , Aaron M. Smith , Jonathan R. Walsh

Restricted Boltzmann machines (RBMs) and their variants are usually trained by contrastive divergence (CD) learning, but the training procedure is an unsupervised learning approach, without any guidances of the background knowledge. To…

Machine Learning · Computer Science 2018-12-06 Jielei Chu , Hongjun Wang , Hua Meng , Peng Jin , Tianrui Li

We study the features extracted by the Restricted Boltzmann Machine (RBM) when it is trained with spin configurations of Ising model at various temperatures. Using the trained RBM, we obtain the flow of iterative reconstructions (RBM flow)…

Machine Learning · Computer Science 2021-11-23 Shotaro Shiba Funai

Conditional generative models are capable of using contextual information as input to create new imaginative outputs. Conditional Restricted Boltzmann Machines (CRBMs) are one class of conditional generative models that have proven to be…

Machine Learning · Computer Science 2023-05-16 Alex H. Lang , Anton D. Loukianov , Charles K. Fisher

Precise physical descriptions of molecules can be obtained by solving the Schrodinger equation; however, these calculations are intractable and even approximations can be cumbersome. Force fields, which estimate interatomic potentials based…

Chemical Physics · Physics 2020-12-15 Peter Nekrasov , Jessica Freeze , Victor Batista

Restricted Boltzmann Machines (RBMs) are generative models which can learn useful representations from samples of a dataset in an unsupervised fashion. They have been widely employed as an unsupervised pre-training method in machine…

Machine Learning · Statistics 2013-09-13 Chris Häusler , Alex Susemihl , Martin P Nawrot , Manfred Opper

We study identity testing for restricted Boltzmann machines (RBMs), and more generally for undirected graphical models. Given sample access to the Gibbs distribution corresponding to an unknown or hidden model $M^*$ and given an explicit…

Data Structures and Algorithms · Computer Science 2020-04-24 Antonio Blanca , Zongchen Chen , Daniel Štefankovič , Eric Vigoda

We investigate the thermodynamic properties of a Restricted Boltzmann Machine (RBM), a simple energy-based generative model used in the context of unsupervised learning. Assuming the information content of this model to be mainly reflected…

Disordered Systems and Neural Networks · Physics 2018-08-20 Aurélien Decelle , Giancarlo Fissore , Cyril Furtlehner

Machine learning methods are powerful in distinguishing different phases of matter in an automated way and provide a new perspective on the study of physical phenomena. We train a Restricted Boltzmann Machine (RBM) on data constructed with…

Statistical Mechanics · Physics 2020-09-23 Shotaro Shiba Funai , Dimitrios Giataganas

Most accurate recommender systems are black-box models, hiding the reasoning behind their recommendations. Yet explanations have been shown to increase the user's trust in the system in addition to providing other benefits such as…

Machine Learning · Statistics 2016-06-24 Behnoush Abdollahi , Olfa Nasraoui

We explore alternative experimental setups for the iterative sampling (flow) from Restricted Boltzmann Machines (RBM) mapped on the temperature space of square lattice Ising models by a neural network thermometer. This framework has been…

Statistical Mechanics · Physics 2022-03-31 Rodrigo Veiga , Renato Vicente

In this paper, we present a new idea for Transfer Learning (TL) based on Gibbs Sampling. Gibbs sampling is an algorithm in which instances are likely to transfer to a new state with a higher possibility with respect to a probability…

Machine Learning · Computer Science 2020-06-26 Hossein Shahabadi Farahani , Alireza Fatehi , Mahdi Aliyari Shoorehdeli

We revisit the challenging problem of training Gaussian-Bernoulli restricted Boltzmann machines (GRBMs), introducing two innovations. We propose a novel Gibbs-Langevin sampling algorithm that outperforms existing methods like Gibbs…

Machine Learning · Computer Science 2022-10-20 Renjie Liao , Simon Kornblith , Mengye Ren , David J. Fleet , Geoffrey Hinton

Restricted Boltzmann machines (RBMs) and their extensions, called 'deep-belief networks', are powerful neural networks that have found applications in the fields of machine learning and artificial intelligence. The standard way to training…

Machine Learning · Computer Science 2018-10-25 Haik Manukian , Fabio L. Traversa , Massimiliano Di Ventra

We extend the framework of Boltzmann machines to a network of complex-valued neurons with variable amplitudes, referred to as Complex Amplitude-Phase Boltzmann machine (CAP-BM). The model is capable of performing unsupervised learning on…

Machine Learning · Statistics 2020-05-06 Zengyi Li , Friedrich T. Sommer

The Extreme Learning Machine (ELM) is a single-hidden layer feedforward neural network (SLFN) learning algorithm that can learn effectively and quickly. The ELM training phase assigns the input weights and bias randomly and does not change…

Neural and Evolutionary Computing · Computer Science 2017-08-18 Andre Pacheco , Renato Krohling , Carlos da Silva