English
Related papers

Related papers: Elastic regularization in restricted Boltzmann mac…

200 papers

Building a good generative model for image has long been an important topic in computer vision and machine learning. Restricted Boltzmann machine (RBM) is one of such models that is simple but powerful. However, its restricted form also has…

Machine Learning · Computer Science 2016-11-24 Hengyuan Hu , Lisheng Gao , Quanbin Ma

We consider the problem of classification when inputs correspond to sets of vectors. This setting occurs in many problems such as the classification of pieces of mail containing several pages, of web sites with several sections or of images…

Machine Learning · Computer Science 2011-03-28 Jérôme Louradour , Hugo Larochelle

Restricted Boltzmann machines (RBMs) are powerful machine learning models, but learning and some kinds of inference in the model require sampling-based approximations, which, in classical digital computers, are implemented using expensive…

Machine Learning · Statistics 2014-10-27 Vincent Dumoulin , Ian J. Goodfellow , Aaron Courville , Yoshua Bengio

The deep Boltzmann machine (DBM) has been an important development in the quest for powerful "deep" probabilistic models. To date, simultaneous or joint training of all layers of the DBM has been largely unsuccessful with existing training…

Neural and Evolutionary Computing · Computer Science 2012-03-21 Guillaume Desjardins , Aaron Courville , Yoshua Bengio

Conditional Restricted Boltzmann Machines (CRBMs) are rich probabilistic models that have recently been applied to a wide range of problems, including collaborative filtering, classification, and modeling motion capture data. While much…

Machine Learning · Computer Science 2012-02-20 Volodymyr Mnih , Hugo Larochelle , Geoffrey E. Hinton

Restricted Boltzmann machine (RBM) provide a general framework for modeling physical systems, but their behavior is dependent on hyperparameters such as the learning rate, the number of hidden nodes and the form of the threshold function.…

Computational Physics · Physics 2020-04-28 David Yevick , Roger Melko

Boltzmann Machines (BMs) are graphical models with interconnected binary units, employed for the unsupervised modeling of data distributions. When trained on real data, BMs show the tendency to behave like critical systems, displaying a…

Disordered Systems and Neural Networks · Physics 2024-06-28 Enrico Ventura , Simona Cocco , Rémi Monasson , Francesco Zamponi

Restricted Boltzmann machines (RBMs) constitute one of the main models for machine statistical inference and they are widely employed in Artificial Intelligence as powerful tools for (deep) learning. However, in contrast with countless…

Disordered Systems and Neural Networks · Physics 2019-03-12 Elena Agliari , Adriano Barra , Brunello Tirozzi

Restricted Boltzmann Machines (RBMs) are widely used probabilistic undirected graphical models with visible and latent nodes, playing an important role in statistics and machine learning. The task of structure learning for RBMs involves…

Quantum Physics · Physics 2023-09-26 Liming Zhao , Aman Agrawal , Patrick Rebentrost

Deep learning architectures have been widely fostered throughout the last years, being used in a wide range of applications, such as object recognition, image reconstruction, and signal processing. Nevertheless, such models suffer from a…

Machine Learning · Computer Science 2021-01-19 Mateus Roder , Gustavo H. de Rosa , Victor Hugo C. de Albuquerque , André L. D. Rossi , João P. Papa

Precise physical descriptions of molecules can be obtained by solving the Schrodinger equation; however, these calculations are intractable and even approximations can be cumbersome. Force fields, which estimate interatomic potentials based…

Chemical Physics · Physics 2020-12-15 Peter Nekrasov , Jessica Freeze , Victor Batista

Restricted Boltzmann machines (RBMs) are a class of neural networks that have been successfully employed as a variational ansatz for quantum many-body wave functions. Here, we develop an analytic method to study quantum many-body spin…

Quantum Physics · Physics 2022-10-06 Xiao-Qi Sun , Tamra Nebabu , Xizhi Han , Michael O. Flynn , Xiao-Liang Qi

Optimization problems, particularly NP-Hard Combinatorial Optimization problems, are some of the hardest computing problems with no known polynomial time algorithm existing. Recently there has been interest in using dedicated hardware to…

Hardware Architecture · Computer Science 2020-10-15 Saavan Patel , Lili Chen , Philip Canoza , Sayeef Salahuddin

Unsupervised neural networks, such as restricted Boltzmann machines (RBMs) and deep belief networks (DBNs), are powerful tools for feature selection and pattern recognition tasks. We demonstrate that overfitting occurs in such models just…

Machine Learning · Computer Science 2017-02-20 Baiyang Wang , Diego Klabjan

Restricted Boltzmann Machines (RBMs) are general unsupervised learning devices to ascertain generative models of data distributions. RBMs are often trained using the Contrastive Divergence learning algorithm (CD), an approximation to the…

Machine Learning · Computer Science 2014-04-10 David Buchaca , Enrique Romero , Ferran Mazzanti , Jordi Delgado

The restricted Boltzmann machine (RBM) is a flexible tool for modeling complex data, however there have been significant computational difficulties in using RBMs to model high-dimensional multinomial observations. In natural language…

Machine Learning · Computer Science 2012-07-06 George E. Dahl , Ryan P. Adams , Hugo Larochelle

The performance of deep neural networks, such as Deep Belief Networks formed by Restricted Boltzmann Machines (RBMs), strongly depends on their training, which is the process of adjusting their parameters. This process can be posed as an…

Neural and Evolutionary Computing · Computer Science 2019-07-16 S. Ivvan Valdez , Alfonso Rojas-Domínguez

Restricted Boltzmann Machines (RBMs) and models derived from them have been successfully used as basic building blocks in deep artificial neural networks for automatic features extraction, unsupervised weights initialization, but also as…

Neural and Evolutionary Computing · Computer Science 2016-07-20 Decebal Constantin Mocanu , Elena Mocanu , Phuong H. Nguyen , Madeleine Gibescu , Antonio Liotta

Restricted Boltzmann machines (RBMs) are a powerful class of generative models, but their training requires computing a gradient that, unlike supervised backpropagation on typical loss functions, is notoriously difficult even to…

Machine Learning · Computer Science 2020-11-03 Haik Manukian , Yan Ru Pei , Sean R. B. Bearden , Massimiliano Di Ventra

We set up Restricted Boltzmann Machines (RBM) to reproduce the Long Range Ising (LRI) models of the Ohmic type in one dimension. The RBM parameters are tuned by using the standard machine learning procedure with an additional method of…

Statistical Mechanics · Physics 2017-01-03 Ken-Ichi Aoki , Tamao Kobayashi