English
Related papers

Related papers: Temperature-Based Deep Boltzmann Machines

200 papers

Deep learning methods relying on multi-layered networks have been actively studied in a wide range of fields in recent years, and deep Boltzmann machines(DBMs) is one of them. In this study, a model of DBMs with some properites of weight…

Disordered Systems and Neural Networks · Physics 2022-10-06 Yuma Ichikawa , Koji Hukushima

The deep extension of the restricted Boltzmann machine (RBM), known as the deep Boltzmann machine (DBM), is an expressive family of machine learning models which can serve as compact representations of complex probability distributions.…

Machine Learning · Computer Science 2021-02-18 Haik Manukian , Massimiliano Di Ventra

Restricted Boltzmann machines (RBM) and deep Boltzmann machines (DBM) are important models in machine learning, and recently found numerous applications in quantum many-body physics. We show that there are fundamental connections between…

Statistical Mechanics · Physics 2021-09-01 Sujie Li , Feng Pan , Pengfei Zhou , Pan Zhang

An increase in the efficiency of sampling from Boltzmann distributions would have a significant impact on deep learning and other machine-learning applications. Recently, quantum annealers have been proposed as a potential candidate to…

Quantum Physics · Physics 2016-08-17 Marcello Benedetti , John Realpe-Gómez , Rupak Biswas , Alejandro Perdomo-Ortiz

Building a good generative model for image has long been an important topic in computer vision and machine learning. Restricted Boltzmann machine (RBM) is one of such models that is simple but powerful. However, its restricted form also has…

Machine Learning · Computer Science 2016-11-24 Hengyuan Hu , Lisheng Gao , Quanbin Ma

A restricted Boltzmann machine (RBM) is an undirected graphical model constructed for discrete or continuous random variables, with two layers, one hidden and one visible, and no conditional dependency within a layer. In recent years, RBMs…

Machine Learning · Statistics 2019-09-12 Andee Kaplan , Daniel Nordman , Stephen Vardeman

Deep Boltzmann machines (DBMs), one of the first ``deep'' learning methods ever studied, are multi-layered probabilistic models governed by a pairwise energy function that describes the likelihood of all variables/nodes in the network. In…

Machine Learning · Computer Science 2023-07-12 Zhili Feng , Ezra Winston , J. Zico Kolter

A Boltzmann machine is a stochastic neural network that has been extensively used in the layers of deep architectures for modern machine learning applications. In this paper, we develop a Boltzmann machine that is capable of modelling…

Statistical Mechanics · Physics 2016-10-18 Giacomo Torlai , Roger G. Melko

Many computer vision applications involve modeling complex spatio-temporal patterns in high-dimensional motion data. Recently, restricted Boltzmann machines (RBMs) have been widely used to capture and represent spatial patterns in a single…

Computer Vision and Pattern Recognition · Computer Science 2017-10-24 Siqi Nie , Ziheng Wang , Qiang Ji

This is a tutorial and survey paper on Boltzmann Machine (BM), Restricted Boltzmann Machine (RBM), and Deep Belief Network (DBN). We start with the required background on probabilistic graphical models, Markov random field, Gibbs sampling,…

Machine Learning · Computer Science 2022-08-09 Benyamin Ghojogh , Ali Ghodsi , Fakhri Karray , Mark Crowley

This paper presents a novel Robust Deep Appearance Models to learn the non-linear correlation between shape and texture of face images. In this approach, two crucial components of face images, i.e. shape and texture, are represented by Deep…

Computer Vision and Pattern Recognition · Computer Science 2016-07-05 Kha Gia Quach , Chi Nhan Duong , Khoa Luu , Tien D. Bui

We introduce a new method for training deep Boltzmann machines jointly. Prior methods of training DBMs require an initial learning pass that trains the model greedily, one layer at a time, or do not perform well on classification tasks. In…

Machine Learning · Statistics 2013-05-02 Ian J. Goodfellow , Aaron Courville , Yoshua Bengio

The restricted Boltzmann machine (RBM) is one of the fundamental building blocks of deep learning. RBM finds wide applications in dimensional reduction, feature extraction, and recommender systems via modeling the probability distributions…

Strongly Correlated Electrons · Physics 2018-02-07 Jing Chen , Song Cheng , Haidong Xie , Lei Wang , Tao Xiang

The restricted Boltzmann machine (RBM) is a two-layer energy-based model that uses its hidden-visible connections to learn the underlying distribution of visible units, whose interactions are often complicated by high-order correlations.…

Statistical Mechanics · Physics 2022-12-07 Jing Gu , Kai Zhang

The deep Boltzmann machine (DBM) has been an important development in the quest for powerful "deep" probabilistic models. To date, simultaneous or joint training of all layers of the DBM has been largely unsuccessful with existing training…

Neural and Evolutionary Computing · Computer Science 2012-03-21 Guillaume Desjardins , Aaron Courville , Yoshua Bengio

Restricted Boltzmann Machines (RBMs) are one of the fundamental building blocks of deep learning. Approximate maximum likelihood training of RBMs typically necessitates sampling from these models. In many training scenarios, computationally…

Machine Learning · Computer Science 2014-10-02 Guillaume Desjardins , Heng Luo , Aaron Courville , Yoshua Bengio

Graphical models are a rich language for describing high-dimensional distributions in terms of their dependence structure. While there are algorithms with provable guarantees for learning undirected graphical models in a variety of…

Machine Learning · Computer Science 2018-11-07 Guy Bresler , Frederic Koehler , Ankur Moitra , Elchanan Mossel

We present a layered Boltzmann machine (BM) that can better exploit the advantages of a distributed representation. It is widely believed that deep BMs (DBMs) have far greater representational power than its shallow counterpart, restricted…

Neural and Evolutionary Computing · Computer Science 2015-06-23 Taichi Kiwaki

Air temperature (Ta) is an essential climatological component that controls and influences various earth surface processes. In this study, we make the first attempt to employ deep learning for Ta mapping mainly based on space remote sensing…

Atmospheric and Oceanic Physics · Physics 2020-01-15 Huanfeng Shen , Yun Jiang , Tongwen Li , Qing Cheng , Chao Zeng , Liangpei Zhang

A central idea of knowledge distillation is to expose relational structure embedded in the teacher's weights for the student to learn, which is often facilitated using a temperature parameter. Despite its widespread use, there remains…

Machine Learning · Computer Science 2026-03-05 Logan Frank , Jim Davis
‹ Prev 1 2 3 10 Next ›