English
Related papers

Related papers: Can RBMs be trained with zero step contrastive div…

200 papers

We present transductive Boltzmann machines (TBMs), which firstly achieve transductive learning of the Gibbs distribution. While exact learning of the Gibbs distribution is impossible by the family of existing Boltzmann machines due to…

Machine Learning · Statistics 2018-05-22 Mahito Sugiyama , Koji Tsuda , Hiroyuki Nakahara

We propose a new approach to combine Restricted Boltzmann Machines (RBMs) that can be used to solve combinatorial optimization problems. This allows synthesis of larger models from smaller RBMs that have been pretrained, thus effectively…

Machine Learning · Computer Science 2019-09-10 Saavan Patel , Sayeef Salahuddin

Restricted Boltzmann Machine (RBM) is an importan- t generative model modeling vectorial data. While applying an RBM in practice to images, the data have to be vec- torized. This results in high-dimensional data and valu- able spatial…

Computer Vision and Pattern Recognition · Computer Science 2016-01-06 Guanglei Qi , Yanfeng Sun , Junbin Gao , Yongli Hu , Jinghua Li

A restricted Boltzmann machine (RBM) is an undirected graphical model constructed for discrete or continuous random variables, with two layers, one hidden and one visible, and no conditional dependency within a layer. In recent years, RBMs…

Machine Learning · Statistics 2019-09-12 Andee Kaplan , Daniel Nordman , Stephen Vardeman

The Robbins-Monro stochastic approximation algorithm is a foundation of many algorithmic frameworks for reinforcement learning (RL), and often an efficient approach to solving (or approximating the solution to) complex optimal control…

Optimization and Control · Mathematics 2019-03-19 Andrey Bernstein , Yue Chen , Marcello Colombino , Emiliano Dall'Anese , Prashant Mehta , Sean Meyn

Restricted Boltzman Machines (RBMs) have been successfully used in recommender systems. However, as with most of other collaborative filtering techniques, it cannot solve cold start problems for there is no rating for a new item. In this…

Information Retrieval · Computer Science 2014-08-04 Jiankou Li , Wei Zhang

Despite their appeal as physics-inspired, energy-based and generative nature, general Boltzmann Machines (BM) are considered intractable to train. This belief led to simplified models of BMs with restricted intralayer connections or…

Emerging Technologies · Computer Science 2024-01-05 Shuvro Chowdhury , Shaila Niazi , Kerem Y. Camsari

This paper investigates photonic continuous-variable Born machines (CVBMs), which utilize photonic quantum states as resources for continuous probability distributions. Implementing exact gradient descent in the CVBM training process is…

Quantum Physics · Physics 2024-10-16 Zoltán Kolarovszki , Dániel T. R. Nagy , Zoltán Zimborás

Deep Boltzmann machines (DBMs), one of the first ``deep'' learning methods ever studied, are multi-layered probabilistic models governed by a pairwise energy function that describes the likelihood of all variables/nodes in the network. In…

Machine Learning · Computer Science 2023-07-12 Zhili Feng , Ezra Winston , J. Zico Kolter

We present explicit classes of probability distributions that can be learned by Restricted Boltzmann Machines (RBMs) depending on the number of units that they contain, and which are representative for the expressive power of the model. We…

Machine Learning · Statistics 2014-06-13 Guido Montufar , Johannes Rauh , Nihat Ay

We introduce a novel combination of Bayesian Models (BMs) and Neural Networks (NNs) for making predictions with a minimum expected risk. Our approach combines the best of both worlds, the data efficiency and interpretability of a BM with…

Machine Learning · Computer Science 2021-09-28 Mathias Löwe , Per Lunnemann Hansen , Sebastian Risi

We propose a Las Vegas transformation of Markov Chain Monte Carlo (MCMC) estimators of Restricted Boltzmann Machines (RBMs). We denote our approach Markov Chain Las Vegas (MCLV). MCLV gives statistical guarantees in exchange for random…

Machine Learning · Computer Science 2018-05-31 Pedro H. P. Savarese , Mayank Kakodkar , Bruno Ribeiro

We present a theoretical analysis of Gaussian-binary restricted Boltzmann machines (GRBMs) from the perspective of density models. The key aspect of this analysis is to show that GRBMs can be formulated as a constrained mixture of…

Neural and Evolutionary Computing · Computer Science 2017-02-06 Nan Wang , Jan Melchior , Laurenz Wiskott

The Random Batch Method (RBM) is an effective technique to reduce the computational complexity when solving certain stochastic differential problems (SDEs) involving interacting particles. It can transform the computational complexity from…

Numerical Analysis · Mathematics 2024-12-23 Yanshun Zhao , Jingrun Chen , Zhiwen Zhang

We consider restricted Boltzmann machine (RBMs) trained over an unstructured dataset made of blurred copies of definite but unavailable ``archetypes'' and we show that there exists a critical sample size beyond which the RBM can learn…

Disordered Systems and Neural Networks · Physics 2021-09-02 Elena Agliari , Francesco Alemanno , Adriano Barra , Giordano De Marzo

A hybrid quantum-classical method for learning Boltzmann machines (BM) for a generative and discriminative task is presented. Boltzmann machines are undirected graphs with a network of visible and hidden nodes where the former is used as…

Quantum Physics · Physics 2022-07-21 Siddhartha Srivastava , Veera Sundararaghavan

We extend the framework of Boltzmann machines to a network of complex-valued neurons with variable amplitudes, referred to as Complex Amplitude-Phase Boltzmann machine (CAP-BM). The model is capable of performing unsupervised learning on…

Machine Learning · Statistics 2020-05-06 Zengyi Li , Friedrich T. Sommer

Understanding the results of deep neural networks is an essential step towards wider acceptance of deep learning algorithms. Many approaches address the issue of interpreting artificial neural networks, but often provide divergent…

Machine Learning · Computer Science 2021-11-16 Vadim Borisov , Johannes Meier , Johan van den Heuvel , Hamed Jalali , Gjergji Kasneci

Restricted Boltzmann Machines (RBM) have attracted a lot of attention of late, as one the principle building blocks of deep networks. Training RBMs remains problematic however, because of the intractibility of their partition function. The…

Machine Learning · Statistics 2010-12-17 Guillaume Desjardins , Aaron Courville , Yoshua Bengio

Restricted Boltzmann Machines (RBMs) and models derived from them have been successfully used as basic building blocks in deep artificial neural networks for automatic features extraction, unsupervised weights initialization, but also as…

Neural and Evolutionary Computing · Computer Science 2016-07-20 Decebal Constantin Mocanu , Elena Mocanu , Phuong H. Nguyen , Madeleine Gibescu , Antonio Liotta
‹ Prev 1 3 4 5 6 7 10 Next ›