中文
相关论文

相关论文: Can RBMs be trained with zero step contrastive div…

200 篇论文

We present transductive Boltzmann machines (TBMs), which firstly achieve transductive learning of the Gibbs distribution. While exact learning of the Gibbs distribution is impossible by the family of existing Boltzmann machines due to…

机器学习 · 统计学 2018-05-22 Mahito Sugiyama , Koji Tsuda , Hiroyuki Nakahara

We propose a new approach to combine Restricted Boltzmann Machines (RBMs) that can be used to solve combinatorial optimization problems. This allows synthesis of larger models from smaller RBMs that have been pretrained, thus effectively…

机器学习 · 计算机科学 2019-09-10 Saavan Patel , Sayeef Salahuddin

Restricted Boltzmann Machine (RBM) is an importan- t generative model modeling vectorial data. While applying an RBM in practice to images, the data have to be vec- torized. This results in high-dimensional data and valu- able spatial…

计算机视觉与模式识别 · 计算机科学 2016-01-06 Guanglei Qi , Yanfeng Sun , Junbin Gao , Yongli Hu , Jinghua Li

A restricted Boltzmann machine (RBM) is an undirected graphical model constructed for discrete or continuous random variables, with two layers, one hidden and one visible, and no conditional dependency within a layer. In recent years, RBMs…

机器学习 · 统计学 2019-09-12 Andee Kaplan , Daniel Nordman , Stephen Vardeman

The Robbins-Monro stochastic approximation algorithm is a foundation of many algorithmic frameworks for reinforcement learning (RL), and often an efficient approach to solving (or approximating the solution to) complex optimal control…

最优化与控制 · 数学 2019-03-19 Andrey Bernstein , Yue Chen , Marcello Colombino , Emiliano Dall'Anese , Prashant Mehta , Sean Meyn

Restricted Boltzman Machines (RBMs) have been successfully used in recommender systems. However, as with most of other collaborative filtering techniques, it cannot solve cold start problems for there is no rating for a new item. In this…

信息检索 · 计算机科学 2014-08-04 Jiankou Li , Wei Zhang

Despite their appeal as physics-inspired, energy-based and generative nature, general Boltzmann Machines (BM) are considered intractable to train. This belief led to simplified models of BMs with restricted intralayer connections or…

新兴技术 · 计算机科学 2024-01-05 Shuvro Chowdhury , Shaila Niazi , Kerem Y. Camsari

This paper investigates photonic continuous-variable Born machines (CVBMs), which utilize photonic quantum states as resources for continuous probability distributions. Implementing exact gradient descent in the CVBM training process is…

量子物理 · 物理学 2024-10-16 Zoltán Kolarovszki , Dániel T. R. Nagy , Zoltán Zimborás

Deep Boltzmann machines (DBMs), one of the first ``deep'' learning methods ever studied, are multi-layered probabilistic models governed by a pairwise energy function that describes the likelihood of all variables/nodes in the network. In…

机器学习 · 计算机科学 2023-07-12 Zhili Feng , Ezra Winston , J. Zico Kolter

We present explicit classes of probability distributions that can be learned by Restricted Boltzmann Machines (RBMs) depending on the number of units that they contain, and which are representative for the expressive power of the model. We…

机器学习 · 统计学 2014-06-13 Guido Montufar , Johannes Rauh , Nihat Ay

We introduce a novel combination of Bayesian Models (BMs) and Neural Networks (NNs) for making predictions with a minimum expected risk. Our approach combines the best of both worlds, the data efficiency and interpretability of a BM with…

机器学习 · 计算机科学 2021-09-28 Mathias Löwe , Per Lunnemann Hansen , Sebastian Risi

We propose a Las Vegas transformation of Markov Chain Monte Carlo (MCMC) estimators of Restricted Boltzmann Machines (RBMs). We denote our approach Markov Chain Las Vegas (MCLV). MCLV gives statistical guarantees in exchange for random…

机器学习 · 计算机科学 2018-05-31 Pedro H. P. Savarese , Mayank Kakodkar , Bruno Ribeiro

We present a theoretical analysis of Gaussian-binary restricted Boltzmann machines (GRBMs) from the perspective of density models. The key aspect of this analysis is to show that GRBMs can be formulated as a constrained mixture of…

神经与进化计算 · 计算机科学 2017-02-06 Nan Wang , Jan Melchior , Laurenz Wiskott

The Random Batch Method (RBM) is an effective technique to reduce the computational complexity when solving certain stochastic differential problems (SDEs) involving interacting particles. It can transform the computational complexity from…

数值分析 · 数学 2024-12-23 Yanshun Zhao , Jingrun Chen , Zhiwen Zhang

We consider restricted Boltzmann machine (RBMs) trained over an unstructured dataset made of blurred copies of definite but unavailable ``archetypes'' and we show that there exists a critical sample size beyond which the RBM can learn…

无序系统与神经网络 · 物理学 2021-09-02 Elena Agliari , Francesco Alemanno , Adriano Barra , Giordano De Marzo

A hybrid quantum-classical method for learning Boltzmann machines (BM) for a generative and discriminative task is presented. Boltzmann machines are undirected graphs with a network of visible and hidden nodes where the former is used as…

量子物理 · 物理学 2022-07-21 Siddhartha Srivastava , Veera Sundararaghavan

We extend the framework of Boltzmann machines to a network of complex-valued neurons with variable amplitudes, referred to as Complex Amplitude-Phase Boltzmann machine (CAP-BM). The model is capable of performing unsupervised learning on…

机器学习 · 统计学 2020-05-06 Zengyi Li , Friedrich T. Sommer

Understanding the results of deep neural networks is an essential step towards wider acceptance of deep learning algorithms. Many approaches address the issue of interpreting artificial neural networks, but often provide divergent…

机器学习 · 计算机科学 2021-11-16 Vadim Borisov , Johannes Meier , Johan van den Heuvel , Hamed Jalali , Gjergji Kasneci

Restricted Boltzmann Machines (RBM) have attracted a lot of attention of late, as one the principle building blocks of deep networks. Training RBMs remains problematic however, because of the intractibility of their partition function. The…

机器学习 · 统计学 2010-12-17 Guillaume Desjardins , Aaron Courville , Yoshua Bengio

Restricted Boltzmann Machines (RBMs) and models derived from them have been successfully used as basic building blocks in deep artificial neural networks for automatic features extraction, unsupervised weights initialization, but also as…

神经与进化计算 · 计算机科学 2016-07-20 Decebal Constantin Mocanu , Elena Mocanu , Phuong H. Nguyen , Madeleine Gibescu , Antonio Liotta