English
Related papers

Related papers: Complex-Valued Restricted Boltzmann Machine for Di…

200 papers

In this letter, we propose enhanced factored three way restricted Boltzmann machines (EFTW-RBMs) for speech detection. The proposed model incorporates conditional feature learning by multiplying the dynamical state of the third unit, which…

Sound · Computer Science 2017-04-24 Pengfei Sun , Jun Qin

A restricted Boltzmann machine (RBM) is a two-layer neural network with shared weights and has been extensively studied for dimensionality reduction, data representation and recommendation systems in the literature. The traditional RBM…

Machine Learning · Computer Science 2026-05-27 Jiangsheng You , Chun-Yen Liu

We are interested in exploring the possibility and benefits of structure learning for deep models. As the first step, this paper investigates the matter for Restricted Boltzmann Machines (RBMs). We conduct the study with Replicated Softmax,…

Machine Learning · Computer Science 2018-08-07 Zhourong Chen , Nevin L. Zhang , Dit-Yan Yeung , Peixian Chen

The success of any machine learning system depends critically on effective representations of data. In many cases, it is desirable that a representation scheme uncovers the parts-based, additive nature of the data. Of current representation…

Machine Learning · Computer Science 2017-08-21 Tu Dinh Nguyen , Truyen Tran , Dinh Phung , Svetha Venkatesh

Restricted Boltzmann Machine (RBM) is a generative stochastic energy-based model of artificial neural network for unsupervised learning. Recently, RBM is well known to be a pre-training method of Deep Learning. In addition to visible and…

Neural and Evolutionary Computing · Computer Science 2018-07-12 Shin Kamada , Takumi Ichimura

Statistical analysis of evolutionary-related protein sequences provides insights about their structure, function, and history. We show that Restricted Boltzmann Machines (RBM), designed to learn complex high-dimensional data and their…

Quantitative Methods · Quantitative Biology 2019-02-28 Jérôme Tubiana , Simona Cocco , Rémi Monasson

Graphical models are a rich language for describing high-dimensional distributions in terms of their dependence structure. While there are algorithms with provable guarantees for learning undirected graphical models in a variety of…

Machine Learning · Computer Science 2018-11-07 Guy Bresler , Frederic Koehler , Ankur Moitra , Elchanan Mossel

We propose a data-driven approach using a Restricted Boltzmann Machine (RBM) to solve the Schr\"odinger equation in configuration space. Traditional Configuration Interaction (CI) methods construct the wavefunction as a linear combination…

Restricted Boltzmann Machines (RBMs) and models derived from them have been successfully used as basic building blocks in deep artificial neural networks for automatic features extraction, unsupervised weights initialization, but also as…

Neural and Evolutionary Computing · Computer Science 2016-07-20 Decebal Constantin Mocanu , Elena Mocanu , Phuong H. Nguyen , Madeleine Gibescu , Antonio Liotta

The deep extension of the restricted Boltzmann machine (RBM), known as the deep Boltzmann machine (DBM), is an expressive family of machine learning models which can serve as compact representations of complex probability distributions.…

Machine Learning · Computer Science 2021-02-18 Haik Manukian , Massimiliano Di Ventra

Restricted Boltzmann Machine (RBM) is a particular type of random neural network models modeling vector data based on the assumption of Bernoulli distribution. For multi-dimensional and non-binary data, it is necessary to vectorize and…

Computer Vision and Pattern Recognition · Computer Science 2016-09-28 Simeng Liu , Yanfeng Sun , Yongli Hu , Junbin Gao , Baocai Yin

This review deals with Restricted Boltzmann Machine (RBM) under the light of statistical physics. The RBM is a classical family of Machine learning (ML) models which played a central role in the development of deep learning. Viewing it as a…

Disordered Systems and Neural Networks · Physics 2023-07-17 Aurélien Decelle , Cyril Furtlehner

The restricted Boltzmann machine (RBM) is a neural network based on the Ising model, well known for its ability to learn probability distributions and stochastically generate new content. However, the high computational cost of Gibbs…

Optics · Physics 2026-03-13 Li Luo , Yisheng Fang , Wanyi Zhang , Zhichao Ruan

We study the type of distributions that Restricted Boltzmann Machines (RBMs) with different activation functions can express by investigating the effect of the activation function of the hidden nodes on the marginal distribution they impose…

Machine Learning · Statistics 2021-03-31 Nicola Bulso , Yasser Roudi

This work analyzes centered binary Restricted Boltzmann Machines (RBMs) and binary Deep Boltzmann Machines (DBMs), where centering is done by subtracting offset values from visible and hidden variables. We show analytically that (i)…

Machine Learning · Statistics 2017-02-08 Jan Melchior , Asja Fischer , Laurenz Wiskott

A restricted Boltzmann machine (RBM) is a generative neural-network model with many novel applications such as collaborative filtering and acoustic modeling. An RBM lacks the capacity to retain memory, making it inappropriate for dynamic…

Machine Learning · Statistics 2018-05-01 Jefferson Hernandez , Andres G. Abad

Finding suitable features has been an essential problem in computer vision. We focus on Restricted Boltzmann Machines (RBMs), which, despite their versatility, cannot accommodate transformations that may occur in the scene. As a result,…

Computer Vision and Pattern Recognition · Computer Science 2016-11-15 Mario Valerio Giuffrida , Sotirios A. Tsaftaris

We present explicit classes of probability distributions that can be learned by Restricted Boltzmann Machines (RBMs) depending on the number of units that they contain, and which are representative for the expressive power of the model. We…

Machine Learning · Statistics 2014-06-13 Guido Montufar , Johannes Rauh , Nihat Ay

The restricted Boltzmann machine (RBM) is one of the fundamental building blocks of deep learning. RBM finds wide applications in dimensional reduction, feature extraction, and recommender systems via modeling the probability distributions…

Strongly Correlated Electrons · Physics 2018-02-07 Jing Chen , Song Cheng , Haidong Xie , Lei Wang , Tao Xiang

Restricted Boltzmann Machines (RBMs) offer a versatile architecture for unsupervised machine learning that can in principle approximate any target probability distribution with arbitrary accuracy. However, the RBM model is usually not…

Machine Learning · Computer Science 2022-09-27 Lennart Dabelow , Masahito Ueda