English
Related papers

Related papers: Perception-Distortion Trade-off with Restricted Bo…

200 papers

Restricted Boltzman Machines (RBMs) have been successfully used in recommender systems. However, as with most of other collaborative filtering techniques, it cannot solve cold start problems for there is no rating for a new item. In this…

Information Retrieval · Computer Science 2014-08-04 Jiankou Li , Wei Zhang

Restricted Boltzmann machine (RBM) provide a general framework for modeling physical systems, but their behavior is dependent on hyperparameters such as the learning rate, the number of hidden nodes and the form of the threshold function.…

Computational Physics · Physics 2020-04-28 David Yevick , Roger Melko

Large-scale electrophysiological recordings now allow simultaneous monitoring of thousands of neurons across multiple brain regions, revealing structured variability in neural population activity. Understanding how these collective patterns…

Neurons and Cognition · Quantitative Biology 2026-03-12 Nicolas Béreux , Giovanni Catania , Aurélien Decelle , Francesca Mignacco , Alfonso de Jesús Navas Gómez , Beatriz Seoane

We propose a new approach to combine Restricted Boltzmann Machines (RBMs) that can be used to solve combinatorial optimization problems. This allows synthesis of larger models from smaller RBMs that have been pretrained, thus effectively…

Machine Learning · Computer Science 2019-09-10 Saavan Patel , Sayeef Salahuddin

A new approach to maximum likelihood learning of discrete graphical models and RBM in particular is introduced. Our method, Perturb and Descend (PD) is inspired by two ideas (I) perturb and MAP method for sampling (II) learning by…

Neural and Evolutionary Computing · Computer Science 2014-05-08 Siamak Ravanbakhsh , Russell Greiner , Brendan Frey

Restricted Boltzmann machines~(RBMs) and conditional RBMs~(CRBMs) are popular models for a wide range of applications. In previous work, learning on such models has been dominated by contrastive divergence~(CD) and its variants. Belief…

Machine Learning · Computer Science 2017-03-06 Wei Ping , Alexander Ihler

Graphical models are powerful tools for modeling high-dimensional data, but learning graphical models in the presence of latent variables is well-known to be difficult. In this work we give new results for learning Restricted Boltzmann…

Machine Learning · Computer Science 2020-07-28 Surbhi Goel , Adam Klivans , Frederic Koehler

Restricted Boltzmann machines (RBMs) are endowed with the universal power of modeling (binary) joint distributions. Meanwhile, as a result of their confining network structure, training RBMs confronts less difficulties (compared with more…

Machine Learning · Computer Science 2015-10-22 Sai Zhang

Restricted Boltzmann Machines (RBMs) are a common family of undirected graphical models with latent variables. An RBM is described by a bipartite graph, with all observed variables in one layer and all latent variables in the other. We…

Machine Learning · Computer Science 2020-10-20 Guy Bresler , Rares-Darius Buhai

Ordinal data is omnipresent in almost all multiuser-generated feedback - questionnaires, preferences etc. This paper investigates modelling of ordinal data with Gaussian restricted Boltzmann machines (RBMs). In particular, we present the…

Machine Learning · Statistics 2014-08-04 Truyen Tran , Dinh Phung , Svetha Venkatesh

A goal of unsupervised machine learning is to build representations of complex high-dimensional data, with simple relations to their properties. Such disentangled representations make easier to interpret the significant latent factors of…

Machine Learning · Computer Science 2023-04-06 Jorge Fernandez-de-Cossio-Diaz , Simona Cocco , Remi Monasson

This review deals with Restricted Boltzmann Machine (RBM) under the light of statistical physics. The RBM is a classical family of Machine learning (ML) models which played a central role in the development of deep learning. Viewing it as a…

Disordered Systems and Neural Networks · Physics 2023-07-17 Aurélien Decelle , Cyril Furtlehner

The restricted Boltzmann machine (RBM) is a flexible tool for modeling complex data, however there have been significant computational difficulties in using RBMs to model high-dimensional multinomial observations. In natural language…

Machine Learning · Computer Science 2012-07-06 George E. Dahl , Ryan P. Adams , Hugo Larochelle

Restricted Boltzmann Machines are generative models that consist of a layer of hidden variables connected to another layer of visible units, and they are used to model the distribution over visible variables. In order to gain a higher…

Computer Vision and Pattern Recognition · Computer Science 2023-06-20 Arkaitz Bidaurrazaga , Aritz Pérez , Roberto Santana

The restricted Boltzmann machine is a network of stochastic units with undirected interactions between pairs of visible and hidden units. This model was popularized as a building block of deep learning architectures and has continued to…

Machine Learning · Computer Science 2018-06-20 Guido Montufar

Building a good generative model for image has long been an important topic in computer vision and machine learning. Restricted Boltzmann machine (RBM) is one of such models that is simple but powerful. However, its restricted form also has…

Machine Learning · Computer Science 2016-11-24 Hengyuan Hu , Lisheng Gao , Quanbin Ma

Gaussian-Bernoulli restricted Boltzmann machines (GBRBMs) are often used for semi-supervised anomaly detection, where they are trained using only normal data points. In GBRBM-based anomaly detection, normal and anomalous data are classified…

Machine Learning · Computer Science 2024-03-20 Kaiji Sekimoto , Muneki Yasuda

We consider the problem of classification when inputs correspond to sets of vectors. This setting occurs in many problems such as the classification of pieces of mail containing several pages, of web sites with several sections or of images…

Machine Learning · Computer Science 2011-03-28 Jérôme Louradour , Hugo Larochelle

A restricted Boltzmann machine (RBM) is an undirected graphical model constructed for discrete or continuous random variables, with two layers, one hidden and one visible, and no conditional dependency within a layer. In recent years, RBMs…

Machine Learning · Statistics 2019-09-12 Andee Kaplan , Daniel Nordman , Stephen Vardeman

We present a mathematical construction for the restricted Boltzmann machine (RBM) that doesn't require specifying the number of hidden units. In fact, the hidden layer size is adaptive and can grow during training. This is obtained by first…

Machine Learning · Computer Science 2016-03-21 Marc-Alexandre Côté , Hugo Larochelle