English
Related papers

Related papers: Feature Learning with Gaussian Restricted Boltzman…

200 papers

Restricted Boltzmann Machines (RBMs) and models derived from them have been successfully used as basic building blocks in deep artificial neural networks for automatic features extraction, unsupervised weights initialization, but also as…

Neural and Evolutionary Computing · Computer Science 2016-07-20 Decebal Constantin Mocanu , Elena Mocanu , Phuong H. Nguyen , Madeleine Gibescu , Antonio Liotta

Many real-world tasks, from associative memory to symbolic reasoning, benefit from discrete, structured representations that standard continuous latent models can struggle to express. We introduce the Gaussian-Multinoulli Restricted…

Machine Learning · Computer Science 2026-03-11 Nikhil Kapasi , Mohamed Elfouly , William Whitehead , Luke Theogarajan

In audio applications, one of the most important representations of audio signals is the amplitude spectrogram. It is utilized in many machine-learning-based information processing methods including the ones using the restricted Boltzmann…

Audio and Speech Processing · Electrical Eng. & Systems 2020-06-26 Toru Nakashika , Kohei Yatabe

Extracting automatically the complex set of features composing real high-dimensional data is crucial for achieving high performance in machine--learning tasks. Restricted Boltzmann Machines (RBM) are empirically known to be efficient for…

Data Analysis, Statistics and Probability · Physics 2017-04-05 Jérôme Tubiana , Rémi Monasson

The Restricted Boltzmann Machine (RBM) is one of the simplest generative neural networks capable of learning input distributions. Despite its simplicity, the analysis of its performance in learning from the training data is only well…

Machine Learning · Computer Science 2025-11-13 Yizhou Xu , Florent Krzakala , Lenka Zdeborová

Building a good generative model for image has long been an important topic in computer vision and machine learning. Restricted Boltzmann machine (RBM) is one of such models that is simple but powerful. However, its restricted form also has…

Machine Learning · Computer Science 2016-11-24 Hengyuan Hu , Lisheng Gao , Quanbin Ma

A comparative study of the application of Gaussian Mixture Model (GMM) and Radial Basis Function (RBF) in biometric recognition of voice has been carried out and presented. The application of machine learning techniques to biometric…

Machine Learning · Computer Science 2012-11-13 Fatai Adesina Anifowose

Graphical models are powerful tools for modeling high-dimensional data, but learning graphical models in the presence of latent variables is well-known to be difficult. In this work we give new results for learning Restricted Boltzmann…

Machine Learning · Computer Science 2020-07-28 Surbhi Goel , Adam Klivans , Frederic Koehler

Conditional Restricted Boltzmann Machines (CRBMs) are rich probabilistic models that have recently been applied to a wide range of problems, including collaborative filtering, classification, and modeling motion capture data. While much…

Machine Learning · Computer Science 2012-02-20 Volodymyr Mnih , Hugo Larochelle , Geoffrey E. Hinton

The success of any machine learning system depends critically on effective representations of data. In many cases, it is desirable that a representation scheme uncovers the parts-based, additive nature of the data. Of current representation…

Machine Learning · Computer Science 2017-08-21 Tu Dinh Nguyen , Truyen Tran , Dinh Phung , Svetha Venkatesh

The Restricted Boltzmann Machine (RBM), an important tool used in machine learning in particular for unsupervized learning tasks, is investigated from the perspective of its spectral properties. Starting from empirical observations, we…

Disordered Systems and Neural Networks · Physics 2018-01-17 Aurélien Decelle , Giancarlo Fissore , Cyril Furtlehner

Ordinal data is omnipresent in almost all multiuser-generated feedback - questionnaires, preferences etc. This paper investigates modelling of ordinal data with Gaussian restricted Boltzmann machines (RBMs). In particular, we present the…

Machine Learning · Statistics 2014-08-04 Truyen Tran , Dinh Phung , Svetha Venkatesh

The Gaussian-Bernoulli restricted Boltzmann machine (GB-RBM) is a useful generative model that captures meaningful features from the given $n$-dimensional continuous data. The difficulties associated with learning GB-RBM are reported…

Machine Learning · Computer Science 2021-02-15 Vidyadhar Upadhya , P S Sastry

Generalization is one of the most important issues in machine learning problems. In this study, we consider generalization in restricted Boltzmann machines (RBMs). We propose an RBM with multivalued hidden variables, which is a simple…

Machine Learning · Statistics 2020-01-09 Yuuki Yokoyama , Tomu Katsumata , Muneki Yasuda

Restricted Boltzmann Machines (RBMs) are a common family of undirected graphical models with latent variables. An RBM is described by a bipartite graph, with all observed variables in one layer and all latent variables in the other. We…

Machine Learning · Computer Science 2020-10-20 Guy Bresler , Rares-Darius Buhai

Restricted Boltzmann Machine (RBM) is a generative stochastic energy-based model of artificial neural network for unsupervised learning. Recently, RBM is well known to be a pre-training method of Deep Learning. In addition to visible and…

Neural and Evolutionary Computing · Computer Science 2018-07-12 Shin Kamada , Takumi Ichimura

Learning invariant representations is a critical task in computer vision. In this paper, we propose the Theta-Restricted Boltzmann Machine ({\theta}-RBM in short), which builds upon the original RBM formulation and injects the notion of…

Computer Vision and Pattern Recognition · Computer Science 2016-06-30 Mario Valerio Giuffrida , Sotirios A. Tsaftaris

An extreme learning machine (ELM) is a three-layered feed-forward neural network having untrained parameters, which are randomly determined before training. Inspired by the idea of ELM, a probabilistic untrained layer called a…

Machine Learning · Computer Science 2022-10-28 Yuri Kanno , Muneki Yasuda

Conditional generative models are capable of using contextual information as input to create new imaginative outputs. Conditional Restricted Boltzmann Machines (CRBMs) are one class of conditional generative models that have proven to be…

Machine Learning · Computer Science 2023-05-16 Alex H. Lang , Anton D. Loukianov , Charles K. Fisher

A restricted Boltzmann machine (RBM) learns a probability distribution over its input samples and has numerous uses like dimensionality reduction, classification and generative modeling. Conventional RBMs accept vectorized data that…

Computer Vision and Pattern Recognition · Computer Science 2018-11-13 Cong Chen , Kim Batselier , Ching-Yun Ko , Ngai Wong