English
Related papers

Related papers: Generalising the Discriminative Restricted Boltzma…

200 papers

A Bayesian Deep Restricted Boltzmann-Kohonen architecture for data clustering termed as DRBM-ClustNet is proposed. This core-clustering engine consists of a Deep Restricted Boltzmann Machine (DRBM) for processing unlabeled data by creating…

Restricted Boltzmann Machines (RBMs) are widely used probabilistic undirected graphical models with visible and latent nodes, playing an important role in statistics and machine learning. The task of structure learning for RBMs involves…

Quantum Physics · Physics 2023-09-26 Liming Zhao , Aman Agrawal , Patrick Rebentrost

We develop a fractional extension of the classical binomial distribution and the associated Bernstein operator, formulated within the framework of the generalized binomial theorem (Hara and Hino [Bull.\ London Math.\ Soc. \textbf{42}…

Probability · Mathematics 2026-02-26 Masanori Hino , Ryuya Namba

We study the type of distributions that Restricted Boltzmann Machines (RBMs) with different activation functions can express by investigating the effect of the activation function of the hidden nodes on the marginal distribution they impose…

Machine Learning · Statistics 2021-03-31 Nicola Bulso , Yasser Roudi

Restricted Boltzmann Machines (RBMs) are a class of generative neural network that are typically trained to maximize a log-likelihood objective function. We argue that likelihood-based training strategies may fail because the objective does…

Machine Learning · Statistics 2018-04-25 Charles K. Fisher , Aaron M. Smith , Jonathan R. Walsh

Finding suitable features has been an essential problem in computer vision. We focus on Restricted Boltzmann Machines (RBMs), which, despite their versatility, cannot accommodate transformations that may occur in the scene. As a result,…

Computer Vision and Pattern Recognition · Computer Science 2016-11-15 Mario Valerio Giuffrida , Sotirios A. Tsaftaris

We investigate the potential of a restricted Boltzmann Machine (RBM) for discriminative representation learning. By imposing the class information preservation constraints on the hidden layer of the RBM, we propose a Signed Laplacian…

Computer Vision and Pattern Recognition · Computer Science 2018-08-29 Dongdong Chen , Jiancheng Lv , Mike E. Davies

A restricted Boltzmann machine (RBM) is a generative neural-network model with many novel applications such as collaborative filtering and acoustic modeling. An RBM lacks the capacity to retain memory, making it inappropriate for dynamic…

Machine Learning · Statistics 2018-05-01 Jefferson Hernandez , Andres G. Abad

The Degree Corrected Stochastic Block Model (DCSBM) was introduced by \cite{karrer2011stochastic} as a generalization of the stochastic block model in which vertices of the same community are allowed to have distinct degree distributions.…

Statistics Theory · Mathematics 2024-06-27 Andressa Cerqueira , Sandro Gallo , Florencia Leonardi , Cristel Vera

Many computer vision applications involve modeling complex spatio-temporal patterns in high-dimensional motion data. Recently, restricted Boltzmann machines (RBMs) have been widely used to capture and represent spatial patterns in a single…

Computer Vision and Pattern Recognition · Computer Science 2017-10-24 Siqi Nie , Ziheng Wang , Qiang Ji

Estimation of Distribution Algorithms (EDAs) require flexible probability models that can be efficiently learned and sampled. Restricted Boltzmann Machines (RBMs) are generative neural networks with these desired properties. We integrate an…

Neural and Evolutionary Computing · Computer Science 2014-12-01 Malte Probst , Franz Rothlauf , Jörn Grahl

Conditional generative models are capable of using contextual information as input to create new imaginative outputs. Conditional Restricted Boltzmann Machines (CRBMs) are one class of conditional generative models that have proven to be…

Machine Learning · Computer Science 2023-05-16 Alex H. Lang , Anton D. Loukianov , Charles K. Fisher

The class of Labeled Random Finite Set filters known as the delta-Generalized Labeled Multi-Bernoulli (dGLMB) filter represents the filtering density as a set of weighted hypotheses, with each hypothesis consisting of a set of labeled…

Signal Processing · Electrical Eng. & Systems 2021-08-10 Lingji Chen

We show how deep learning methods can be applied in the context of crowdsourcing and unsupervised ensemble learning. First, we prove that the popular model of Dawid and Skene, which assumes that all classifiers are conditionally…

Machine Learning · Statistics 2017-04-24 Uri Shaham , Xiuyuan Cheng , Omer Dror , Ariel Jaffe , Boaz Nadler , Joseph Chang , Yuval Kluger

The restricted Boltzmann machine (RBM) is a flexible tool for modeling complex data, however there have been significant computational difficulties in using RBMs to model high-dimensional multinomial observations. In natural language…

Machine Learning · Computer Science 2012-07-06 George E. Dahl , Ryan P. Adams , Hugo Larochelle

We develop a probabilistic framework for deep learning based on the Deep Rendering Mixture Model (DRMM), a new generative probabilistic model that explicitly capture variations in data due to latent task nuisance variables. We demonstrate…

Machine Learning · Statistics 2016-12-07 Ankit B. Patel , Tan Nguyen , Richard G. Baraniuk

A restricted Boltzmann machine (RBM) learns a probability distribution over its input samples and has numerous uses like dimensionality reduction, classification and generative modeling. Conventional RBMs accept vectorized data that…

Computer Vision and Pattern Recognition · Computer Science 2018-11-13 Cong Chen , Kim Batselier , Ching-Yun Ko , Ngai Wong

There is emerging interest in performing regression between distributions. In contrast to prediction on single instances, these machine learning methods can be useful for population-based studies or on problems that are inherently…

Machine Learning · Computer Science 2019-06-03 Connie Kou , Hwee Kuan Lee , Jorge Sanz , Teck Khim Ng

We present transductive Boltzmann machines (TBMs), which firstly achieve transductive learning of the Gibbs distribution. While exact learning of the Gibbs distribution is impossible by the family of existing Boltzmann machines due to…

Machine Learning · Statistics 2018-05-22 Mahito Sugiyama , Koji Tsuda , Hiroyuki Nakahara

We present a mathematical construction for the restricted Boltzmann machine (RBM) that doesn't require specifying the number of hidden units. In fact, the hidden layer size is adaptive and can grow during training. This is obtained by first…

Machine Learning · Computer Science 2016-03-21 Marc-Alexandre Côté , Hugo Larochelle