English
Related papers

Related papers: Enhanced Factored Three-Way Restricted Boltzmann M…

200 papers

Most speech enhancement algorithms make use of the short-time Fourier transform (STFT), which is a simple and flexible time-frequency decomposition that estimates the short-time spectrum of a signal. However, the duration of short STFT…

Sound · Computer Science 2015-09-03 Scott Wisdom , Thomas Powers , Les Atlas , James Pitton

Acoustic models in real-time speech recognition systems typically stack multiple unidirectional LSTM layers to process the acoustic frames over time. Performance improvements over vanilla LSTM architectures have been reported by prepending…

Audio and Speech Processing · Electrical Eng. & Systems 2020-07-02 Maarten Van Segbroeck , Harish Mallidih , Brian King , I-Fan Chen , Gurpreet Chadha , Roland Maas

The deep extension of the restricted Boltzmann machine (RBM), known as the deep Boltzmann machine (DBM), is an expressive family of machine learning models which can serve as compact representations of complex probability distributions.…

Machine Learning · Computer Science 2021-02-18 Haik Manukian , Massimiliano Di Ventra

Restricted Boltzmann Machines (RBMs) are generative models which can learn useful representations from samples of a dataset in an unsupervised fashion. They have been widely employed as an unsupervised pre-training method in machine…

Machine Learning · Statistics 2013-09-13 Chris Häusler , Alex Susemihl , Martin P Nawrot , Manfred Opper

In this study, a novel machine learning algorithm, restricted Boltzmann machine (RBM), is introduced. The algorithm is applied for the spectral classification in astronomy. RBM is a bipartite generative graphical model with two separate…

Machine Learning · Computer Science 2013-10-15 Fuqiang Chen , Yan Wu , Yude Bu , Guodong Zhao

An extreme learning machine (ELM) is a three-layered feed-forward neural network having untrained parameters, which are randomly determined before training. Inspired by the idea of ELM, a probabilistic untrained layer called a…

Machine Learning · Computer Science 2022-10-28 Yuri Kanno , Muneki Yasuda

We propose an extension of the Restricted Boltzmann Machine (RBM) that allows the joint shape and appearance of foreground objects in cluttered images to be modeled independently of the background. We present a learning scheme that learns…

Machine Learning · Computer Science 2011-07-20 Nicolas Heess , Nicolas Le Roux , John Winn

Much work has been done refining and characterizing the receptive fields learned by deep learning algorithms. A lot of this work has focused on the development of Gabor-like filters learned when enforcing sparsity constraints on a natural…

Machine Learning · Statistics 2012-11-01 Chris Häusler , Alex Susemihl

We are interested in exploring the possibility and benefits of structure learning for deep models. As the first step, this paper investigates the matter for Restricted Boltzmann Machines (RBMs). We conduct the study with Replicated Softmax,…

Machine Learning · Computer Science 2018-08-07 Zhourong Chen , Nevin L. Zhang , Dit-Yan Yeung , Peixian Chen

Factorization machines (FM) are a popular model class to learn pairwise interactions by a low-rank approximation. Different from existing FM-based approaches which use a fixed rank for all features, this paper proposes a Rank-Aware FM…

Machine Learning · Computer Science 2019-05-21 Xiaoshuang Chen , Yin Zheng , Jiaxing Wang , Wenye Ma , Junzhou Huang

The restricted Boltzmann machine (RBM) is one of the fundamental building blocks of deep learning. RBM finds wide applications in dimensional reduction, feature extraction, and recommender systems via modeling the probability distributions…

Strongly Correlated Electrons · Physics 2018-02-07 Jing Chen , Song Cheng , Haidong Xie , Lei Wang , Tao Xiang

We propose FSB-LSTM, a novel long short-term memory (LSTM) based architecture that integrates full- and sub-band (FSB) modeling, for single- and multi-channel speech enhancement in the short-time Fourier transform (STFT) domain. The model…

Audio and Speech Processing · Electrical Eng. & Systems 2023-04-19 Zhong-Qiu Wang , Samuele Cornell , Shukjae Choi , Younglo Lee , Byeong-Yeol Kim , Shinji Watanabe

Finding suitable features has been an essential problem in computer vision. We focus on Restricted Boltzmann Machines (RBMs), which, despite their versatility, cannot accommodate transformations that may occur in the scene. As a result,…

Computer Vision and Pattern Recognition · Computer Science 2016-11-15 Mario Valerio Giuffrida , Sotirios A. Tsaftaris

Restricted Boltzmann Machines are generative models that consist of a layer of hidden variables connected to another layer of visible units, and they are used to model the distribution over visible variables. In order to gain a higher…

Computer Vision and Pattern Recognition · Computer Science 2023-06-20 Arkaitz Bidaurrazaga , Aritz Pérez , Roberto Santana

This paper presents our contribution to the 3rd CHiME Speech Separation and Recognition Challenge. Our system uses Bidirectional Long Short-Term Memory (BLSTM) Recurrent Neural Networks (RNNs) for Single-channel Speech Enhancement (SSE).…

Sound · Computer Science 2015-10-02 Amr El-Desoky Mousa , Erik Marchi , Björn Schuller

Most of the deep learning based speech enhancement (SE) methods rely on estimating the magnitude spectrum of the clean speech signal from the observed noisy speech signal, either by magnitude spectral masking or regression. These methods…

Audio and Speech Processing · Electrical Eng. & Systems 2020-10-28 Raktim Gautam Goswami , Sivaganesh Andhavarapu , K Sri Rama Murty

Restricted Boltzmann Machines (RBMs) are a common family of undirected graphical models with latent variables. An RBM is described by a bipartite graph, with all observed variables in one layer and all latent variables in the other. We…

Machine Learning · Computer Science 2020-10-20 Guy Bresler , Rares-Darius Buhai

This paper presents a novel approach to speaker subspace modelling based on Gaussian-Binary Restricted Boltzmann Machines (GRBM). The proposed model is based on the idea of shared factors as in the Probabilistic Linear Discriminant Analysis…

Machine Learning · Computer Science 2015-03-19 Danila Doroshin , Alexander Yamshinin , Nikolay Lubimov , Marina Nastasenko , Mikhail Kotov , Maxim Tkachenko

We consider the problem of discriminatively learning restricted Boltzmann machines in the presence of relational data. Unlike previous approaches that employ a rule learner (for structure learning) and a weight learner (for parameter…

Machine Learning · Computer Science 2020-01-29 Navdeep Kaur , Gautam Kunapuli , Sriraam Natarajan

Speech foundation models (SFMs), such as Open Whisper-Style Speech Models (OWSM), are trained on massive datasets to achieve accurate automatic speech recognition. However, even SFMs struggle to accurately recognize rare and unseen words.…

Sound · Computer Science 2025-06-12 Yui Sudo , Yusuke Fujita , Atsushi Kojima , Tomoya Mizumoto , Lianbo Liu