English
Related papers

Related papers: Multi-layered Discriminative Restricted Boltzmann …

200 papers

Estimation of Distribution Algorithms (EDAs) require flexible probability models that can be efficiently learned and sampled. Restricted Boltzmann Machines (RBMs) are generative neural networks with these desired properties. We integrate an…

Neural and Evolutionary Computing · Computer Science 2014-12-01 Malte Probst , Franz Rothlauf , Jörn Grahl

Training deep neural networks (DNNs) from noisy labels is an important and challenging task. However, most existing approaches focus on the corrupted labels and ignore the importance of inherent data structure. To bridge the gap between…

Machine Learning · Computer Science 2024-05-03 Zijia Wang , Wenbin Yang , Zhisong Liu , Zhen Jia

Current large scale implementations of deep learning and data mining require thousands of processors, massive amounts of off-chip memory, and consume gigajoules of energy. Emerging memory technologies such as nanoscale two-terminal…

Neural and Evolutionary Computing · Computer Science 2016-11-15 S. Burc Eryilmaz , Emre Neftci , Siddharth Joshi , SangBum Kim , Matthew BrightSky , Hsiang-Lan Lung , Chung Lam , Gert Cauwenberghs , H. -S. Philip Wong

The requirement of high spectrum efficiency puts forward higher requirements on frame synchronization (FS) in wireless communication systems. Meanwhile, a large number of nonlinear devices or blocks will inevitably cause nonlinear…

Signal Processing · Electrical Eng. & Systems 2021-03-30 Chaojin Qing , Wang Yu , Shuhai Tang , Chuangui Rao , Jiafan Wang

Studies on artificial neural networks rarely address both vanishing gradients and overfitting issues. In this study, we follow the pupil learning procedure, which has the features of interpreting, picking, understanding, cramming, and…

Machine Learning · Computer Science 2023-08-01 Rua-Huan Tsaih , Yu-Hang Chien , Shih-Yi Chien

We set up Restricted Boltzmann Machines (RBM) to reproduce the Long Range Ising (LRI) models of the Ohmic type in one dimension. The RBM parameters are tuned by using the standard machine learning procedure with an additional method of…

Statistical Mechanics · Physics 2017-01-03 Ken-Ichi Aoki , Tamao Kobayashi

Deep learning methods relying on multi-layered networks have been actively studied in a wide range of fields in recent years, and deep Boltzmann machines(DBMs) is one of them. In this study, a model of DBMs with some properites of weight…

Disordered Systems and Neural Networks · Physics 2022-10-06 Yuma Ichikawa , Koji Hukushima

Currently there are two predominant ways to train deep neural networks. The first one uses restricted Boltzmann machine (RBM) and the second one autoencoders. RBMs are stacked in layers to form deep belief network (DBN); the final…

Machine Learning · Computer Science 2016-12-23 Vanika Singhal , Shikha Singh , Angshul Majumdar

This study suggests a new prediction model for chaotic time series inspired by the brain emotional learning of mammals. We describe the structure and function of this model, which is referred to as BELPM (Brain Emotional Learning-Based…

Signal Processing · Electrical Eng. & Systems 2020-05-27 Mahboobeh Parsapoor

Although extreme learning machine (ELM) has been successfully applied to a number of pattern recognition problems, it fails to pro-vide sufficient good results in hyperspectral image (HSI) classification due to two main drawbacks. The first…

Computer Vision and Pattern Recognition · Computer Science 2018-05-15 Faxian Cao , Zhijing Yang , Jinchang Ren , Wing-Kuen Ling

Reconfigurable intelligent surface (RIS)-assisted orthogonal frequency division multiplexing (OFDM) systems have aroused extensive research interests due to the controllable communication environment and the performance of combating…

Signal Processing · Electrical Eng. & Systems 2021-10-27 Chaojin Qing , Li Wang , Lei Dong , Jiafan Wang

Restricted Boltzmann Machines (RBM) have attracted a lot of attention of late, as one the principle building blocks of deep networks. Training RBMs remains problematic however, because of the intractibility of their partition function. The…

Machine Learning · Statistics 2010-12-17 Guillaume Desjardins , Aaron Courville , Yoshua Bengio

We introduce a rapid and precise analytical approach for analyzing cerebral blood flow (CBF) using Diffuse Correlation Spectroscopy (DCS) with the application of the Extreme Learning Machine (ELM). Our evaluation of ELM and existing…

Machine Learning · Computer Science 2024-02-02 Xi Chen , Zhenya Zang , Xingda Li

The restricted Boltzmann machine (RBM) is a neural network based on the Ising model, well known for its ability to learn probability distributions and stochastically generate new content. However, the high computational cost of Gibbs…

Optics · Physics 2026-03-13 Li Luo , Yisheng Fang , Wanyi Zhang , Zhichao Ruan

Conditional restricted Boltzmann machines are undirected stochastic neural networks with a layer of input and output units connected bipartitely to a layer of hidden units. These networks define models of conditional probability…

Neural and Evolutionary Computing · Computer Science 2015-03-13 Guido Montufar , Nihat Ay , Keyan Ghazi-Zahedi

The possibility of employing restricted Boltzmann machine (RBM) for collaborative filtering has been known for about a decade. However, there has been hardly any work on this topic since 2007. This work revisits the application of RBM in…

Machine Learning · Computer Science 2019-10-18 Sagar Verma , Prince Patel , Angshul Majumdar

We present Branch-Train-Merge (BTM), a communication-efficient algorithm for embarrassingly parallel training of large language models (LLMs). We show it is possible to independently train subparts of a new class of LLMs on different…

Computation and Language · Computer Science 2022-08-08 Margaret Li , Suchin Gururangan , Tim Dettmers , Mike Lewis , Tim Althoff , Noah A. Smith , Luke Zettlemoyer

Unsupervised neural networks, such as restricted Boltzmann machines (RBMs) and deep belief networks (DBNs), are powerful tools for feature selection and pattern recognition tasks. We demonstrate that overfitting occurs in such models just…

Machine Learning · Computer Science 2017-02-20 Baiyang Wang , Diego Klabjan

Restricted Boltzmann machines (RBMs) are a class of neural networks that have been successfully employed as a variational ansatz for quantum many-body wave functions. Here, we develop an analytic method to study quantum many-body spin…

Quantum Physics · Physics 2022-10-06 Xiao-Qi Sun , Tamra Nebabu , Xizhi Han , Michael O. Flynn , Xiao-Liang Qi

Latent class model (LCM), which is a finite mixture of different categorical distributions, is one of the most widely used models in statistics and machine learning fields. Because of its non-continuous nature and the flexibility in shape,…

Machine Learning · Statistics 2021-03-23 Hao Chen , Lanshan Han , Alvin Lim