English
Related papers

Related papers: Restricted Boltzmann machine to determine the inpu…

200 papers

We present a closed form expression for initializing the input weights in a multi-layer perceptron, which can be used as the first step in synthesis of an Extreme Learning Ma-chine. The expression is based on the standard function for a…

Neural and Evolutionary Computing · Computer Science 2014-06-12 Jonathan Tapson , Philip de Chazal , André van Schaik

In multi-task learning (MTL), related tasks learn jointly to improve generalization performance. To exploit the high learning speed of extreme learning machines (ELMs), we apply the ELM framework to the MTL problem, where the output weights…

Machine Learning · Computer Science 2019-04-26 Yu Ye , Ming Xiao , Mikael Skoglund

The restricted Boltzmann machine (RBM) is one of the fundamental building blocks of deep learning. RBM finds wide applications in dimensional reduction, feature extraction, and recommender systems via modeling the probability distributions…

Strongly Correlated Electrons · Physics 2018-02-07 Jing Chen , Song Cheng , Haidong Xie , Lei Wang , Tao Xiang

Restricted Boltzmann machines (RBMs) are a powerful class of generative models, but their training requires computing a gradient that, unlike supervised backpropagation on typical loss functions, is notoriously difficult even to…

Machine Learning · Computer Science 2020-11-03 Haik Manukian , Yan Ru Pei , Sean R. B. Bearden , Massimiliano Di Ventra

Reinforcement learning is a popular machine learning paradigm which can find near optimal solutions to complex problems. Most often, these procedures involve function approximation using neural networks with gradient based updates to…

Neural and Evolutionary Computing · Computer Science 2020-06-05 Callum Wilson , Annalisa Riccardi , Edmondo Minisci

Finding suitable features has been an essential problem in computer vision. We focus on Restricted Boltzmann Machines (RBMs), which, despite their versatility, cannot accommodate transformations that may occur in the scene. As a result,…

Computer Vision and Pattern Recognition · Computer Science 2016-11-15 Mario Valerio Giuffrida , Sotirios A. Tsaftaris

The paper presents a robust parameter learning methodology for identification of nonlinear dynamical system from data while satisfying safety and stability constraints in the context of learning from demonstration (LfD) methods. Extreme…

Systems and Control · Electrical Eng. & Systems 2022-12-12 Iman Salehi , Ghananeel Rotithor , Ashwin P. Dani

This review deals with Restricted Boltzmann Machine (RBM) under the light of statistical physics. The RBM is a classical family of Machine learning (ML) models which played a central role in the development of deep learning. Viewing it as a…

Disordered Systems and Neural Networks · Physics 2023-07-17 Aurélien Decelle , Cyril Furtlehner

Recent advances in training deep (multi-layer) architectures have inspired a renaissance in neural network use. For example, deep convolutional networks are becoming the default option for difficult tasks on large datasets, such as image…

Neural and Evolutionary Computing · Computer Science 2016-02-17 Mark D. McDonnell , Migel D. Tissera , Tony Vladusich , André van Schaik , Jonathan Tapson

Conventional extreme learning machines solve a Moore-Penrose generalized inverse of hidden layer activated matrix and analytically determine the output weights to achieve generalized performance, by assuming the same loss from different…

Computer Vision and Pattern Recognition · Computer Science 2016-11-15 Lei Zhang , David Zhang

We propose a novel quantum model for the restricted Boltzmann machine (RBM), in which the visible units remain classical whereas the hidden units are quantized as noninteracting fermions. The free motion of the fermions is parametrically…

Disordered Systems and Neural Networks · Physics 2021-02-15 Ya. S. Lyakhova , E. A. Polyakov , A. N. Rubtsov

Restricted Boltzmann Machines (RBMs) are widely used probabilistic undirected graphical models with visible and latent nodes, playing an important role in statistics and machine learning. The task of structure learning for RBMs involves…

Quantum Physics · Physics 2023-09-26 Liming Zhao , Aman Agrawal , Patrick Rebentrost

Learning invariant representations is a critical task in computer vision. In this paper, we propose the Theta-Restricted Boltzmann Machine ({\theta}-RBM in short), which builds upon the original RBM formulation and injects the notion of…

Computer Vision and Pattern Recognition · Computer Science 2016-06-30 Mario Valerio Giuffrida , Sotirios A. Tsaftaris

This work concerns receiver design for light emitting diode (LED) communications where the LED nonlinearity can severely degrade the performance of communications. We propose extreme learning machine (ELM) based non-iterative receivers and…

Signal Processing · Electrical Eng. & Systems 2020-12-30 Dawei Gao , Qinghua Guo , Jun Tong , Nan Wu , Jiangtao Xi , Yanguang Yu

We present a new statistical learning paradigm for Boltzmann machines based on a new inference principle we have proposed: the latent maximum entropy principle (LME). LME is different both from Jaynes maximum entropy principle and from…

Machine Learning · Computer Science 2012-12-12 Shaojun Wang , Dale Schuurmans , Fuchun Peng , Yunxin Zhao

Machine learning models have become an essential tool in current indoor positioning solutions, given their high capabilities to extract meaningful information from the environment. Convolutional neural networks (CNNs) are one of the most…

Signal Processing · Electrical Eng. & Systems 2022-07-19 Darwin Quezada-Gaibor , Joaquín Torres-Sospedra , Jari Nurmi , Yevgeni Koucheryavy , Joaquín Huerta

We introduce a rapid and precise analytical approach for analyzing cerebral blood flow (CBF) using Diffuse Correlation Spectroscopy (DCS) with the application of the Extreme Learning Machine (ELM). Our evaluation of ELM and existing…

Machine Learning · Computer Science 2024-02-02 Xi Chen , Zhenya Zang , Xingda Li

Restricted Boltzmann Machines (RBMs) and models derived from them have been successfully used as basic building blocks in deep artificial neural networks for automatic features extraction, unsupervised weights initialization, but also as…

Neural and Evolutionary Computing · Computer Science 2016-07-20 Decebal Constantin Mocanu , Elena Mocanu , Phuong H. Nguyen , Madeleine Gibescu , Antonio Liotta

This paper introduces a novel approach for multi-task regression that connects Kernel Machines (KMs) and Extreme Learning Machines (ELMs) through the exploitation of the Random Fourier Features (RFFs) approximation of the RBF kernel. In…

Short-term traffic volume prediction models have been extensively studied in the past few decades. However, most of the previous studies only focus on single-value prediction. Considering the uncertain and chaotic nature of the…

Neural and Evolutionary Computing · Computer Science 2017-11-15 Lei Lin , John Handley , Adel Sadek