Gibbs Sampling with Low-Power Spiking Digital Neurons
Abstract
Restricted Boltzmann Machines and Deep Belief Networks have been successfully used in a wide variety of applications including image classification and speech recognition. Inference and learning in these algorithms uses a Markov Chain Monte Carlo procedure called Gibbs sampling. A sigmoidal function forms the kernel of this sampler which can be realized from the firing statistics of noisy integrate-and-fire neurons on a neuromorphic VLSI substrate. This paper demonstrates such an implementation on an array of digital spiking neurons with stochastic leak and threshold properties for inference tasks and presents some key performance metrics for such a hardware-based sampler in both the generative and discriminative contexts.
Cite
@article{arxiv.1503.07793,
title = {Gibbs Sampling with Low-Power Spiking Digital Neurons},
author = {Srinjoy Das and Bruno Umbria Pedroni and Paul Merolla and John Arthur and Andrew S. Cassidy and Bryan L. Jackson and Dharmendra Modha and Gert Cauwenberghs and Ken Kreutz-Delgado},
journal= {arXiv preprint arXiv:1503.07793},
year = {2015}
}
Comments
Accepted at ISCAS 2015