English
Related papers

Related papers: Supervised Learning in Temporally-Coded Spiking Ne…

200 papers

Spiking neural networks have shown great promise for the design of low-power sensory-processing and edge-computing hardware platforms. However, implementing on-chip learning algorithms on such architectures is still an open challenge,…

Neural and Evolutionary Computing · Computer Science 2021-04-13 Matteo Cartiglia , Germain Haessig , Giacomo Indiveri

Spiking neural networks (SNNs) are a viable alternative to conventional artificial neural networks when resource efficiency and computational complexity are of importance. A major advantage of SNNs is their binary information transfer…

Neural and Evolutionary Computing · Computer Science 2023-10-18 Daniel Gerlinghoff , Tao Luo , Rick Siow Mong Goh , Weng-Fai Wong

A vast majority of computation in the brain is performed by spiking neural networks. Despite the ubiquity of such spiking, we currently lack an understanding of how biological spiking neural circuits learn and compute in-vivo, as well as…

Neurons and Cognition · Quantitative Biology 2018-05-31 Friedemann Zenke , Surya Ganguli

We introduce a new supervised learning algorithm based to train spiking neural networks for classification. The algorithm overcomes a limitation of existing multi-spike learning methods: it solves the problem of interference between…

Neural and Evolutionary Computing · Computer Science 2021-08-12 Huy Le Nguyen , Dominique Chu

We introduce an algorithm to do backpropagation on a spiking network. Our network is "spiking" in the sense that our neurons accumulate their activation into a potential over time, and only send out a signal (a "spike") when this potential…

Neural and Evolutionary Computing · Computer Science 2016-11-08 Peter O'Connor , Max Welling

Compared with rate-based artificial neural networks, Spiking Neural Networks (SNN) provide a more biological plausible model for the brain. But how they perform supervised learning remains elusive. Inspired by recent works of Bengio et al.,…

Neural and Evolutionary Computing · Computer Science 2022-03-08 Zhanhao Hu , Tao Wang , Xiaolin Hu

We present a spike-based unsupervised regenerative learning scheme to train Spiking Deep Networks (SpikeCNN) for object recognition problems using biologically realistic leaky integrate-and-fire neurons. The training methodology is based on…

Neural and Evolutionary Computing · Computer Science 2016-02-05 Priyadarshini Panda , Kaushik Roy

Spiking neural networks (SNNs) represent a promising approach in machine learning, combining the hierarchical learning capabilities of deep neural networks with the energy efficiency of spike-based computations. Traditional end-to-end…

Neural and Evolutionary Computing · Computer Science 2024-11-12 Ruyin Wan , Qian Zhang , George Em Karniadakis

Precise spike timing as a means to encode information in neural networks is biologically supported, and is advantageous over frequency-based codes by processing input features on a much shorter time-scale. For these reasons, much recent…

Neural and Evolutionary Computing · Computer Science 2016-10-31 Brian Gardner , André Grüning

Error backpropagation is a highly effective mechanism for learning high-quality hierarchical features in deep networks. Updating the features or weights in one layer, however, requires waiting for the propagation of error signals from…

Neural and Evolutionary Computing · Computer Science 2017-11-21 Hesham Mostafa , Vishwajith Ramesh , Gert Cauwenberghs

The current article introduces a supervised learning algorithm for multilayer spiking neural networks. The algorithm presented here overcomes some limitations of existing learning algorithms as it can be applied to neurons firing multiple…

Neural and Evolutionary Computing · Computer Science 2014-02-04 Ioana Sporea , André Grüning

The vast majority of natural sensory data is temporally redundant. Video frames or audio samples which are sampled at nearby points in time tend to have similar values. Typically, deep learning algorithms take no advantage of this…

Neural and Evolutionary Computing · Computer Science 2017-06-14 Peter O'Connor , Efstratios Gavves , Max Welling

Spiking neural networks (SNN) are artificial computational models that have been inspired by the brain's ability to naturally encode and process information in the time domain. The added temporal dimension is believed to render them more…

Emerging Technologies · Computer Science 2019-05-29 S. R. Nandakumar , Irem Boybat , Manuel Le Gallo , Evangelos Eleftheriou , Abu Sebastian , Bipin Rajendran

A Spiking Neural Network (SNN) can be trained indirectly by first training an Artificial Neural Network (ANN) with the conventional backpropagation algorithm, then converting it into an SNN. The conventional rate-coding method for SNNs uses…

Neural and Evolutionary Computing · Computer Science 2021-06-15 Ming Zhang , Nenggan Zheng , De Ma , Gang Pan , Zonghua Gu

We describe a novel spiking neural network (SNN) for automated, real-time handwritten digit classification and its implementation on a GP-GPU platform. Information processing within the network, from feature extraction to classification is…

Machine Learning · Statistics 2017-11-13 Shruti R. Kulkarni , John M. Alexiades , Bipin Rajendran

Spiking neural network (SNN) is interesting both theoretically and practically because of its strong bio-inspiration nature and potentially outstanding energy efficiency. Unfortunately, its development has fallen far behind the conventional…

Computer Vision and Pattern Recognition · Computer Science 2021-09-20 Shibo Zhou , Xiaohua LI , Ying Chen , Sanjeev T. Chandrasekaran , Arindam Sanyal

Spike-based neuromorphic hardware promises to reduce the energy consumption of image classification and other deep learning applications, particularly on mobile phones or other edge devices. However, direct training of deep spiking neural…

Neural and Evolutionary Computing · Computer Science 2021-01-27 Christoph Stöckl , Wolfgang Maass

We recently proposed the STiDi-BP algorithm, which avoids backward recursive gradient computation, for training multi-layer spiking neural networks (SNNs) with single-spike-based temporal coding. The algorithm employs a linear approximation…

Neural and Evolutionary Computing · Computer Science 2021-09-01 Maryam Mirsadeghi , Majid Shalchian , Saeed Reza Kheradpisheh , Timothée Masquelier

Spiking Neural Networks (SNNs) are being explored for their potential energy efficiency resulting from sparse, event-driven computations. Many recent works have demonstrated effective backpropagation for deep Spiking Neural Networks (SNNs)…

Neural and Evolutionary Computing · Computer Science 2020-03-04 Jason M. Allred , Steven J. Spencer , Gopalakrishnan Srinivasan , Kaushik Roy

Spiking neural networks are a promising approach towards next-generation models of the brain in computational neuroscience. Moreover, compared to classic artificial neural networks, they could serve as an energy-efficient deployment of AI…

Neural and Evolutionary Computing · Computer Science 2021-09-24 Justus F. Hübotter , Pablo Lanillos , Jakub M. Tomczak