English
Related papers

Related papers: Supervised Learning without Backpropagation using …

200 papers

Precise spatio-temporal patterns of neuronal action potentials underly e.g. sensory representations and control of muscle activities. However, it is not known how the synaptic efficacies in the neuronal networks of the brain adapt such that…

Neurons and Cognition · Quantitative Biology 2015-02-24 Christian Albers , Maren Westkott , Klaus Pawelzik

A common view in the neuroscience community is that memory is encoded in the connection strength between neurons. This perception led artificial neural network models to focus on connection weights as the key variables to modulate learning.…

Neural and Evolutionary Computing · Computer Science 2022-02-22 Hananel Hazan , Simon Caby , Christopher Earl , Hava Siegelmann , Michael Levin

The use of analog resistance states for storing weights in neuromorphic systems is impeded by fabrication imprecision and device stochasticity that limit the precision of synapse weights. This challenge can be resolved by emulating analog…

Neural and Evolutionary Computing · Computer Science 2021-12-13 Peng Zhou , Julie A. Smith , Laura Deremo , Stephen K. Heinrich-Barna , Joseph S. Friedman

Deep spiking neural networks (SNNs) hold great potential for improving the latency and energy efficiency of deep neural networks through event-based computation. However, training such networks is difficult due to the non-differentiable…

Neural and Evolutionary Computing · Computer Science 2016-09-01 Jun Haeng Lee , Tobi Delbruck , Michael Pfeiffer

Building spiking neural networks (SNNs) based on biological synaptic plasticities holds a promising potential for accomplishing fast and energy-efficient computing, which is beneficial to mobile robotic applications. However, the…

Neural and Evolutionary Computing · Computer Science 2020-03-11 Zhenshan Bing , Claus Meschede , Guang Chen , Alois Knoll , Kai Huang

The adaptive changes in synaptic efficacy that occur between spiking neurons have been demonstrated to play a critical role in learning for biological neural networks. Despite this source of inspiration, many learning focused applications…

Neural and Evolutionary Computing · Computer Science 2022-05-30 Samuel Schmidgall , Julia Ashkanazy , Wallace Lawson , Joe Hays

In recent years, Spiking Neural Networks (SNNs) have demonstrated great successes in completing various Machine Learning tasks. We introduce a method for learning image features by \textit{locally connected layers} in SNNs using…

Neural and Evolutionary Computing · Computer Science 2019-04-15 Daniel J. Saunders , Devdhar Patel , Hananel Hazan , Hava T. Siegelmann , Robert Kozma

Spiking Neural Networks (SNNs) use spatio-temporal spike patterns to represent and transmit information, which is not only biologically realistic but also suitable for ultra-low-power event-driven neuromorphic implementation. Motivated by…

Neural and Evolutionary Computing · Computer Science 2020-11-05 Malu Zhang , Jiadong Wang , Burin Amornpaisannon , Zhixuan Zhang , VPK Miriyala , Ammar Belatreche , Hong Qu , Jibin Wu , Yansong Chua , Trevor E. Carlson , Haizhou Li

We propose a memory efficient method, named Stochastic Backpropagation (SBP), for training deep neural networks on videos. It is based on the finding that gradients from incomplete execution for backpropagation can still effectively train…

Computer Vision and Pattern Recognition · Computer Science 2022-04-01 Feng Cheng , Mingze Xu , Yuanjun Xiong , Hao Chen , Xinyu Li , Wei Li , Wei Xia

Brain-inspired machine intelligence research seeks to develop computational models that emulate the information processing and adaptability that distinguishes biological systems of neurons. This has led to the development of spiking neural…

Neural and Evolutionary Computing · Computer Science 2024-10-28 Alexander Ororbia

Spiking neural networks (SNNs) are promising in a bio-plausible coding for spatio-temporal information and event-driven signal processing, which is very suited for energy-efficient implementation in neuromorphic hardware. However, the…

Neural and Evolutionary Computing · Computer Science 2020-12-21 Hanle Zheng , Yujie Wu , Lei Deng , Yifan Hu , Guoqi Li

While surrogate backpropagation proves useful for training deep spiking neural networks (SNNs), incorporating biologically inspired local signals on a large scale remains challenging. This difficulty stems primarily from the high memory…

Neural and Evolutionary Computing · Computer Science 2025-12-09 Yuchen Tian , Samuel Tensingh , Jason Eshraghian , Nhan Duy Truong , Omid Kavehei

Recent research in the field of spiking neural networks (SNNs) has shown that recurrent variants of SNNs, namely long short-term SNNs (LSNNs), can be trained via error gradients just as effective as LSTMs. The underlying learning method…

Neural and Evolutionary Computing · Computer Science 2020-06-18 Manuel Traub , Martin V. Butz , R. Harald Baayen , Sebastian Otte

There has been an increasing interest in spiking neural networks in recent years. SNNs are seen as hypothetical solutions for the bottlenecks of ANNs in pattern recognition, such as energy efficiency. But current methods such as ANN-to-SNN…

Computer Vision and Pattern Recognition · Computer Science 2021-07-06 El-Assal Mireille , Tirilly Pierre , Bilasco Ioan Marius

Spiking neuron networks have been used successfully to solve simple reinforcement learning tasks with continuous action set applying learning rules based on spike-timing-dependent plasticity (STDP). However, most of these models cannot be…

Machine Learning · Computer Science 2020-09-01 Stephen Chung , Robert Kozma

Spike Timing-Dependent Plasticity (STDP) is a promising substitute to backpropagation for local training of Spiking Neural Networks (SNNs) on neuromorphic hardware. STDP allows SNNs to address classification tasks by combining unsupervised…

Computer Vision and Pattern Recognition · Computer Science 2024-10-23 Gaspard Goupy , Pierre Tirilly , Ioan Marius Bilasco

Spiking neural networks (SNNs) are well suited for spatio-temporal learning and implementations on energy-efficient event-driven neuromorphic processors. However, existing SNN error backpropagation (BP) methods lack proper handling of…

Neural and Evolutionary Computing · Computer Science 2021-06-08 Wenrui Zhang , Peng Li

Neural networks have shown great potential in many applications like speech recognition, drug discovery, image classification, and object detection. Neural network models are inspired by biological neural networks, but they are optimized to…

Neural and Evolutionary Computing · Computer Science 2018-03-23 Yuan Zeng , Kevin Devincentis , Yao Xiao , Zubayer Ibne Ferdous , Xiaochen Guo , Zhiyuan Yan , Yevgeny Berdichevsky

Artificial Spiking Neural Networks (ASNNs) promise greater information processing efficiency because of discrete event-based (i.e., spike) computation. Several Machine Learning (ML) applications use biologically inspired plasticity…

Machine Learning · Computer Science 2022-03-15 Mahima Milinda Alwis Weerasinghe , David Parry , Grace Wang , Jacqueline Whalley

This paper presents a constructive algorithm that achieves successful one-shot learning of hidden spike-patterns in a competitive detection task. It has previously been shown (Masquelier et al., 2008) that spike-timing-dependent plasticity…

Neurons and Cognition · Quantitative Biology 2017-08-31 Toby Lightheart , Steven Grainger , Tien-Fu Lu