English
Related papers

Related papers: Spike-based alignment learning solves the weight t…

200 papers

Spiking neural network (SNN) is a brain-inspired model which has more spatio-temporal information processing capacity and computational energy efficiency. However, with the increasing depth of SNNs, the memory problem caused by the weights…

Neural and Evolutionary Computing · Computer Science 2022-08-02 Changqing Xu , Yijian Pei , Zili Wu , Yi Liu , Yintang Yang

Equilibrium Propagation (EP) is a biologically plausible local learning algorithm initially developed for convergent recurrent neural networks (RNNs), where weight updates rely solely on the connecting neuron states across two phases. The…

Neural and Evolutionary Computing · Computer Science 2024-07-04 Jiaqi Lin , Malyaban Bal , Abhronil Sengupta

A semi-supervised learning method for spiking neural networks is proposed. The proposed method consists of supervised learning by backpropagation and subsequent unsupervised learning by spike-timing-dependent plasticity (STDP), which is a…

Neural and Evolutionary Computing · Computer Science 2021-06-23 Kotaro Furuya , Jun Ohkubo

Backpropagation (BP) is the cornerstone of today's deep learning algorithms, but it is inefficient partially because of backward locking, which means updating the weights of one layer locks the weight updates in the other layers.…

Neural and Evolutionary Computing · Computer Science 2021-02-10 Yu-Wei Kao , Hung-Hsuan Chen

Backpropagation is driving today's artificial neural networks (ANNs). However, despite extensive research, it remains unclear if the brain implements this algorithm. Among neuroscientists, reinforcement learning (RL) algorithms are often…

Neurons and Cognition · Quantitative Biology 2020-04-24 Benjamin James Lansdell , Prashanth Ravi Prakash , Konrad Paul Kording

Models of sensory processing and learning in the cortex need to efficiently assign credit to synapses in all areas. In deep learning, a known solution is error backpropagation, which however requires biologically implausible weight…

Neurons and Cognition · Quantitative Biology 2024-02-05 Kevin Max , Laura Kriener , Garibaldi Pineda García , Thomas Nowotny , Ismael Jaras , Walter Senn , Mihai A. Petrovici

The plasticity property of biological neural networks allows them to perform learning and optimize their behavior by changing their configuration. Inspired by biology, plasticity can be modeled in artificial neural networks by using Hebbian…

Neural and Evolutionary Computing · Computer Science 2020-12-21 Anil Yaman , Giovanni Iacca , Decebal Constantin Mocanu , George Fletcher , Mykola Pechenizkiy

Spiking neural networks (SNNs) possess energy-efficient potential due to event-based computation. However, supervised training of SNNs remains a challenge as spike activities are non-differentiable. Previous SNNs training methods can be…

Neural and Evolutionary Computing · Computer Science 2019-10-08 Yunzhe Hao , Xuhui Huang , Meng Dong , Bo Xu

Spiking neural networks (SNN) have recently emerged as alternatives to traditional neural networks, owing to energy efficiency benefits and capacity to better capture biological neuronal mechanisms. However, the classic backpropagation…

Neural and Evolutionary Computing · Computer Science 2023-03-13 Jane H. Lee , Saeid Haghighatshoar , Amin Karbasi

Spike-timing-dependent plasticity (STDP) provides a biologically-plausible learning mechanism for spiking neural networks (SNNs); however, Hebbian weight updates in architectures with recurrent connections suffer from pathological weight…

Neural and Evolutionary Computing · Computer Science 2026-01-14 Andreas Massey , Aliaksandr Hubin , Stefano Nichele , Solve Sæbø

Spiking neural networks play an important role in brain-like neuromorphic computations and in studying working mechanisms of neural circuits. One drawback of training a large scale spiking neural network is that updating all weights is…

Neurons and Cognition · Quantitative Biology 2024-08-15 Zhanghan Lin , Haiping Huang

Understanding how biological neural networks are shaped via local plasticity mechanisms can lead to energy-efficient and self-adaptive information processing systems, which promises to mitigate some of the current roadblocks in edge…

Neural and Evolutionary Computing · Computer Science 2025-04-10 Willian Soares Girão , Nicoletta Risi , Elisabetta Chicca

The neural plausibility of backpropagation has long been disputed, primarily for its use of non-local weight transport $-$ the biologically dubious requirement that one neuron instantaneously measure the synaptic weights of another. Until…

Neurons and Cognition · Quantitative Biology 2020-06-26 Daniel Kunin , Aran Nayebi , Javier Sagastuy-Brena , Surya Ganguli , Jonathan M. Bloom , Daniel L. K. Yamins

In this article, we propose a new paradigm for training spiking neural networks (SNNs), spike accumulation forwarding (SAF). It is known that SNNs are energy-efficient but difficult to train. Consequently, many researchers have proposed…

Neural and Evolutionary Computing · Computer Science 2024-07-01 Ryuji Saiin , Tomoya Shirakawa , Sota Yoshihara , Yoshihide Sawada , Hiroyuki Kusumoto

Networks of interconnected neurons communicating through spiking signals offer the bedrock of neural computations. Our brains spiking neural networks have the computational capacity to achieve complex pattern recognition and cognitive…

Neural and Evolutionary Computing · Computer Science 2024-12-06 Naresh Ravichandran , Anders Lansner , Pawel Herman

A fundamental feature of learning in animals is the "ability to forget" that allows an organism to perceive, model and make decisions from disparate streams of information and adapt to changing environments. Against this backdrop, we…

Neural and Evolutionary Computing · Computer Science 2018-06-12 Priyadarshini Panda , Jason M. Allred , Shriram Ramanathan , Kaushik Roy

Spiking Neural Networks (SNN). SNNs are based on a more biologically inspired approach than usual artificial neural networks. Such models are characterized by complex dynamics between neurons and spikes. These are very sensitive to the…

Neural and Evolutionary Computing · Computer Science 2024-09-06 Thomas Firmin , Pierre Boulet , El-Ghazali Talbi

Spiking Neural Networks (SNNs) are promising energy-efficient models for neuromorphic computing. For training the non-differentiable SNN models, the backpropagation through time (BPTT) with surrogate gradients (SG) method has achieved high…

Neural and Evolutionary Computing · Computer Science 2023-08-08 Qingyan Meng , Mingqing Xiao , Shen Yan , Yisen Wang , Zhouchen Lin , Zhi-Quan Luo

Spiking neural networks (SNNs) can utilize spatio-temporal information and have a nature of energy efficiency which is a good alternative to deep neural networks(DNNs). The event-driven information processing makes SNNs can reduce the…

Neural and Evolutionary Computing · Computer Science 2021-12-15 Changqing Xu , Yi Liu , Yintang Yang

Spiking Neural Networks (SNNs) use spatio-temporal spike patterns to represent and transmit information, which is not only biologically realistic but also suitable for ultra-low-power event-driven neuromorphic implementation. Motivated by…

Neural and Evolutionary Computing · Computer Science 2020-11-05 Malu Zhang , Jiadong Wang , Burin Amornpaisannon , Zhixuan Zhang , VPK Miriyala , Ammar Belatreche , Hong Qu , Jibin Wu , Yansong Chua , Trevor E. Carlson , Haizhou Li