English
Related papers

Related papers: Overcoming the Weight Transport Problem via Spike-…

200 papers

Spiking neural networks (SNN) have recently emerged as alternatives to traditional neural networks, owing to energy efficiency benefits and capacity to better capture biological neuronal mechanisms. However, the classic backpropagation…

Neural and Evolutionary Computing · Computer Science 2023-03-13 Jane H. Lee , Saeid Haghighatshoar , Amin Karbasi

Unitary neural networks are promising alternatives for solving the exploding and vanishing activation/gradient problem without the need for explicit normalization that reduces the inference speed. However, they often require longer training…

Machine Learning · Computer Science 2021-02-22 Hao-Yuan Chang

Biological neurons can detect complex spatio-temporal features in spiking patterns via their synapses spread across across their dendritic branches. This is achieved by modulating the efficacy of the individual synapses, and by exploiting…

Emerging Technologies · Computer Science 2023-12-15 Melika Payvand , Simone D'Agostino , Filippo Moro , Yigit Demirag , Giacomo Indiveri , Elisa Vianello

Synaptic delays play a crucial role in biological neuronal networks, where their modulation has been observed in mammalian learning processes. In the realm of neuromorphic computing, although spiking neural networks (SNNs) aim to emulate…

Neural and Evolutionary Computing · Computer Science 2025-06-19 Marissa Dominijanni , Alexander Ororbia , Kenneth W. Regan

As an important class of spiking neural networks (SNNs), recurrent spiking neural networks (RSNNs) possess great computational power and have been widely used for processing sequential data like audio and text. However, most RSNNs suffer…

Neural and Evolutionary Computing · Computer Science 2020-10-27 Wenrui Zhang , Peng Li

Brain-inspired spiking neural networks (SNNs) have recently drawn more and more attention due to their event-driven and energy-efficient characteristics. The integration of storage and computation paradigm on neuromorphic hardwares makes…

Neural and Evolutionary Computing · Computer Science 2022-10-14 Yufei Guo , Liwen Zhang , Yuanpei Chen , Xinyi Tong , Xiaode Liu , YingLei Wang , Xuhui Huang , Zhe Ma

Spiking neural networks (SNNs) are energy-efficient neural networks because of their spiking nature. However, as the spike firing rate of SNNs increases, the energy consumption does as well, and thus, the advantage of SNNs diminishes. Here,…

Machine Learning · Computer Science 2024-01-15 Kazuma Suetake , Takuya Ushimaru , Ryuji Saiin , Yoshihide Sawada

Spiking Neural Networks (SNNs) have garnered attention over recent years due to their increased energy efficiency and advantages in terms of operational complexity compared to traditional Artificial Neural Networks (ANNs). Two important…

Neural and Evolutionary Computing · Computer Science 2025-01-15 Daniel Windhager , Lothar Ratschbacher , Bernhard A. Moser , Michael Lunglmayr

Spikes are the currency in central nervous systems for information transmission and processing. They are also believed to play an essential role in low-power consumption of the biological systems, whose efficiency attracts increasing…

Neural and Evolutionary Computing · Computer Science 2020-05-05 Qiang Yu , Shenglan Li , Huajin Tang , Longbiao Wang , Jianwu Dang , Kay Chen Tan

The representation of the natural-density, heterogeneous connectivity of neuronal network models at relevant spatial scales remains a challenge for Computational Neuroscience and Neuromorphic Computing. In particular, the memory demands…

Neurons and Cognition · Quantitative Biology 2022-09-16 Stefan Dasbach , Tom Tetzlaff , Markus Diesmann , Johanna Senk

Spiking neural networks (SNNs) that enable low-power design on edge devices have recently attracted significant research. However, the temporal characteristic of SNNs causes high latency, high bandwidth and high energy consumption for the…

Hardware Architecture · Computer Science 2022-05-05 Hong-Han Lien , Chung-Wei Hsu , Tian-Sheuan Chang

Evaluation of spiking neural networks requires fetching a large number of synaptic weights to update postsynaptic neurons. This limits parallelism and becomes a bottleneck for hardware. We present an approach for spike propagation based on…

Neural and Evolutionary Computing · Computer Science 2020-01-28 Abinand Nallathambi , Nitin Chandrachoodan

Spiking neural networks (SNNs) are brain-inspired models that enable energy-efficient implementation on neuromorphic hardware. However, the supervised training of SNNs remains a hard problem due to the discontinuity of the spiking neuron…

Neural and Evolutionary Computing · Computer Science 2021-12-20 Mingqing Xiao , Qingyan Meng , Zongpeng Zhang , Yisen Wang , Zhouchen Lin

Advances in neuroscience have enabled researchers to measure the activities of large numbers of neurons simultaneously in behaving animals. We have access to the fluorescence of each of the neurons which provides a first-order approximation…

Neurons and Cognition · Quantitative Biology 2023-07-21 Abhisek Chakraborty

The last decade has seen the parallel emergence in computational neuroscience and machine learning of neural network structures which spread the input signal randomly to a higher dimensional space; perform a nonlinear activation; and then…

Neural and Evolutionary Computing · Computer Science 2013-06-11 Jonathan Tapson , Andre van Schaik

For energy-efficient computation in specialized neuromorphic hardware, we present spiking neural coding, an instantiation of a family of artificial neural models grounded in the theory of predictive coding. This model, the first of its…

Neural and Evolutionary Computing · Computer Science 2022-08-09 Alexander Ororbia

Deep spiking neural networks (SNNs) hold great potential for improving the latency and energy efficiency of deep neural networks through event-based computation. However, training such networks is difficult due to the non-differentiable…

Neural and Evolutionary Computing · Computer Science 2016-09-01 Jun Haeng Lee , Tobi Delbruck , Michael Pfeiffer

Inspired by biology, spiking neural networks (SNNs) process information via discrete spikes over time, offering an energy-efficient alternative to the classical computing paradigm and classical artificial neural networks (ANNs). In this…

Neural and Evolutionary Computing · Computer Science 2025-12-19 Shayan Hundrieser , Philipp Tuchel , Insung Kong , Johannes Schmidt-Hieber

Spiking neural network (SNN), as a brain-inspired energy-efficient neural network, has attracted the interest of researchers. While the training of spiking neural networks is still an open problem. One effective way is to map the weight of…

Neural and Evolutionary Computing · Computer Science 2022-05-10 Yang Li , Yi Zeng

Spiking neural networks are a type of artificial neural networks in which communication between neurons is only made of events, also called spikes. This property allows neural networks to make asynchronous and sparse computations and…

Neural and Evolutionary Computing · Computer Science 2024-05-07 Florent De Geeter , Damien Ernst , Guillaume Drion