English
Related papers

Related papers: Temporal Surrogate Back-propagation for Spiking Ne…

200 papers

Spiking neural networks (SNNs) can be used in low-power and embedded systems (such as emerging neuromorphic chips) due to their event-based nature. Also, they have the advantage of low computation cost in contrast to conventional artificial…

Computer Vision and Pattern Recognition · Computer Science 2021-01-20 Ali Samadzadeh , Fatemeh Sadat Tabatabaei Far , Ali Javadi , Ahmad Nickabadi , Morteza Haghir Chehreghani

Spiking Neural Networks are often touted as brain-inspired learning models for the third wave of Artificial Intelligence. Although recent SNNs trained with supervised backpropagation show classification accuracy comparable to deep networks,…

Neural and Evolutionary Computing · Computer Science 2022-11-09 Biswadeep Chakraborty , Saibal Mukhopadhyay

Spiking neural networks are nature's versatile solution to fault-tolerant and energy efficient signal processing. To translate these benefits into hardware, a growing number of neuromorphic spiking neural network processors attempt to…

Neural and Evolutionary Computing · Computer Science 2019-05-06 Emre O. Neftci , Hesham Mostafa , Friedemann Zenke

Spiking neural networks (SNNs) promise ultra-low-power applications by exploiting temporal and spatial sparsity. The number of binary activations, called spikes, is proportional to the power consumed when executed on neuromorphic hardware.…

Computer Vision and Pattern Recognition · Computer Science 2024-06-25 Gregor Lenz , Garrick Orchard , Sadique Sheik

Spiking neural networks (SNNs), inspired by the spiking behavior of biological neurons, provide a unique pathway for capturing the intricacies of temporal data. However, applying SNNs to time-series forecasting is challenging due to…

Neural and Evolutionary Computing · Computer Science 2024-05-30 Changze Lv , Yansen Wang , Dongqi Han , Xiaoqing Zheng , Xuanjing Huang , Dongsheng Li

Spiking neural networks (SNN) are artificial computational models that have been inspired by the brain's ability to naturally encode and process information in the time domain. The added temporal dimension is believed to render them more…

Emerging Technologies · Computer Science 2019-05-29 S. R. Nandakumar , Irem Boybat , Manuel Le Gallo , Evangelos Eleftheriou , Abu Sebastian , Bipin Rajendran

Spiking Neural Networks (SNNs) are biologically plausible models that have been identified as potentially apt for deploying energy-efficient intelligence at the edge, particularly for sequential learning tasks. However, training of SNNs…

Neural and Evolutionary Computing · Computer Science 2025-01-09 Marco Paul E. Apolinario , Kaushik Roy

Foundational models based on the transformer architecture are currently the state-of-the-art in general language modeling, as well as in scientific areas such as material science and climate. However, training and deploying these models is…

Machine Learning · Computer Science 2025-10-16 Adarsha Balaji , Sandeep Madireddy , Prasanna Balaprakash

Spiking Neural Networks (SNNs) have gained huge attention as a potential energy-efficient alternative to conventional Artificial Neural Networks (ANNs) due to their inherent high-sparsity activation. However, most prior SNN methods use…

Neural and Evolutionary Computing · Computer Science 2022-07-22 Youngeun Kim , Yuhang Li , Hyoungseob Park , Yeshwanth Venkatesha , Priyadarshini Panda

Sleep plays an important role in incremental learning and consolidation of memories in biological systems. Motivated by the processes that are known to be involved in sleep generation in biological networks, we developed an algorithm that…

Neural and Evolutionary Computing · Computer Science 2019-08-07 Giri P Krishnan , Timothy Tadros , Ramyaa Ramyaa , Maxim Bazhenov

We propose a new learning algorithm to train spiking neural networks (SNN) using conventional artificial neural networks (ANN) as proxy. We couple two SNN and ANN networks, respectively, made of integrate-and-fire (IF) and ReLU neurons with…

Neural and Evolutionary Computing · Computer Science 2022-08-02 Saeed Reza Kheradpisheh , Maryam Mirsadeghi , Timothée Masquelier

Spiking neural networks (SNNs) are known as a typical kind of brain-inspired models with their unique features of rich neuronal dynamics, diverse coding schemes and low power consumption properties. How to obtain a high-accuracy model has…

Neural and Evolutionary Computing · Computer Science 2022-03-07 Yihan Lin , Yifan Hu , Shijie Ma , Guoqi Li , Dongjie Yu

Artificial Neural Networks (ANNs) are currently being used as function approximators in many state-of-the-art Reinforcement Learning (RL) algorithms. Spiking Neural Networks (SNNs) have been shown to drastically reduce the energy…

Machine Learning · Computer Science 2020-01-23 Bleema Rosenfeld , Osvaldo Simeone , Bipin Rajendran

Spiking Neural Networks (SNNs) have recently emerged as an alternative to deep learning owing to sparse, asynchronous and binary event (or spike) driven processing, that can yield huge energy efficiency benefits on neuromorphic hardware.…

Computer Vision and Pattern Recognition · Computer Science 2021-11-12 Youngeun Kim , Priyadarshini Panda

The information of spiking neural networks (SNNs) are propagated between the adjacent biological neuron by spikes, which provides a computing paradigm with the promise of simulating the human brain. Recent studies have found that the time…

Neural and Evolutionary Computing · Computer Science 2022-05-05 Pengfei Sun , Longwei Zhu , Dick Botteldooren

As an important class of spiking neural networks (SNNs), recurrent spiking neural networks (RSNNs) possess great computational power and have been widely used for processing sequential data like audio and text. However, most RSNNs suffer…

Neural and Evolutionary Computing · Computer Science 2020-10-27 Wenrui Zhang , Peng Li

Spiking neural networks (SNNs) have emerged as energy-efficient neural networks with temporal information. SNNs have shown a superior efficiency on neuromorphic devices, but the devices are susceptible to noise, which hinders them from…

Neural and Evolutionary Computing · Computer Science 2021-04-23 Seongsik Park , Dongjin Lee , Sungroh Yoon

Spiking Neural Networks (SNNs) have recently emerged as the low-power alternative to Artificial Neural Networks (ANNs) owing to their asynchronous, sparse, and binary information processing. To improve the energy-efficiency and throughput,…

Neural and Evolutionary Computing · Computer Science 2022-06-22 Abhiroop Bhattacharjee , Youngeun Kim , Abhishek Moitra , Priyadarshini Panda

As neural interfaces become more advanced, there has been an increase in the volume and complexity of neural data recordings. These interfaces capture rich information about neural dynamics that call for efficient, real-time processing…

Neural and Evolutionary Computing · Computer Science 2024-08-26 Sai Deepesh Pokala , Marie Bernert , Takuya Nanami , Takashi Kohno , Timothée Lévi , Blaise Yvert

Artificial neural networks (ANNs) experience catastrophic forgetting (CF) during sequential learning. In contrast, the brain can learn continuously without any signs of catastrophic forgetting. Spiking neural networks (SNNs) are the next…

Neural and Evolutionary Computing · Computer Science 2022-12-26 Dmitry Antonov , Kirill Sviatov , Sergey Sukhov