English
Related papers

Related papers: Differential Coding for Training-Free ANN-to-SNN C…

200 papers

Spiking Neural Network (SNN) is a promising energy-efficient AI model when implemented on neuromorphic hardware. However, it is a challenge to efficiently train SNNs due to their non-differentiability. Most existing methods either suffer…

Neural and Evolutionary Computing · Computer Science 2023-03-31 Qingyan Meng , Mingqing Xiao , Shen Yan , Yisen Wang , Zhouchen Lin , Zhi-Quan Luo

Biological spiking neural networks (SNNs) can temporally encode information in their outputs, e.g. in the rank order in which neurons fire, whereas artificial neural networks (ANNs) conventionally do not. As a result, models of SNNs for…

Neural and Evolutionary Computing · Computer Science 2023-08-03 Alan Jeffares , Qinghai Guo , Pontus Stenetorp , Timoleon Moraitis

Spiking Neural Network (SNN) has been recognized as one of the next generation of neural networks. Conventionally, SNN can be converted from a pre-trained ANN by only replacing the ReLU activation to spike activation while keeping the…

Machine Learning · Computer Science 2021-06-15 Yuhang Li , Shikuang Deng , Xin Dong , Ruihao Gong , Shi Gu

Spiking neural networks (SNNs) are receiving increasing attention due to their low power consumption and strong bio-plausibility. Optimization of SNNs is a challenging task. Two main methods, artificial neural network (ANN)-to-SNN…

Neural and Evolutionary Computing · Computer Science 2023-05-30 Chunming Jiang , Yilei Zhang

Recent Spiking Neural Networks (SNNs) works focus on an image classification task, therefore various coding techniques have been proposed to convert an image into temporal binary spikes. Among them, rate coding and direct coding are…

Neural and Evolutionary Computing · Computer Science 2022-04-13 Youngeun Kim , Hyoungseob Park , Abhishek Moitra , Abhiroop Bhattacharjee , Yeshwanth Venkatesha , Priyadarshini Panda

Spiking neural networks (SNNs) are brain-inspired mathematical models with the ability to process information in the form of spikes. SNNs are expected to provide not only new machine-learning algorithms, but also energy-efficient…

Neural and Evolutionary Computing · Computer Science 2020-01-16 Yusuke Sakemi , Kai Morino , Takashi Morie , Kazuyuki Aihara

Emerged as a biology-inspired method, Spiking Neural Networks (SNNs) mimic the spiking nature of brain neurons and have received lots of research attention. SNNs deal with binary spikes as their activation and therefore derive extreme…

Computer Vision and Pattern Recognition · Computer Science 2023-05-04 Yufei Guo , Weihang Peng , Yuanpei Chen , Liwen Zhang , Xiaode Liu , Xuhui Huang , Zhe Ma

We introduce a method to convert Physics-Informed Neural Networks (PINNs), commonly used in scientific machine learning, to Spiking Neural Networks (SNNs), which are expected to have higher energy efficiency compared to traditional…

Neural and Evolutionary Computing · Computer Science 2023-09-01 Qian Zhang , Chenxi Wu , Adar Kahana , Youngeun Kim , Yuhang Li , George Em Karniadakis , Priyadarshini Panda

Spiking Neural Networks (SNNs), recognized as the third generation of neural networks, are known for their bio-plausibility and energy efficiency, especially when implemented on neuromorphic hardware. However, the majority of existing…

Neural and Evolutionary Computing · Computer Science 2024-07-02 Yi Jiang , Sen Lu , Abhronil Sengupta

In recent years, spiking neural networks (SNNs) have been used in reinforcement learning (RL) due to their low power consumption and event-driven features. However, spiking reinforcement learning (SRL), which suffers from fixed coding…

Machine Learning · Computer Science 2024-04-25 Lang Qin , Rui Yan , Huajin Tang

In the past decade, advances in Artificial Neural Networks (ANNs) have allowed them to perform extremely well for a wide range of tasks. In fact, they have reached human parity when performing image recognition, for example. Unfortunately,…

Neural and Evolutionary Computing · Computer Science 2024-10-30 Srivatsa P , Kyle Timothy Ng Chu , Burin Amornpaisannon , Yaswanth Tavva , Venkata Pavan Kumar Miriyala , Jibin Wu , Malu Zhang , Haizhou Li , Trevor E. Carlson

Spiking neural networks (SNNs) have advantages in latency and energy efficiency over traditional artificial neural networks (ANNs) due to its event-driven computation mechanism and replacement of energy-consuming weight multiplications with…

Neural and Evolutionary Computing · Computer Science 2023-11-03 Zhehui Wang , Xiaozhe Gu , Rick Goh , Joey Tianyi Zhou , Tao Luo

Spiking neural networks (SNNs) are the third generation of neural networks and can explore both rate and temporal coding for energy-efficient event-driven computation. However, the decision accuracy of existing SNN designs is contingent…

Neural and Evolutionary Computing · Computer Science 2020-02-25 Changqing Xu , Wenrui Zhang , Yu Liu , Peng Li

One of the key challenges in training Spiking Neural Networks (SNNs) is that target outputs typically come in the form of natural signals, such as labels for classification or images for generative models, and need to be encoded into…

Neural and Evolutionary Computing · Computer Science 2021-09-30 Nicolas Skatchkovsky , Osvaldo Simeone , Hyeryung Jang

Spiking neural networks are efficient computation models for low-power environments. Spike-based BP algorithms and ANN-to-SNN (ANN2SNN) conversions are successful techniques for SNN training. Nevertheless, the spike-base BP training is slow…

Neural and Evolutionary Computing · Computer Science 2023-08-31 Jianxiong Tang , Jianhuang Lai , Xiaohua Xie , Lingxiao Yang , Wei-Shi Zheng

Biological neurons communicate with a sparing exchange of pulses - spikes. It is an open question how real spiking neurons produce the kind of powerful neural computation that is possible with deep artificial neural networks, using only so…

Neural and Evolutionary Computing · Computer Science 2016-09-08 Davide Zambrano , Sander M. Bohte

Spiking neural networks (SNNs) have gained considerable interest due to their energy-efficient characteristics, yet lack of a scalable training algorithm has restricted their applicability in practical machine learning problems. The deep…

Neural and Evolutionary Computing · Computer Science 2020-03-27 Seongsik Park , Seijoon Kim , Byunggook Na , Sungroh Yoon

In the past years, artificial neural networks (ANNs) have become the de-facto standard to solve tasks in communications engineering that are difficult to solve with traditional methods. In parallel, the artificial intelligence community…

Signal Processing · Electrical Eng. & Systems 2023-01-19 Eike-Manuel Bansbach , Alexander von Bank , Laurent Schmalen

Gradient descent training techniques are remarkably successful in training analog-valued artificial neural networks (ANNs). Such training techniques, however, do not transfer easily to spiking networks due to the spike generation hard…

Neural and Evolutionary Computing · Computer Science 2017-08-17 Hesham Mostafa

Spiking neural networks (SNNs) are promising in a bio-plausible coding for spatio-temporal information and event-driven signal processing, which is very suited for energy-efficient implementation in neuromorphic hardware. However, the…

Neural and Evolutionary Computing · Computer Science 2020-12-21 Hanle Zheng , Yujie Wu , Lei Deng , Yifan Hu , Guoqi Li