English
Related papers

Related papers: Towards High-performance Spiking Transformers from…

200 papers

Spiking neural network (SNN), as a brain-inspired energy-efficient neural network, has attracted the interest of researchers. While the training of spiking neural networks is still an open problem. One effective way is to map the weight of…

Neural and Evolutionary Computing · Computer Science 2022-05-10 Yang Li , Yi Zeng

Spiking Neural Networks (SNNs) are increasingly recognized for their biological plausibility and energy efficiency, positioning them as strong alternatives to Artificial Neural Networks (ANNs) in neuromorphic computing applications. SNNs…

Neural and Evolutionary Computing · Computer Science 2025-07-14 Kairong Yu , Tianqing Zhang , Qi Xu , Gang Pan , Hongwei Wang

Artificial Neural Networks (ANNs) are bio-inspired models of neural computation that have proven highly effective. Still, ANNs lack a natural notion of time, and neural units in ANNs exchange analog values in a frame-based manner, a…

Neural and Evolutionary Computing · Computer Science 2017-10-16 Davide Zambrano , Roeland Nusselder , H. Steven Scholte , Sander Bohte

Spiking Neural Networks (SNNs) operate with asynchronous discrete events (or spikes) which can potentially lead to higher energy-efficiency in neuromorphic hardware implementations. Many works have shown that an SNN for inference can be…

Machine Learning · Computer Science 2020-05-06 Nitin Rathi , Gopalakrishnan Srinivasan , Priyadarshini Panda , Kaushik Roy

Spiking Neural Networks (SNNs) have recently attracted significant research interest as the third generation of artificial neural networks that can enable low-power event-driven data analytics. The best performing SNNs for image recognition…

Neural and Evolutionary Computing · Computer Science 2020-04-02 Bing Han , Gopalakrishnan Srinivasan , Kaushik Roy

Spiking Neural Network (SNN) has been recognized as one of the next generation of neural networks. Conventionally, SNN can be converted from a pre-trained ANN by only replacing the ReLU activation to spike activation while keeping the…

Machine Learning · Computer Science 2021-06-15 Yuhang Li , Shikuang Deng , Xin Dong , Ruihao Gong , Shi Gu

Spiking Neural Networks (SNNs) offer a more energy-efficient alternative to Artificial Neural Networks (ANNs) by mimicking biological neural principles, establishing them as a promising approach to mitigate the increasing energy demands of…

Machine Learning · Computer Science 2025-02-24 Velibor Bojković , Xiaofeng Wu , Bin Gu

Spiking Neural Networks (SNNs) have emerged as a popular spatio-temporal computing paradigm for complex vision tasks. Recently proposed SNN training algorithms have significantly reduced the number of time steps (down to 1) for improved…

Computer Vision and Pattern Recognition · Computer Science 2023-11-29 Gourav Datta , Zeyu Liu , Anni Li , Peter A. Beerel

Spiking Neural Networks (SNN) are a class of bio-inspired neural networks that promise to bring low-power and low-latency inference to edge devices through asynchronous and sparse processing. However, being temporal models, SNNs depend…

Computer Vision and Pattern Recognition · Computer Science 2024-04-19 Asude Aydin , Mathias Gehrig , Daniel Gehrig , Davide Scaramuzza

Transformers have demonstrated outstanding performance across a wide range of tasks, owing to their self-attention mechanism, but they are highly energy-consuming. Spiking Neural Networks have emerged as a promising energy-efficient…

Computer Vision and Pattern Recognition · Computer Science 2025-03-18 Yufei Guo , Xiaode Liu , Yuanpei Chen , Weihang Peng , Yuhan Zhang , Zhe Ma

Spiking neural networks (SNNs) operating with asynchronous discrete events show higher energy efficiency with sparse computation. A popular approach for implementing deep SNNs is ANN-SNN conversion combining both efficient training of ANNs…

Neural and Evolutionary Computing · Computer Science 2024-03-20 Ziming Wang , Shuang Lian , Yuhao Zhang , Xiaoxin Cui , Rui Yan , Huajin Tang

The spiking neural network (SNN) computes and communicates information through discrete binary events. It is considered more biologically plausible and more energy-efficient than artificial neural networks (ANN) in emerging neuromorphic…

Neural and Evolutionary Computing · Computer Science 2021-05-28 Yang Li , Yi Zeng , Dongcheng Zhao

Spiking neural networks (SNNs) provide an energy-efficient alternative to a variety of artificial neural network (ANN) based AI applications. As the progress in neuromorphic computing with SNNs expands their use in applications, the problem…

Neural and Evolutionary Computing · Computer Science 2024-04-15 Ozan Özdenizci , Robert Legenstein

Leveraging the event-driven paradigm, Spiking Neural Networks (SNNs) offer a promising approach for energy-efficient Transformer architectures.While ANN-to-SNN conversion avoids the high training cost of directly trained Spiking…

Machine Learning · Computer Science 2025-12-16 Jingya Wang , Xin Deng , Wenjie Wei , Dehao Zhang , Shuai Wang , Qian Sun , Jieyuan Zhang , Hanwen Liu , Ning Xie , Malu Zhang

Spiking Neural Networks (SNNs) have received extensive academic attention due to the unique properties of low power consumption and high-speed computing on neuromorphic chips. Among various training methods of SNNs, ANN-SNN conversion has…

Neural and Evolutionary Computing · Computer Science 2023-02-07 Zecheng Hao , Tong Bu , Jianhao Ding , Tiejun Huang , Zhaofei Yu

Spiking Neural Networks (SNNs) have emerged as a promising third generation of neural networks, offering unique characteristics such as binary outputs, high sparsity, and biological plausibility. However, the lack of effective learning…

Neural and Evolutionary Computing · Computer Science 2024-03-01 Liuzhenghao Lv , Wei Fang , Li Yuan , Yonghong Tian

The combination of Spiking Neural Networks (SNNs) and Transformers has attracted significant attention due to their potential for high energy efficiency and high-performance nature. However, existing works on this topic typically rely on…

Neural and Evolutionary Computing · Computer Science 2023-07-18 Ziqing Wang , Yuetong Fang , Jiahang Cao , Qiang Zhang , Zhongrui Wang , Renjing Xu

Spiking Neural Networks (SNNs) are seen as an energy-efficient alternative to traditional Artificial Neural Networks (ANNs), but the performance gap remains a challenge. While this gap is narrowing through ANN-to-SNN conversion, substantial…

Computer Vision and Pattern Recognition · Computer Science 2024-12-24 Ziqing Wang , Yuetong Fang , Jiahang Cao , Hongwei Ren , Renjing Xu

Spiking Neural Networks (SNNs) represent the latest generation of neural computation, offering a brain-inspired alternative to conventional Artificial Neural Networks (ANNs). Unlike ANNs, which depend on continuous-valued signals, SNNs…

Neural and Evolutionary Computing · Computer Science 2025-11-03 Sales G. Aribe

Spiking Neural Networks (SNNs) have recently attracted widespread research interest as an efficient alternative to traditional Artificial Neural Networks (ANNs) because of their capability to process sparse and binary spike information and…

Neural and Evolutionary Computing · Computer Science 2023-05-30 Yuhang Li , Abhishek Moitra , Tamar Geller , Priyadarshini Panda