English
Related papers

Related papers: Stochastic Spiking Attention: Accelerating Attenti…

200 papers

Recently, large models, such as Vision Transformer and BERT, have garnered significant attention due to their exceptional performance. However, their extensive computational requirements lead to considerable power and hardware resource…

Hardware Architecture · Computer Science 2025-01-15 Zhengke Li , Wendong Mao , Siyu Zhang , Qiwei Dong , Zhongfeng Wang

In this work, we propose stochastic Binary Spiking Neural Network (sBSNN) composed of stochastic spiking neurons and binary synapses (stochastic only during training) that computes probabilistically with one-bit precision for…

Emerging Technologies · Computer Science 2020-02-27 Minsuk Koo , Gopalakrishnan Srinivasan , Yong Shim , Kaushik Roy

Spiking neural networks (SNNs) recently gained momentum due to their low-power multiplication-free computing and the closer resemblance of biological processes in the nervous system of humans. However, SNNs require very long spike trains…

Hardware Architecture · Computer Science 2022-06-07 Daniel Gerlinghoff , Zhehui Wang , Xiaozhe Gu , Rick Siow Mong Goh , Tao Luo

The rising demand for energy-efficient edge AI systems (e.g., mobile agents/robots) has increased the interest in neuromorphic computing, since it offers ultra-low power/energy AI computation through spiking neural network (SNN) algorithms…

Neural and Evolutionary Computing · Computer Science 2026-01-06 Rachmad Vidya Wicaksana Putra , Pasindu Wickramasinghe , Muhammad Shafique

In the last few years, spiking neural networks have been demonstrated to perform on par with regular convolutional neural networks. Several works have proposed methods to convert a pre-trained CNN to a Spiking CNN without a significant…

Neural and Evolutionary Computing · Computer Science 2020-05-05 Martino Sorbaro , Qian Liu , Massimo Bortone , Sadique Sheik

The machine learning community has become increasingly interested in the energy efficiency of neural networks. The Spiking Neural Network (SNN) is a promising approach to energy-efficient computing, since its activation levels are quantized…

Machine Learning · Computer Science 2021-03-03 Aaron R. Voelker , Daniel Rasmussen , Chris Eliasmith

The integration of neuromorphic computing and transformers through spiking neural networks (SNNs) offers a promising path to energy-efficient sequence modeling, with the potential to overcome the energy-intensive nature of the artificial…

Hardware Architecture · Computer Science 2025-04-23 Zihang Song , Prabodh Katti , Osvaldo Simeone , Bipin Rajendran

Spiking Neural Networks (SNNs) have gained significant attention in edge computing due to their low power consumption and computational efficiency. However, existing implementations either use conventional System on Chip (SoC) architectures…

Hardware Architecture · Computer Science 2026-03-13 Kanishka Gunawardana , Sanka Peeris , Kavishka Rambukwella , Thamish Wanduragala , Saadia Jameel , Roshan Ragel , Isuru Nawinne

Spiking Neural Networks(SNNs) provide a brain-inspired and event-driven mechanism that is believed to be critical to unlock energy-efficient deep learning. The mixture-of-experts approach mirrors the parallel distributed processing of…

Neural and Evolutionary Computing · Computer Science 2024-12-10 Boxun Xu , Junyoung Hwang , Pruek Vanna-iampikul , Yuxuan Yin , Sung Kyu Lim , Peng Li

Spiking Neural Network (SNN) is the third generation of Neural Network (NN) mimicking the natural behavior of the brain. By processing based on binary input/output, SNNs offer lower complexity, higher density and lower power consumption.…

Neural and Evolutionary Computing · Computer Science 2020-03-24 Khanh N. Dang , Abderazek Ben Abdallah

Spiking neural networks (SNNs) have shown advantages in computation and energy efficiency over traditional artificial neural networks (ANNs) thanks to their event-driven representations. SNNs also replace weight multiplications in ANNs with…

Neural and Evolutionary Computing · Computer Science 2023-06-01 Yangfan Hu , Qian Zheng , Xudong Jiang , Gang Pan

Deep 'Analog Artificial Neural Networks' (ANNs) perform complex classification problems with remarkably high accuracy. However, they rely on humongous amount of power to perform the calculations, veiling the accuracy benefits. The…

Emerging Technologies · Computer Science 2018-04-17 Parami Wijesinghe , Aayush Ankit , Abhronil Sengupta , Kaushik Roy

Ensuring energy-efficient design in neuromorphic computing systems necessitates a tailored architecture combined with algorithmic approaches. This manuscript focuses on enhancing brain-inspired perceptual computing machines through a novel…

Neural and Evolutionary Computing · Computer Science 2024-08-15 Ali Shiri Sichani , Sai Kankatala

Spiking neural networks (SNNs) have garnered interest due to their energy efficiency and superior effectiveness on neuromorphic chips compared with traditional artificial neural networks (ANNs). One of the mainstream approaches to…

Neural and Evolutionary Computing · Computer Science 2024-04-29 Zhipeng Huang , Jianhao Ding , Zhiyu Pan , Haoran Li , Ying Fang , Zhaofei Yu , Jian K. Liu

Neuromorphic computing, which exploits Spiking Neural Networks (SNNs) on neuromorphic chips, is a promising energy-efficient alternative to traditional AI. CNN-based SNNs are the current mainstream of neuromorphic computing. By contrast, no…

Neural and Evolutionary Computing · Computer Science 2024-04-08 Man Yao , Jiakui Hu , Tianxiang Hu , Yifan Xu , Zhaokun Zhou , Yonghong Tian , Bo Xu , Guoqi Li

The combination of Spiking Neural Networks (SNNs) with Vision Transformer architectures has garnered significant attention due to their potential for energy-efficient and high-performance computing paradigms. However, a substantial…

Computer Vision and Pattern Recognition · Computer Science 2025-06-19 Wei Hua , Chenlin Zhou , Jibin Wu , Yansong Chua , Yangyang Shu

Spiking Neural Networks (SNNs), recognized as the third generation of neural networks, are known for their bio-plausibility and energy efficiency, especially when implemented on neuromorphic hardware. However, the majority of existing…

Neural and Evolutionary Computing · Computer Science 2024-07-02 Yi Jiang , Sen Lu , Abhronil Sengupta

Spiking Neural Networks (SNNs) are a promising, energy-efficient alternative to standard Artificial Neural Networks (ANNs) and are particularly well-suited to spatio-temporal tasks such as keyword spotting and video classification. However,…

Neural and Evolutionary Computing · Computer Science 2026-02-09 Zainab Aizaz , James C. Knight , Thomas Nowotny

Spiking Neural Networks (SNNs) have attracted the attention of the deep learning community for use in low-latency, low-power neuromorphic hardware, as well as models for understanding neuroscience. In this paper, we introduce Spiking Phasor…

Neural and Evolutionary Computing · Computer Science 2022-04-04 Connor Bybee , E. Paxon Frady , Friedrich T. Sommer

Spiking Neural Networks (SNNs) offer a biologically inspired computational paradigm, enabling energy-efficient data processing through spike-based information transmission. Despite notable advancements in hardware for SNNs, spike encoding…

Signal Processing · Electrical Eng. & Systems 2025-06-03 MHD Anas Alsakkal , Runze Wang , Piotr Dudek , Jayawan Wijekoon