English
Related papers

Related papers: Enhancing the Performance of Transformer-based Spi…

200 papers

Deep spiking neural networks (SNNs) have emerged as a potential alternative to traditional deep learning frameworks, due to their promise to provide increased compute efficiency on event-driven neuromorphic hardware. However, to perform…

Neural and Evolutionary Computing · Computer Science 2021-07-28 Souvik Kundu , Gourav Datta , Massoud Pedram , Peter A. Beerel

Brain-inspired Spiking Neural Networks (SNNs) have the characteristics of event-driven and high energy-efficient, which are different from traditional Artificial Neural Networks (ANNs) when deployed on edge devices such as neuromorphic…

Computer Vision and Pattern Recognition · Computer Science 2023-08-10 Jue Chen , Huan Yuan , Jianchao Tan , Bin Chen , Chengru Song , Di Zhang

The ambition of brain-inspired Spiking Neural Networks (SNNs) is to become a low-power alternative to traditional Artificial Neural Networks (ANNs). This work addresses two major challenges in realizing this vision: the performance gap…

Computer Vision and Pattern Recognition · Computer Science 2025-01-22 Man Yao , Xuerui Qiu , Tianxiang Hu , Jiakui Hu , Yuhong Chou , Keyu Tian , Jianxing Liao , Luziwei Leng , Bo Xu , Guoqi Li

We recently proposed the STiDi-BP algorithm, which avoids backward recursive gradient computation, for training multi-layer spiking neural networks (SNNs) with single-spike-based temporal coding. The algorithm employs a linear approximation…

Neural and Evolutionary Computing · Computer Science 2021-09-01 Maryam Mirsadeghi , Majid Shalchian , Saeed Reza Kheradpisheh , Timothée Masquelier

Event cameras are considered to have great potential for computer vision and robotics applications because of their high temporal resolution and low power consumption characteristics. However, the event stream output from event cameras has…

Computer Vision and Pattern Recognition · Computer Science 2022-11-23 Xiaoshan Wu , Weihua He , Man Yao , Ziyang Zhang , Yaoyuan Wang , Guoqi Li

Spiking Neural Networks (SNNs) are increasingly studied as energy-efficient alternatives to Convolutional Neural Networks (CNNs), particularly for edge intelligence. However, prior work has largely emphasized large-scale models, leaving the…

Computer Vision and Pattern Recognition · Computer Science 2026-02-11 Radib Bin Kabir , Tawsif Tashwar Dipto , Mehedi Ahamed , Sabbir Ahmed , Md Hasanul Kabir

Spiking neural networks (SNNs) present a promising energy efficient alternative to traditional Artificial Neural Networks (ANNs) due to their multiplication-free operations enabled by binarized intermediate activations. However, this…

Neural and Evolutionary Computing · Computer Science 2024-10-15 Xiaoting Wang , Yanxiang Zhang

Spiking Neural Networks (SNNs) have been attached great importance due to their biological plausibility and high energy-efficiency on neuromorphic chips. As these chips are usually resource-constrained, the compression of SNNs is thus…

Neural and Evolutionary Computing · Computer Science 2021-08-19 Yanqi Chen , Zhaofei Yu , Wei Fang , Tiejun Huang , Yonghong Tian

Brain-inspired spiking neuron networks (SNNs) have attracted widespread research interest due to their low power features, high biological plausibility, and strong spatiotemporal information processing capability. Although adopting a…

Neural and Evolutionary Computing · Computer Science 2024-09-06 Changqing Xu , Yi Liu , Yintang Yang

Spiking Neural Networks (SNNs) provide energy-efficient computation but their deployment is constrained by dense connectivity and high spiking operation costs. Existing magnitude-based pruning strategies, when naively applied to SNNs, fail…

Machine Learning · Computer Science 2026-03-17 Junqiao Wang , Zhehang Ye , Yuqi Ouyang

Deep convolutional neural networks (CNNs) have shown great potential for numerous real-world machine learning applications, but performing inference in large CNNs in real-time remains a challenge. We have previously demonstrated that…

Machine Learning · Statistics 2016-12-14 Bodo Rueckauer , Iulia-Alexandra Lungu , Yuhuang Hu , Michael Pfeiffer

Deep Neural Networks (DNNs) have gained immense success in cognitive applications and greatly pushed today's artificial intelligence forward. The biggest challenge in executing DNNs is their extremely data-extensive computations. The…

Computer Vision and Pattern Recognition · Computer Science 2019-09-10 Fuqiang Liu , C. Liu

Spiking neural networks (SNNs) well support spatiotemporal learning and energy-efficient event-driven hardware neuromorphic processors. As an important class of SNNs, recurrent spiking neural networks (RSNNs) possess great computational…

Neural and Evolutionary Computing · Computer Science 2020-02-25 Wenrui Zhang , Peng Li

Spiking Neural Networks (SNNs), as an emerging biologically inspired computational model, demonstrate significant energy efficiency advantages due to their event-driven information processing mechanism. Compared to traditional Artificial…

Neural and Evolutionary Computing · Computer Science 2025-08-18 Changqing Xu , Buxuan Song , Yi Liu , Xinfang Liao , Wenbin Zheng , Yintang Yang

Spiking Neural Networks (SNNs) offer promising energy-efficient alternatives to large language models (LLMs) due to their event-driven nature and ultra-low power consumption. However, to preserve capacity, most existing spiking LLMs still…

Neural and Evolutionary Computing · Computer Science 2026-05-15 Sihang Guo , Chenlin Zhou , Jiaqi Wang , Kehai Chen , Qingyan Meng , Zhengyu Ma

Spiking Neural Networks (SNNs) have emerged as a promising approach to improve the energy efficiency of machine learning models, as they naturally implement event-driven computations while avoiding expensive multiplication operations. In…

Neural and Evolutionary Computing · Computer Science 2024-10-31 Anagha Nimbekar , Prabodh Katti , Chen Li , Bashir M. Al-Hashimi , Amit Acharyya , Bipin Rajendran

Spiking Neural Networks (SNNs) offer a promising and energy-efficient alternative to conventional neural networks, thanks to their sparse binary activation. However, they face challenges regarding memory and computation overhead due to…

Neural and Evolutionary Computing · Computer Science 2026-01-06 Donghyun Lee , Abhishek Moitra , Youngeun Kim , Ruokai Yin , Priyadarshini Panda

Automated Machine Learning(Auto-ML) pruning methods aim at searching a pruning strategy automatically to reduce the computational complexity of deep Convolutional Neural Networks(deep CNNs). However, some previous work found that the…

Computer Vision and Pattern Recognition · Computer Science 2021-09-23 Mingyang Zhang , Xinyi Yu , Jingtao Rong , Linlin Ou

Spiking Neural Networks (SNNs) have emerged as a popular spatio-temporal computing paradigm for complex vision tasks. Recently proposed SNN training algorithms have significantly reduced the number of time steps (down to 1) for improved…

Computer Vision and Pattern Recognition · Computer Science 2023-11-29 Gourav Datta , Zeyu Liu , Anni Li , Peter A. Beerel

Adaptive "life-long" learning at the edge and during online task performance is an aspirational goal of AI research. Neuromorphic hardware implementing Spiking Neural Networks (SNNs) are particularly attractive in this regard, as their…

Neural and Evolutionary Computing · Computer Science 2022-01-27 Kenneth Stewart , Emre Neftci