English
Related papers

Related papers: SAFformer:Improving Spiking Transformer via Active…

200 papers

Spiking Neural Networks (SNNs) have recently gained significant interest in on-chip learning in embedded devices and emerged as an energy-efficient alternative to conventional Artificial Neural Networks (ANNs). However, to extend SNNs to a…

Machine Learning · Computer Science 2024-09-20 Manh V. Nguyen , Liang Zhao , Bobin Deng , William Severa , Honghui Xu , Shaoen Wu

Spiking Neural Network (SNN) has been recognized as one of the next generation of neural networks. Conventionally, SNN can be converted from a pre-trained ANN by only replacing the ReLU activation to spike activation while keeping the…

Machine Learning · Computer Science 2021-06-15 Yuhang Li , Shikuang Deng , Xin Dong , Ruihao Gong , Shi Gu

Spiking Neural Networks (SNNs) have shown competitive performance to Artificial Neural Networks (ANNs) in various vision tasks, while offering superior energy efficiency. However, existing SNN-based Transformers primarily focus on…

Computer Vision and Pattern Recognition · Computer Science 2025-05-16 Shihao Zou , Qingfeng Li , Wei Ji , Jingjing Li , Yongkui Yang , Guoqi Li , Chao Dong

Spiking neural network (SNN), as the next generation of artificial neural network (ANN), offer a closer mimicry of natural neural networks and hold promise for significant improvements in computational efficiency. However, the current SNN…

Computer Vision and Pattern Recognition · Computer Science 2025-02-04 Dengyu Wu , Gaojie Jin , Han Yu , Xinping Yi , Xiaowei Huang

Artificial neural networks (ANN) have become the mainstream acoustic modeling technique for large vocabulary automatic speech recognition (ASR). A conventional ANN features a multi-layer architecture that requires massive amounts of…

Neural and Evolutionary Computing · Computer Science 2019-11-20 Jibin Wu , Emre Yilmaz , Malu Zhang , Haizhou Li , Kay Chen Tan

Spiking Neural Networks (SNNs) have recently emerged as a prominent neural computing paradigm. However, the typical shallow SNN architectures have limited capacity for expressing complex representations while training deep SNNs using input…

Neural and Evolutionary Computing · Computer Science 2020-03-26 Chankyu Lee , Syed Shakib Sarwar , Priyadarshini Panda , Gopalakrishnan Srinivasan , Kaushik Roy

Spiking Neural Networks (SNNs) have emerged with promising energy-efficient property, yet a substantial performance gap persists compared to Artificial Neural Networks (ANNs). This gap stems from at least two key limitations: first,…

Neural and Evolutionary Computing · Computer Science 2026-05-28 Feifan Zhou , Xiang Wei , Yang Liu , Qiang Yu

Spiking Neural Networks (SNNs), as bio-inspired energy-efficient neural networks, have attracted great attentions from researchers and industry. The most efficient way to train deep SNNs is through ANN-SNN conversion. However, the…

Neural and Evolutionary Computing · Computer Science 2021-05-26 Jianhao Ding , Zhaofei Yu , Yonghong Tian , Tiejun Huang

Spiking neural networks (SNNs) are brain-inspired models that enable energy-efficient implementation on neuromorphic hardware. However, the supervised training of SNNs remains a hard problem due to the discontinuity of the spiking neuron…

Neural and Evolutionary Computing · Computer Science 2021-12-20 Mingqing Xiao , Qingyan Meng , Zongpeng Zhang , Yisen Wang , Zhouchen Lin

Spiking neural networks (SNN) are artificial computational models that have been inspired by the brain's ability to naturally encode and process information in the time domain. The added temporal dimension is believed to render them more…

Emerging Technologies · Computer Science 2019-05-29 S. R. Nandakumar , Irem Boybat , Manuel Le Gallo , Evangelos Eleftheriou , Abu Sebastian , Bipin Rajendran

In recent years, deep learning has been a revolution in the field of machine learning, for computer vision in particular. In this approach, a deep (multilayer) artificial neural network (ANN) is trained in a supervised manner using…

Neural and Evolutionary Computing · Computer Science 2019-01-23 Amirhossein Tavanaei , Masoud Ghodrati , Saeed Reza Kheradpisheh , Timothee Masquelier , Anthony S. Maida

Spiking neural networks (SNNs) represent a promising approach in machine learning, combining the hierarchical learning capabilities of deep neural networks with the energy efficiency of spike-based computations. Traditional end-to-end…

Neural and Evolutionary Computing · Computer Science 2024-11-12 Ruyin Wan , Qian Zhang , George Em Karniadakis

Spiking Neural Networks (SNNs), as an emerging biologically inspired computational model, demonstrate significant energy efficiency advantages due to their event-driven information processing mechanism. Compared to traditional Artificial…

Neural and Evolutionary Computing · Computer Science 2025-08-18 Changqing Xu , Buxuan Song , Yi Liu , Xinfang Liao , Wenbin Zheng , Yintang Yang

Spiking neural networks (SNNs) with adaptive synapses reflect core properties of biological neural networks. Speech recognition, as an application involving audio coding and dynamic learning, provides a good test problem to study SNN…

Neural and Evolutionary Computing · Computer Science 2017-03-14 Amirhossein Tavanaei , Anthony S Maida

Spiking Neural Networks (SNNs) have gained attention for their energy-efficient machine learning capabilities, utilizing bio-inspired activation functions and sparse binary spike-data representations. While recent SNN algorithmic advances…

Neural and Evolutionary Computing · Computer Science 2023-09-08 Abhiroop Bhattacharjee , Ruokai Yin , Abhishek Moitra , Priyadarshini Panda

Spiking Neural Networks (SNNs) demonstrate significant potential for energy-efficient neuromorphic computing through an event-driven paradigm. While training methods and computational models have greatly advanced, SNNs struggle to achieve…

Neural and Evolutionary Computing · Computer Science 2025-10-27 Jieyuan Zhang , Xiaolong Zhou , Shuai Wang , Wenjie Wei , Hanwen Liu , Qian Sun , Malu Zhang , Yang Yang , Haizhou Li

We introduce a method to convert Physics-Informed Neural Networks (PINNs), commonly used in scientific machine learning, to Spiking Neural Networks (SNNs), which are expected to have higher energy efficiency compared to traditional…

Neural and Evolutionary Computing · Computer Science 2023-09-01 Qian Zhang , Chenxi Wu , Adar Kahana , Youngeun Kim , Yuhang Li , George Em Karniadakis , Priyadarshini Panda

Facial Expression Recognition (FER) is an active research domain that has shown great progress recently, notably thanks to the use of large deep learning models. However, such approaches are particularly energy intensive, which makes their…

Computer Vision and Pattern Recognition · Computer Science 2023-04-21 Sami Barchid , Benjamin Allaert , Amel Aissaoui , José Mennesson , Chaabane Djéraba

Spiking neural networks (SNNs) offer biologically inspired computation but remain underexplored for continuous regression tasks in scientific machine learning. In this work, we introduce and systematically evaluate Quadratic…

Neural and Evolutionary Computing · Computer Science 2025-11-11 Ruyin Wan , George Em Karniadakis , Panos Stinis

Spiking neural networks (SNNs) promise low-power event-driven computation for temporally rich tasks, but commonly used neuron models often trade off gradient-based trainability, dynamical richness, and high activity sparsity. These…

Neural and Evolutionary Computing · Computer Science 2026-05-13 Alex Fulleda-Garcia , Saray Soldado-Magraner , Josep Maria Margarit-Taulé