English
Related papers

Related papers: SVFormer: A Direct Training Spiking Transformer fo…

200 papers

Spiking neural network (SNN), as the next generation of artificial neural network (ANN), offer a closer mimicry of natural neural networks and hold promise for significant improvements in computational efficiency. However, the current SNN…

Computer Vision and Pattern Recognition · Computer Science 2025-02-04 Dengyu Wu , Gaojie Jin , Han Yu , Xinping Yi , Xiaowei Huang

Spiking neural networks (SNNs) are biology-inspired artificial neural networks (ANNs) that comprise of spiking neurons to process asynchronous discrete signals. While more efficient in power consumption and inference speed on the…

Neural and Evolutionary Computing · Computer Science 2021-03-02 Shikuang Deng , Shi Gu

Spiking neural networks (SNNs) are potential competitors to artificial neural networks (ANNs) due to their high energy-efficiency on neuromorphic hardware. However, SNNs are unfolded over simulation time steps during the training process.…

Computer Vision and Pattern Recognition · Computer Science 2023-12-14 Hong Zhang , Yu Zhang

Event-based cameras display great potential for a variety of tasks such as high-speed motion detection and navigation in low-light environments where conventional frame-based cameras suffer critically. This is attributed to their high…

Neural and Evolutionary Computing · Computer Science 2020-09-16 Chankyu Lee , Adarsh Kumar Kosta , Alex Zihao Zhu , Kenneth Chaney , Kostas Daniilidis , Kaushik Roy

Bio-inspired Spiking Neural Networks (SNN) are now demonstrating comparable accuracy to intricate convolutional neural networks (CNN), all while delivering remarkable energy and latency efficiency when deployed on neuromorphic hardware. In…

Computer Vision and Pattern Recognition · Computer Science 2023-12-13 Gourav Datta , Zeyu Liu , James Diffenderfer , Bhavya Kailkhura , Peter A. Beerel

Learning discriminative spatiotemporal representation is the key problem of video understanding. Recently, Vision Transformers (ViTs) have shown their power in learning long-term video dependency with self-attention. Unfortunately, they…

Computer Vision and Pattern Recognition · Computer Science 2022-11-18 Kunchang Li , Yali Wang , Yinan He , Yizhuo Li , Yi Wang , Limin Wang , Yu Qiao

Spiking Neural Networks (SNNs) provide an energy-efficient deep learning option due to their unique spike-based event-driven (i.e., spike-driven) paradigm. In this paper, we incorporate the spike-driven paradigm into Transformer by the…

Neural and Evolutionary Computing · Computer Science 2023-07-06 Man Yao , Jiakui Hu , Zhaokun Zhou , Li Yuan , Yonghong Tian , Bo Xu , Guoqi Li

Spiking neural networks (SNNs) have shown clear advantages over traditional artificial neural networks (ANNs) for low latency and high computational efficiency, due to their event-driven nature and sparse communication. However, the…

Neural and Evolutionary Computing · Computer Science 2020-07-03 Jibin Wu , Chenglin Xu , Daquan Zhou , Haizhou Li , Kay Chen Tan

Event camera-based pattern recognition is a newly arising research topic in recent years. Current researchers usually transform the event streams into images, graphs, or voxels, and adopt deep neural networks for event-based classification.…

Computer Vision and Pattern Recognition · Computer Science 2025-05-06 Xiao Wang , Yao Rong , Zongzhen Wu , Lin Zhu , Bo Jiang , Jin Tang , Yonghong Tian

Spiking Neural Networks (SNNs) exhibit exceptional energy efficiency on neuromorphic hardware due to their sparse activation patterns. However, conventional training methods based on surrogate gradients and Backpropagation Through Time…

Computer Vision and Pattern Recognition · Computer Science 2025-10-09 Xiaochen Zhao , Chengting Yu , Kairong Yu , Lei Liu , Aili Wang

Spiking neural network (SNN) has attracted great attention due to its characteristic of high efficiency and accuracy. Currently, the ANN-to-SNN conversion methods can obtain ANN on-par accuracy SNN with ultra-low latency (8 time-steps) in…

Neural and Evolutionary Computing · Computer Science 2024-08-21 Kang You , Zekai Xu , Chen Nie , Zhijie Deng , Qinghai Guo , Xiang Wang , Zhezhi He

Spiking Neural Networks (SNNs), with their inherent recurrence, offer an efficient method for processing the asynchronous temporal data generated by Dynamic Vision Sensors (DVS), making them well-suited for event-based vision applications.…

Hardware Architecture · Computer Science 2024-11-06 Deepika Sharma , Shubham Negi , Trishit Dutta , Amogh Agrawal , Kaushik Roy

Spiking Neural Networks (SNNs) have emerged as a promising substitute for Artificial Neural Networks (ANNs) due to their advantages of fast inference and low power consumption. However, the lack of efficient training algorithms has hindered…

Neural and Evolutionary Computing · Computer Science 2025-03-06 Tong Bu , Maohua Li , Zhaofei Yu

Transformer-based Spiking Neural Networks (SNNs) integrate SNNs with global self-attention and have demonstrated impressive performance. However, existing Transformer-based SNNs suffer from two fundamental limitations. First, they typically…

Neural and Evolutionary Computing · Computer Science 2026-05-15 Lingdong Li , Hangming Zhang , Qiang Yu

It is a challenging task to learn discriminative representation from images and videos, due to large local redundancy and complex global dependency in these visual data. Convolution neural networks (CNNs) and vision transformers (ViTs) have…

Computer Vision and Pattern Recognition · Computer Science 2024-10-28 Kunchang Li , Yali Wang , Junhao Zhang , Peng Gao , Guanglu Song , Yu Liu , Hongsheng Li , Yu Qiao

Spiking neural networks (SNNs) that enable low-power design on edge devices have recently attracted significant research. However, the temporal characteristic of SNNs causes high latency, high bandwidth and high energy consumption for the…

Hardware Architecture · Computer Science 2022-05-05 Hong-Han Lien , Chung-Wei Hsu , Tian-Sheuan Chang

Spiking Neural Networks (SNNs), known for their biologically plausible architecture, face the challenge of limited performance. The self-attention mechanism, which is the cornerstone of the high-performance Transformer and also a…

Neural and Evolutionary Computing · Computer Science 2024-01-05 Zhaokun Zhou , Kaiwei Che , Wei Fang , Keyu Tian , Yuesheng Zhu , Shuicheng Yan , Yonghong Tian , Li Yuan

The combination of Spiking Neural Networks (SNNs) with Vision Transformer architectures has garnered significant attention due to their potential for energy-efficient and high-performance computing paradigms. However, a substantial…

Computer Vision and Pattern Recognition · Computer Science 2025-06-19 Wei Hua , Chenlin Zhou , Jibin Wu , Yansong Chua , Yangyang Shu

Spiking neural networks (SNNs) have shown advantages in computation and energy efficiency over traditional artificial neural networks (ANNs) thanks to their event-driven representations. SNNs also replace weight multiplications in ANNs with…

Neural and Evolutionary Computing · Computer Science 2023-06-01 Yangfan Hu , Qian Zheng , Xudong Jiang , Gang Pan

Spiking neural networks (SNNs) can be run on neuromorphic devices with ultra-high speed and ultra-low energy consumption because of their binary and event-driven nature. Therefore, SNNs are expected to have various applications, including…

Neural and Evolutionary Computing · Computer Science 2021-12-15 Hiromichi Kamata , Yusuke Mukuta , Tatsuya Harada