English
Related papers

Related papers: Neural Dynamics Self-Attention for Spiking Transfo…

200 papers

Spiking Neural Networks (SNNs) have emerged as a promising energy-efficient alternative to traditional Artificial Neural Networks (ANNs). Despite this, bridging the performance gap with ANNs in practical scenarios remains a significant…

Computer Vision and Pattern Recognition · Computer Science 2024-03-19 Ziqing Wang , Yuetong Fang , Jiahang Cao , Renjing Xu

Bio-inspired Spiking Neural Networks (SNN) are now demonstrating comparable accuracy to intricate convolutional neural networks (CNN), all while delivering remarkable energy and latency efficiency when deployed on neuromorphic hardware. In…

Computer Vision and Pattern Recognition · Computer Science 2023-12-13 Gourav Datta , Zeyu Liu , James Diffenderfer , Bhavya Kailkhura , Peter A. Beerel

Memristor-based Spiking Neural Networks (SNNs) with temporal spike encoding enable ultra-low-energy computation, making them ideal for battery-powered intelligent devices. This paper presents a circuit-level memristive spiking neural…

Emerging Technologies · Computer Science 2025-07-29 Santlal Prajapati , Susmita Sur-Kolay , Soumyadeep Dutta

Spiking Neural Networks (SNNs) may offer an energy-efficient alternative for implementing deep learning applications. In recent years, there have been several proposals focused on supervised (conversion, spike-based gradient descent) and…

Computer Vision and Pattern Recognition · Computer Science 2019-10-31 Priyadarshini Panda , Aparna Aketi , Kaushik Roy

Neural Radiance Fields (NeRF)-based models have achieved remarkable success in 3D reconstruction and rendering tasks. However, during both training and inference, these models rely heavily on dense point sampling along rays from multiple…

Computer Vision and Pattern Recognition · Computer Science 2025-08-01 Ranxi Lin , Canming Yao , Jiayi Li , Weihang Liu , Xin Lou , Pingqiang Zhou

Spiking Neural Networks (SNNs) are capable of encoding and processing temporal information in a biologically plausible way. However, most existing SNN-based methods for image tasks do not fully exploit this feature. Moreover, they often…

Neural and Evolutionary Computing · Computer Science 2024-06-06 Xuerui Qiu , Zheng Luan , Zhaorui Wang , Rui-Jie Zhu

Spiking Neural Networks (SNNs) are highly energy-efficient due to event-driven, sparse computation, but their training is challenged by spike non-differentiability and trade-offs among performance, efficiency, and biological plausibility.…

Neural and Evolutionary Computing · Computer Science 2026-01-30 Zihan Huang , Zijie Xu , Yihan Huang , Shanshan Jia , Tong Bu , Yiting Dong , Wenxuan Liu , Jianhao Ding , Zhaofei Yu , Tiejun Huang

Inspired by more detailed modeling of biological neurons, Spiking neural networks (SNNs) have been investigated both as more biologically plausible and potentially more powerful models of neural computation, and also with the aim of…

Neural and Evolutionary Computing · Computer Science 2021-03-24 Bojian Yin , Federico Corradi , Sander M. Bohte

Spiking Neural Networks (SNNs) demonstrate significant potential for energy-efficient neuromorphic computing through an event-driven paradigm. While training methods and computational models have greatly advanced, SNNs struggle to achieve…

Neural and Evolutionary Computing · Computer Science 2025-10-27 Jieyuan Zhang , Xiaolong Zhou , Shuai Wang , Wenjie Wei , Hanwen Liu , Qian Sun , Malu Zhang , Yang Yang , Haizhou Li

Spiking Neural Networks (SNNs) bear the potential of efficient unsupervised and continual learning capabilities because of their biological plausibility, but their complexity still poses a serious research challenge to enable their…

Neural and Evolutionary Computing · Computer Science 2023-03-06 Rachmad Vidya Wicaksana Putra , Muhammad Shafique

Speech Emotion Recognition (SER) is widely deployed in Human-Computer Interaction, yet the high computational cost of conventional models hinders their implementation on resource-constrained edge devices. Spiking Neural Networks (SNNs)…

Artificial Intelligence · Computer Science 2026-02-10 Xun Su , Huamin Wang , Qi Zhang

The spiking neural network (SNN) using leaky-integrated-and-fire (LIF) neurons has been commonly used in automatic speech recognition (ASR) tasks. However, the LIF neuron is still relatively simple compared to that in the biological brain.…

Neural and Evolutionary Computing · Computer Science 2023-02-03 Minglun Han , Qingyu Wang , Tielin Zhang , Yi Wang , Duzhen Zhang , Bo Xu

Biologically plausible and energy-efficient frameworks such as Spiking Neural Networks (SNNs) have not been sufficiently explored in low-level vision tasks. Taking image deraining as an example, this study addresses the representation of…

Computer Vision and Pattern Recognition · Computer Science 2026-01-21 Shuang Chen , Tomas Krajnik , Farshad Arvin , Amir Atapour-Abarghouei

Spiking Neural Networks (SNNs) operate with asynchronous discrete events (or spikes) which can potentially lead to higher energy-efficiency in neuromorphic hardware implementations. Many works have shown that an SNN for inference can be…

Machine Learning · Computer Science 2020-05-06 Nitin Rathi , Gopalakrishnan Srinivasan , Priyadarshini Panda , Kaushik Roy

Spike-based Transformer presents a compelling and energy-efficient alternative to traditional Artificial Neural Network (ANN)-based Transformers, achieving impressive results through sparse binary computations. However, existing spike-based…

Neural and Evolutionary Computing · Computer Science 2025-03-04 Donghyun Lee , Yuhang Li , Youngeun Kim , Shiting Xiao , Priyadarshini Panda

Spiking Neural Networks (SNNs) exhibit exceptional energy efficiency on neuromorphic hardware due to their sparse activation patterns. However, conventional training methods based on surrogate gradients and Backpropagation Through Time…

Computer Vision and Pattern Recognition · Computer Science 2025-10-09 Xiaochen Zhao , Chengting Yu , Kairong Yu , Lei Liu , Aili Wang

Event cameras offer high temporal resolution and dynamic range with minimal motion blur, making them promising for robust object detection. While Spiking Neural Networks (SNNs) on neuromorphic hardware are often considered for…

Computer Vision and Pattern Recognition · Computer Science 2025-06-23 Soikat Hasan Ahmed , Jan Finkbeiner , Emre Neftci

Spiking Neural Networks (SNNs) have emerged as an attractive spatio-temporal computing paradigm for complex vision tasks. However, most existing works yield models that require many time steps and do not leverage the inherent temporal…

Neural and Evolutionary Computing · Computer Science 2022-10-25 Gourav Datta , Haoqin Deng , Robert Aviles , Peter A. Beerel

Spiking Neural Networks (SNNs) are seen as an energy-efficient alternative to traditional Artificial Neural Networks (ANNs), but the performance gap remains a challenge. While this gap is narrowing through ANN-to-SNN conversion, substantial…

Computer Vision and Pattern Recognition · Computer Science 2024-12-24 Ziqing Wang , Yuetong Fang , Jiahang Cao , Hongwei Ren , Renjing Xu

Spiking Neural Networks (SNNs) have recently emerged as a prominent neural computing paradigm. However, the typical shallow SNN architectures have limited capacity for expressing complex representations while training deep SNNs using input…

Neural and Evolutionary Computing · Computer Science 2020-03-26 Chankyu Lee , Syed Shakib Sarwar , Priyadarshini Panda , Gopalakrishnan Srinivasan , Kaushik Roy