English
Related papers

Related papers: Binary Event-Driven Spiking Transformer

200 papers

Transformer-based Spiking Neural Networks (SNNs) suffer from a great performance gap compared to floating-point \mbox{Artificial} Neural Networks (ANNs) due to the binary nature of spike trains. Recent efforts have introduced deep-level…

Neural and Evolutionary Computing · Computer Science 2025-08-12 Zeqi Zheng , Zizheng Zhu , Yingchao Yu , Yanchen Huang , Changze Lv , Junfeng Tang , Zhaofei Yu , Yaochu Jin

Spiking Neural Networks (SNNs) are highly energy-efficient due to event-driven, sparse computation, but their training is challenged by spike non-differentiability and trade-offs among performance, efficiency, and biological plausibility.…

Neural and Evolutionary Computing · Computer Science 2026-01-30 Zihan Huang , Zijie Xu , Yihan Huang , Shanshan Jia , Tong Bu , Yiting Dong , Wenxuan Liu , Jianhao Ding , Zhaofei Yu , Tiejun Huang

Spiking neural network (SNN), as a brain-inspired energy-efficient neural network, has attracted the interest of researchers. While the training of spiking neural networks is still an open problem. One effective way is to map the weight of…

Neural and Evolutionary Computing · Computer Science 2022-05-10 Yang Li , Yi Zeng

Spiking neural networks (SNNs) are promising in a bio-plausible coding for spatio-temporal information and event-driven signal processing, which is very suited for energy-efficient implementation in neuromorphic hardware. However, the…

Neural and Evolutionary Computing · Computer Science 2020-12-21 Hanle Zheng , Yujie Wu , Lei Deng , Yifan Hu , Guoqi Li

Spiking Neural Networks (SNNs) may offer an energy-efficient alternative for implementing deep learning applications. In recent years, there have been several proposals focused on supervised (conversion, spike-based gradient descent) and…

Computer Vision and Pattern Recognition · Computer Science 2019-10-31 Priyadarshini Panda , Aparna Aketi , Kaushik Roy

Spiking neural networks (SNNs) have emerged as a promising direction in both computational neuroscience and artificial intelligence, offering advantages such as strong biological plausibility and low energy consumption on neuromorphic…

Neural and Evolutionary Computing · Computer Science 2025-12-04 Luu Trong Nhan , Luu Trung Duong , Pham Ngoc Nam , Truong Cong Thang

Spiking Neural Networks (SNNs) have gained significant attention due to their biological plausibility and energy efficiency, making them promising alternatives to Artificial Neural Networks (ANNs). However, the performance gap between SNNs…

Computer Vision and Pattern Recognition · Computer Science 2025-04-30 Tianqing Zhang , Kairong Yu , Xian Zhong , Hongwei Wang , Qi Xu , Qiang Zhang

Spike train classification has recently become an important topic in the machine learning community, where each spike train is a binary event sequence with \emph{temporal-sparsity of signals of interest} and \emph{temporal-noise}…

Neural and Evolutionary Computing · Computer Science 2024-11-12 Hang Yin , Yao Su , Liping Liu , Thomas Hartvigsen , Xin Dai , Xiangnan Kong

Spiking neural networks (SNNs) are the third generation of neural networks that are biologically inspired to process data in a fashion that emulates the exchange of signals in the brain. Within the Computer Vision community SNNs have…

Audio and Speech Processing · Electrical Eng. & Systems 2024-09-04 William Bjorndahl , Jack Easton , Austin Modoff , Eric C. Larson , Joseph Camp , Prasanna Rangarajan

Neuromorphic computing is an emerging technology enabling low-latency and energy-efficient signal processing. A key algorithmic tool in neuromorphic computing is spiking neural networks (SNNs). SNNs are biologically inspired neural networks…

Machine Learning · Computer Science 2025-08-11 Sanja Karilanova , Subhrakanti Dey , Ayça Özçelikkale

Deep neural networks for image super-resolution (SR) have demonstrated superior performance. However, the large memory and computation consumption hinders their deployment on resource-constrained devices. Binary neural networks (BNNs),…

Computer Vision and Pattern Recognition · Computer Science 2025-02-24 Renjie Wei , Zechun Liu , Yuchen Fan , Runsheng Wang , Ru Huang , Meng Li

Spiking Neural Networks (SNNs), as a biologically plausible alternative to Artificial Neural Networks (ANNs), have demonstrated advantages in terms of energy efficiency, temporal processing, and biological plausibility. However, SNNs are…

Machine Learning · Computer Science 2025-09-22 Xinyu Luo , Kecheng Chen , Pao-Sheng Vincent Sun , Chris Xing Tian , Arindam Basu , Haoliang Li

Spiking Neural Networks (SNNs) have emerged as a new generation of energy-efficient neural networks suitable for implementation on neuromorphic hardware. As neuromorphic hardware has limited memory and computational resources, parameter…

Machine Learning · Computer Science 2026-01-29 Lianfeng Shi , Ao Li , Benjamin Ward-Cherrier

Uncertainty in biological neural systems appears to be computationally beneficial rather than detrimental. However, in neuromorphic computing systems, device variability often limits performance, including accuracy and efficiency. In this…

Neural and Evolutionary Computing · Computer Science 2026-02-10 Huannan Zheng , Jingli Liu , Kezhou Yang

Deep Neural Networks (DNNs) have been successfully implemented across various signal processing fields, resulting in significant enhancements in performance. However, DNNs generally require substantial computational resources, leading to…

Signal Processing · Electrical Eng. & Systems 2024-07-09 Shuai Wang , Dehao Zhang , Ammar Belatreche , Yichen Xiao , Hongyu Qing , Wenjie We , Malu Zhang , Yang Yang

Spiking neural networks (SNNs) aim to realize brain-inspired intelligence on neuromorphic chips with high energy efficiency by introducing neural dynamics and spike properties. As the emerging spiking deep learning paradigm attracts…

Neural and Evolutionary Computing · Computer Science 2023-10-26 Wei Fang , Yanqi Chen , Jianhao Ding , Zhaofei Yu , Timothée Masquelier , Ding Chen , Liwei Huang , Huihui Zhou , Guoqi Li , Yonghong Tian

Spiking neural networks (SNNs) have tremendous potential for energy-efficient neuromorphic chips due to their binary and event-driven architecture. SNNs have been primarily used in classification tasks, but limited exploration on image…

Neural and Evolutionary Computing · Computer Science 2023-09-25 Mingxuan Liu , Jie Gan , Rui Wen , Tao Li , Yongli Chen , Hong Chen

As a foundational architecture of artificial intelligence models, Transformer has been recently adapted to spiking neural networks with promising performance across various tasks. However, existing spiking Transformer(ST)-based models…

Machine Learning · Computer Science 2026-01-06 Hongze Sun , Wuque Cai , Duo Chen , Quan Tang , Shifeng Mao , Jiayi He , Zhenxing Wang , Yan Cui , Dezhong Yao , Daqing Guo

Spiking neural networks (SNNs) are a promising paradigm for energy-efficient event-driven computation, but large-scale SNN execution remains challenging because sparse spike communication and synchronization can dominate runtime. Existing…

Hardware Architecture · Computer Science 2026-05-27 Muhammad Ihsan Al Hafiz , Artur Podobas

Spiking Neural Network (SNN) inference has a clear potential for high energy efficiency as computation is triggered by events. However, the inherent sparsity of events poses challenges for conventional computing systems, driving the…

Hardware Architecture · Computer Science 2025-04-09 Simone Manoni , Paul Scheffler , Luca Zanatta , Andrea Acquaviva , Luca Benini , Andrea Bartolini