English
Related papers

Related papers: SAFformer:Improving Spiking Transformer via Active…

200 papers

In this paper, we present an energy-efficient SNN architecture, which can seamlessly run deep spiking neural networks (SNNs) with improved accuracy. First, we propose a conversion aware training (CAT) to reduce ANN-to-SNN conversion loss…

Neural and Evolutionary Computing · Computer Science 2022-08-10 Dongwoo Lew , Kyungchul Lee , Jongsun Park

Artificial Neural Network (ANN) based techniques have dominated state-of-the-art results in most problems related to computer vision, audio recognition, and natural language processing in the past few years, resulting in strong industrial…

Neural and Evolutionary Computing · Computer Science 2019-06-24 Khaled F. Hussain , Mohamed Yousef Bassyouni , Erol Gelenbe

Brain-inspired spiking neural networks (SNNs) replace the multiply-accumulate operations of traditional neural networks by integrate-and-fire neurons, with the goal of achieving greater energy efficiency. Specialized hardware…

Neural and Evolutionary Computing · Computer Science 2023-05-10 Myat Thu Linn Aung , Daniel Gerlinghoff , Chuping Qu , Liwei Yang , Tian Huang , Rick Siow Mong Goh , Tao Luo , Weng-Fai Wong

Spike-based Transformer presents a compelling and energy-efficient alternative to traditional Artificial Neural Network (ANN)-based Transformers, achieving impressive results through sparse binary computations. However, existing spike-based…

Neural and Evolutionary Computing · Computer Science 2025-03-04 Donghyun Lee , Yuhang Li , Youngeun Kim , Shiting Xiao , Priyadarshini Panda

Spiking Neural Networks (SNNs) have been put forward as an energy-efficient alternative to Artificial Neural Networks (ANNs) since they perform sparse Accumulate operations instead of the power-hungry Multiply-and-Accumulate operations.…

Neural and Evolutionary Computing · Computer Science 2025-12-12 Pranav Ramesh , Gopalakrishnan Srinivasan

Spiking neural networks (SNNs) enable power-efficient implementations due to their sparse, spike-based coding scheme. This paper develops a bio-inspired SNN that uses unsupervised learning to extract discriminative features from speech…

Neural and Evolutionary Computing · Computer Science 2017-11-23 Amirhossein Tavanaei , Anthony Maida

Spiking Neural Networks (SNNs) aim to bridge the gap between neuroscience and machine learning by emulating the structure of the human nervous system. However, like convolutional neural networks, SNNs are vulnerable to adversarial attacks.…

Computer Vision and Pattern Recognition · Computer Science 2025-03-18 Weiran Chen , Qi Xu

Transformer-based Spiking Neural Networks (SNNs) suffer from a great performance gap compared to floating-point \mbox{Artificial} Neural Networks (ANNs) due to the binary nature of spike trains. Recent efforts have introduced deep-level…

Neural and Evolutionary Computing · Computer Science 2025-08-12 Zeqi Zheng , Zizheng Zhu , Yingchao Yu , Yanchen Huang , Changze Lv , Junfeng Tang , Zhaofei Yu , Yaochu Jin

Leveraging the event-driven paradigm, Spiking Neural Networks (SNNs) offer a promising approach for energy-efficient Transformer architectures.While ANN-to-SNN conversion avoids the high training cost of directly trained Spiking…

Machine Learning · Computer Science 2025-12-16 Jingya Wang , Xin Deng , Wenjie Wei , Dehao Zhang , Shuai Wang , Qian Sun , Jieyuan Zhang , Hanwen Liu , Ning Xie , Malu Zhang

Spiking Neural Networks (SNNs) use discrete spike sequences to transmit information, which significantly mimics the information transmission of the brain. Although this binarized form of representation dramatically enhances the energy…

Neural and Evolutionary Computing · Computer Science 2023-01-31 Guobin Shen , Dongcheng Zhao , Yi Zeng

Modern surgical systems increasingly rely on intelligent scene understanding to improve intra-operative safety and situational awareness, with surgical scene segmentation playing a fundamental role in fine-grained surgical perception.…

Computer Vision and Pattern Recognition · Computer Science 2026-03-24 Shihao Zou , Jingjing Li , Wei Ji , Jincai Huang , Kai Wang , Guo Dan , Weixin Si , Yi Pan

Spiking neural networks (SNNs) provide an energy-efficient alternative to a variety of artificial neural network (ANN) based AI applications. As the progress in neuromorphic computing with SNNs expands their use in applications, the problem…

Neural and Evolutionary Computing · Computer Science 2024-04-15 Ozan Özdenizci , Robert Legenstein

In the era of AI at the edge, self-driving cars, and climate change, the need for energy-efficient, small, embedded AI is growing. Spiking Neural Networks (SNNs) are a promising approach to address this challenge, with their event-driven…

Computer Vision and Pattern Recognition · Computer Science 2024-06-07 Lennard Bodden , Franziska Schwaiger , Duc Bach Ha , Lars Kreuzberg , Sven Behnke

The field of neuromorphic computing promises extremely low-power and low-latency sensing and processing. Challenges in transferring learning algorithms from traditional artificial neural networks (ANNs) to spiking neural networks (SNNs)…

Computer Vision and Pattern Recognition · Computer Science 2021-10-27 Jesse Hagenaars , Federico Paredes-Vallés , Guido de Croon

Reinforcement learning agents based on Transformer architectures have achieved impressive performance on sequential decision-making tasks, but their reliance on dense matrix operations makes them ill-suited for energy-constrained,…

Machine Learning · Computer Science 2025-09-01 Vishal Pandey , Debasmita Biswas

Spiking neural networks (SNNs) are promising in a bio-plausible coding for spatio-temporal information and event-driven signal processing, which is very suited for energy-efficient implementation in neuromorphic hardware. However, the…

Neural and Evolutionary Computing · Computer Science 2020-12-21 Hanle Zheng , Yujie Wu , Lei Deng , Yifan Hu , Guoqi Li

Inspired by biology, spiking neural networks (SNNs) process information via discrete spikes over time, offering an energy-efficient alternative to the classical computing paradigm and classical artificial neural networks (ANNs). In this…

Neural and Evolutionary Computing · Computer Science 2025-12-19 Shayan Hundrieser , Philipp Tuchel , Insung Kong , Johannes Schmidt-Hieber

Spiking Neural Networks (SNNs) have emerged as a promising tool for event-based optical flow estimation tasks due to their ability to leverage spatio-temporal information and low-power capabilities. However, the performance of SNN models is…

Computer Vision and Pattern Recognition · Computer Science 2025-04-29 Hongze Sun , Jun Wang , Wuque Cai , Duo Chen , Qianqian Liao , Jiayi He , Yan Cui , Dezhong Yao , Daqing Guo

Spiking Neural Networks (SNNs) represent a biologically inspired paradigm offering an energy-efficient alternative to conventional artificial neural networks (ANNs) for Computer Vision (CV) applications. This paper presents a systematic…

Computer Vision and Pattern Recognition · Computer Science 2024-11-27 Craig Iaboni , Pramod Abichandani

As a foundational architecture of artificial intelligence models, Transformer has been recently adapted to spiking neural networks with promising performance across various tasks. However, existing spiking Transformer(ST)-based models…

Machine Learning · Computer Science 2026-01-06 Hongze Sun , Wuque Cai , Duo Chen , Quan Tang , Shifeng Mao , Jiayi He , Zhenxing Wang , Yan Cui , Dezhong Yao , Daqing Guo