English
Related papers

Related papers: Scaling Spike-driven Transformer with Efficient Sp…

200 papers

The integration of neuromorphic computing and transformers through spiking neural networks (SNNs) offers a promising path to energy-efficient sequence modeling, with the potential to overcome the energy-intensive nature of the artificial…

Hardware Architecture · Computer Science 2025-04-23 Zihang Song , Prabodh Katti , Osvaldo Simeone , Bipin Rajendran

Spiking Neural Networks (SNNs), known for their biologically plausible architecture, face the challenge of limited performance. The self-attention mechanism, which is the cornerstone of the high-performance Transformer and also a…

Neural and Evolutionary Computing · Computer Science 2024-01-05 Zhaokun Zhou , Kaiwei Che , Wei Fang , Keyu Tian , Yuesheng Zhu , Shuicheng Yan , Yonghong Tian , Li Yuan

Spiking Neural Networks (SNNs) are a promising approach to low-power applications on neuromorphic hardware due to their energy efficiency. However, training SNNs is challenging because of the non-differentiable spike generation function. To…

Neural and Evolutionary Computing · Computer Science 2025-08-19 Qingyan Meng , Mingqing Xiao , Zhengyu Ma , Huihui Zhou , Yonghong Tian , Zhouchen Lin

Brain-machine interfaces (BMIs) are promising for motor rehabilitation and mobility augmentation. High-accuracy and low-power algorithms are required to achieve implantable BMI systems. In this paper, we propose a novel spiking neural…

Signal Processing · Electrical Eng. & Systems 2022-10-13 Jiawei Liao , Lars Widmer , Xiaying Wang , Alfio Di Mauro , Samuel R. Nason-Tomaszewski , Cynthia A. Chestek , Luca Benini , Taekwang Jang

Neuromorphic hardware aims to leverage distributed computing and event-driven circuit design to achieve an energy-efficient AI system. The name "neuromorphic" is derived from its spiking and local computing nature, which mimics the…

Neural and Evolutionary Computing · Computer Science 2025-06-24 Zhenhui Chen , Haoran Xu , Yangfan Hu , Xiaofei Jin , Xinyu Li , Ziyang Kang , Gang Pan , De Ma

Spiking Neural Networks (SNNs) have recently emerged as the low-power alternative to Artificial Neural Networks (ANNs) because of their sparse, asynchronous, and binary event-driven processing. Due to their energy efficiency, SNNs have a…

Computer Vision and Pattern Recognition · Computer Science 2021-10-18 Youngeun Kim , Joshua Chough , Priyadarshini Panda

Reinforcement learning agents based on Transformer architectures have achieved impressive performance on sequential decision-making tasks, but their reliance on dense matrix operations makes them ill-suited for energy-constrained,…

Machine Learning · Computer Science 2025-09-01 Vishal Pandey , Debasmita Biswas

The field of neuromorphic computing promises extremely low-power and low-latency sensing and processing. Challenges in transferring learning algorithms from traditional artificial neural networks (ANNs) to spiking neural networks (SNNs)…

Computer Vision and Pattern Recognition · Computer Science 2021-10-27 Jesse Hagenaars , Federico Paredes-Vallés , Guido de Croon

Spiking neural networks (SNNs) are well known as the brain-inspired models with high computing efficiency, due to a key component that they utilize spikes as information units, close to the biological neural systems. Although spiking based…

Neural and Evolutionary Computing · Computer Science 2023-04-18 Qi Xu , Yaxin Li , Jiangrong Shen , Jian K Liu , Huajin Tang , Gang Pan

Spiking Neural Networks (SNNs) have garnered considerable attention as a potential alternative to Artificial Neural Networks (ANNs). Recent studies have highlighted SNNs' potential on large-scale datasets. For SNN training, two main…

Machine Learning · Computer Science 2025-03-24 Shu Yang , Chengting Yu , Lei Liu , Hanzhi Ma , Aili Wang , Erping Li

Artificial Neural Networks (ANNs) are currently being used as function approximators in many state-of-the-art Reinforcement Learning (RL) algorithms. Spiking Neural Networks (SNNs) have been shown to drastically reduce the energy…

Machine Learning · Computer Science 2020-01-23 Bleema Rosenfeld , Osvaldo Simeone , Bipin Rajendran

Recent advancements in neuroscience research have propelled the development of Spiking Neural Networks (SNNs), which not only have the potential to further advance neuroscience research but also serve as an energy-efficient alternative to…

Computer Vision and Pattern Recognition · Computer Science 2024-05-28 Yimeng Shan , Malu Zhang , Rui-jie Zhu , Xuerui Qiu , Jason K. Eshraghian , Haicheng Qu

Spiking neural networks (SNNs) have become an interesting alternative to conventional artificial neural networks (ANN) thanks to their temporal processing capabilities and energy efficient implementations in neuromorphic hardware. However…

Machine Learning · Computer Science 2022-09-22 Alex Vicente-Sola , Davide L. Manna , Paul Kirkland , Gaetano Di Caterina , Trevor Bihl

Spiking Neural Networks promise brain-inspired and energy-efficient computation by transmitting information through binary (0/1) spikes. Yet, their performance still lags behind that of artificial neural networks, often assumed to result…

Computer Vision and Pattern Recognition · Computer Science 2026-01-06 Yuetong Fang , Deming Zhou , Ziqing Wang , Hongwei Ren , ZeCui Zeng , Lusong Li , Shibo Zhou , Renjing Xu

Neuromorphic computing has recently gained momentum with the emergence of various neuromorphic processors. As the field advances, there is an increasing focus on developing training methods that can effectively leverage the unique…

Emerging Technologies · Computer Science 2025-04-15 Sanaz Mahmoodi Takaghaj , Jack Sampson

Multi-bit spiking neural networks (SNNs) have recently become a heated research spot, pursuing energy-efficient and high-accurate AI. However, with more bits involved, the associated memory and computation demands escalate to the point…

Neural and Evolutionary Computing · Computer Science 2025-12-02 Xingting Yao , Qinghao Hu , Fei Zhou , Tielong Liu , Gang Li , Peisong Wang , Jian Cheng

Decoding brain signals accurately and efficiently is crucial for intra-cortical brain-computer interfaces. Traditional decoding approaches based on neural activity vector features suffer from low accuracy, whereas deep learning based…

Human-Computer Interaction · Computer Science 2025-04-15 Song Yang , Haotian Fu , Herui Zhang , Peng Zhang , Wei Li , Dongrui Wu

Spiking neural networks (SNNs) provide an energy-efficient solution by utilizing the spike-based and sparse nature of biological systems. Since the advent of Transformers, SNNs have struggled to compete with artificial networks on long…

Neural and Evolutionary Computing · Computer Science 2024-10-24 Yan Zhong , Ruoyu Zhao , Chao Wang , Qinghai Guo , Jianguo Zhang , Zhichao Lu , Luziwei Leng

Spiking Neural Networks (SNNs) promise orders-of-magnitude lower power consumption and low-latency inference on neuromorphic hardware for a wide range of robotic tasks. In this work, we present an energy-efficient implementation of a…

Machine Learning · Computer Science 2025-08-01 Sirine Arfa , Bernhard Vogginger , Christian Mayr

Emergence of deep neural networks (DNNs) has raised enormous attention towards artificial neural networks (ANNs) once again. They have become the state-of-the-art models and have won different machine learning challenges. Although these…

Neural and Evolutionary Computing · Computer Science 2022-12-09 Shahriar Rezghi Shirsavar , Abdol-Hossein Vahabie , Mohammad-Reza A. Dehaqani