English
Related papers

Related papers: RTFormer: Re-parameter TSBN Spiking Transformer

200 papers

The primate visual cortex exhibits topographic organization, where functionally similar neurons are spatially clustered, a structure widely believed to enhance neural processing efficiency. While prior works have demonstrated that…

Neural and Evolutionary Computing · Computer Science 2025-11-24 Deming Zhou , Yuetong Fang , Zhaorui Wang , Renjing Xu

The combination of Spiking Neural Networks (SNNs) and Transformers has attracted significant attention due to their potential for high energy efficiency and high-performance nature. However, existing works on this topic typically rely on…

Neural and Evolutionary Computing · Computer Science 2023-07-18 Ziqing Wang , Yuetong Fang , Jiahang Cao , Qiang Zhang , Zhongrui Wang , Renjing Xu

Spiking neural networks (SNNs) are powerful models of spatiotemporal computation and are well suited for deployment on resource-constrained edge devices and neuromorphic hardware due to their low power consumption. Leveraging attention…

Neural and Evolutionary Computing · Computer Science 2024-11-13 Boxun Xu , Junyoung Hwang , Pruek Vanna-iampikul , Sung Kyu Lim , Peng Li

Spiking neural networks (SNNs) have gained considerable interest due to their energy-efficient characteristics, yet lack of a scalable training algorithm has restricted their applicability in practical machine learning problems. The deep…

Neural and Evolutionary Computing · Computer Science 2020-03-27 Seongsik Park , Seijoon Kim , Byunggook Na , Sungroh Yoon

Spiking neural networks (SNNs) exhibit superior energy efficiency but suffer from limited performance. In this paper, we consider SNNs as ensembles of temporal subnetworks that share architectures and weights, and highlight a crucial issue…

Machine Learning · Computer Science 2025-02-21 Yongqi Ding , Lin Zuo , Mengmeng Jing , Pei He , Hanpu Deng

In recent years, spiking neural networks (SNNs) have attracted substantial interest due to their potential to replicate the energy-efficient and event-driven processing of biological neurons. Despite this, the application of SNNs in graph…

Artificial Intelligence · Computer Science 2024-07-31 Mingkun Xu , Huifeng Yin , Yujie Wu , Guoqi Li , Faqiang Liu , Jing Pei , Shuai Zhong , Lei Deng

Inspired by more detailed modeling of biological neurons, Spiking neural networks (SNNs) have been investigated both as more biologically plausible and potentially more powerful models of neural computation, and also with the aim of…

Neural and Evolutionary Computing · Computer Science 2021-03-24 Bojian Yin , Federico Corradi , Sander M. Bohte

In the past decade, advances in Artificial Neural Networks (ANNs) have allowed them to perform extremely well for a wide range of tasks. In fact, they have reached human parity when performing image recognition, for example. Unfortunately,…

Neural and Evolutionary Computing · Computer Science 2024-10-30 Srivatsa P , Kyle Timothy Ng Chu , Burin Amornpaisannon , Yaswanth Tavva , Venkata Pavan Kumar Miriyala , Jibin Wu , Malu Zhang , Haizhou Li , Trevor E. Carlson

Ensuring energy-efficient design in neuromorphic computing systems necessitates a tailored architecture combined with algorithmic approaches. This manuscript focuses on enhancing brain-inspired perceptual computing machines through a novel…

Neural and Evolutionary Computing · Computer Science 2024-08-15 Ali Shiri Sichani , Sai Kankatala

The energy-efficient and brain-like information processing abilities of Spiking Neural Networks (SNNs) have attracted considerable attention, establishing them as a crucial element of brain-inspired computing. One prevalent challenge…

Neural and Evolutionary Computing · Computer Science 2025-10-27 Zhichao Zhu , Yang Qi , Wenlian Lu , Zhigang Wang , Lu Cao , Jianfeng Feng

Spiking Neural Networks (SNNs) offer a more energy-efficient alternative to Artificial Neural Networks (ANNs) by mimicking biological neural principles, establishing them as a promising approach to mitigate the increasing energy demands of…

Machine Learning · Computer Science 2025-02-24 Velibor Bojković , Xiaofeng Wu , Bin Gu

Neuromorphic computing is an emerging technology enabling low-latency and energy-efficient signal processing. A key algorithmic tool in neuromorphic computing is spiking neural networks (SNNs). SNNs are biologically inspired neural networks…

Machine Learning · Computer Science 2025-08-11 Sanja Karilanova , Subhrakanti Dey , Ayça Özçelikkale

The tremendous energy consumption of deep neural networks (DNNs) has become a serious problem in deep learning. Spiking neural networks (SNNs), which mimic the operations in the human brain, have been studied as prominent energy-efficient…

Neural and Evolutionary Computing · Computer Science 2021-06-07 Seongsik Park , Sungroh Yoon

As one of the energy-efficient alternatives of conventional neural networks (CNNs), spiking neural networks (SNNs) have gained more and more interest recently. To train the deep models, some effective batch normalization (BN) techniques are…

Computer Vision and Pattern Recognition · Computer Science 2023-08-17 Yufei Guo , Yuhan Zhang , Yuanpei Chen , Weihang Peng , Xiaode Liu , Liwen Zhang , Xuhui Huang , Zhe Ma

Spiking Neural Networks (SNNs), particularly Spiking Transformers, offer energy-efficient processing of event-based sensor data for healthcare applications. Yet current architectures are rigid: they are trained and deployed as static…

Neural and Evolutionary Computing · Computer Science 2026-05-15 Alberto Ancilotto , Gianluca Amprimo , Stefano Di Carlo , Elisabetta Farella

Brain-inspired Spiking Neural Networks (SNNs) have attracted attention for their event-driven characteristics and high energy efficiency. However, the temporal dependency and irregularity of spikes present significant challenges for…

Hardware Architecture · Computer Science 2025-06-11 Kainan Wang , Chengyi Yang , Chengting Yu , Yee Sin Ang , Bo Wang , Aili Wang

Brain-inspired Spiking Neural Networks (SNNs) have the characteristics of event-driven and high energy-efficient, which are different from traditional Artificial Neural Networks (ANNs) when deployed on edge devices such as neuromorphic…

Computer Vision and Pattern Recognition · Computer Science 2023-08-10 Jue Chen , Huan Yuan , Jianchao Tan , Bin Chen , Chengru Song , Di Zhang

Spiking neural networks (SNNs) provide an energy-efficient solution by utilizing the spike-based and sparse nature of biological systems. Since the advent of Transformers, SNNs have struggled to compete with artificial networks on long…

Neural and Evolutionary Computing · Computer Science 2024-10-24 Yan Zhong , Ruoyu Zhao , Chao Wang , Qinghai Guo , Jianguo Zhang , Zhichao Lu , Luziwei Leng

Spiking Neural Networks (SNNs), recognized as the third generation of neural networks, are known for their bio-plausibility and energy efficiency, especially when implemented on neuromorphic hardware. However, the majority of existing…

Neural and Evolutionary Computing · Computer Science 2024-07-02 Yi Jiang , Sen Lu , Abhronil Sengupta

Implantable Brain-machine interfaces (BMIs) are promising for motor rehabilitation and mobility augmentation, and they demand accurate and energy-efficient algorithms. In this paper, we propose a novel spiking neural network (SNN) decoder…

Signal Processing · Electrical Eng. & Systems 2024-05-06 Jiawei Liao , Oscar Toomey , Xiaying Wang , Lars Widmer , Cynthia A. Chestek , Luca Benini , Taekwang Jang