English
Related papers

Related papers: SpiLiFormer: Enhancing Spiking Transformers with L…

200 papers

Spiking neural networks (SNNs) with event-based computation are promising brain-inspired models for energy-efficient applications on neuromorphic hardware. However, most supervised SNN training methods, such as conversion from artificial…

Neural and Evolutionary Computing · Computer Science 2023-02-02 Mingqing Xiao , Qingyan Meng , Zongpeng Zhang , Yisen Wang , Zhouchen Lin

Speech enhancement is critical for improving speech intelligibility and quality in various audio devices. In recent years, deep learning-based methods have significantly improved speech enhancement performance, but they often come with a…

Audio and Speech Processing · Electrical Eng. & Systems 2024-10-08 Xiang Hao , Chenxiang Ma , Qu Yang , Jibin Wu , Kay Chen Tan

Spike train classification has recently become an important topic in the machine learning community, where each spike train is a binary event sequence with \emph{temporal-sparsity of signals of interest} and \emph{temporal-noise}…

Neural and Evolutionary Computing · Computer Science 2024-11-12 Hang Yin , Yao Su , Liping Liu , Thomas Hartvigsen , Xin Dai , Xiangnan Kong

Spiking Neural Networks (SNNs) promise orders-of-magnitude lower power consumption and low-latency inference on neuromorphic hardware for a wide range of robotic tasks. In this work, we present an energy-efficient implementation of a…

Machine Learning · Computer Science 2025-08-01 Sirine Arfa , Bernhard Vogginger , Christian Mayr

Spiking neural networks (SNNs) that enables energy efficient implementation on emerging neuromorphic hardware are gaining more attention. Yet now, SNNs have not shown competitive performance compared with artificial neural networks (ANNs),…

Neural and Evolutionary Computing · Computer Science 2018-11-26 Yujie Wu , Lei Deng , Guoqi Li , Jun Zhu , Luping Shi

Multi-bit spiking neural networks (SNNs) have recently become a heated research spot, pursuing energy-efficient and high-accurate AI. However, with more bits involved, the associated memory and computation demands escalate to the point…

Neural and Evolutionary Computing · Computer Science 2025-12-02 Xingting Yao , Qinghao Hu , Fei Zhou , Tielong Liu , Gang Li , Peisong Wang , Jian Cheng

Spiking Neural Networks (SNNs) provide an energy-efficient paradigm for visual recognition. We present SpikingMoE, which integrates a spike-driven Transformer with a Mixture-of-Experts (MoE) framework for dynamic computation. Inspired by…

Neural and Evolutionary Computing · Computer Science 2026-05-25 Yukai Yang , Chenxi Qin , Jungang Li , Xin Zhang , Wenwei Shao , Liqun Chen

Continuous learning of novel classes is crucial for edge devices to preserve data privacy and maintain reliable performance in dynamic environments. However, the scenario becomes particularly challenging when data samples are insufficient,…

Machine Learning · Computer Science 2026-05-12 Huijing Zhang , Muyang Cao , Linshan Jiang , Xin Du , Di Yu , Changze Lv , Shuiguang Deng

Spiking Transformers have recently emerged as promising architectures for combining the efficiency of spiking neural networks with the representational power of self-attention. However, the lack of standardized implementations, evaluation…

Neural and Evolutionary Computing · Computer Science 2025-12-24 Sicheng Shen , Dongcheng Zhao , Linghao Feng , Zeyang Yue , Jindong Li , Tenglong Li , Guobin Shen , Yi Zeng

Spiking neural networks (SNNs) are posited as a computationally efficient and biologically plausible alternative to conventional neural architectures, with their core computational framework primarily using the leaky integrate-and-fire…

Neural and Evolutionary Computing · Computer Science 2025-03-18 Malyaban Bal , Abhronil Sengupta

Spiking neural network (SNN) is interesting both theoretically and practically because of its strong bio-inspiration nature and potentially outstanding energy efficiency. Unfortunately, its development has fallen far behind the conventional…

Computer Vision and Pattern Recognition · Computer Science 2021-09-20 Shibo Zhou , Xiaohua LI , Ying Chen , Sanjeev T. Chandrasekaran , Arindam Sanyal

Lateral connection is a fundamental feature of biological neural circuits, facilitating local information processing and adaptive learning. In this work, we integrate lateral connections with a substructure selection network to develop a…

Neural and Evolutionary Computing · Computer Science 2025-04-01 Linghao Feng , Dongcheng Zhao , Sicheng Shen , Yi Zeng

Spiking neural networks (SNNs) are known as a typical kind of brain-inspired models with their unique features of rich neuronal dynamics, diverse coding schemes and low power consumption properties. How to obtain a high-accuracy model has…

Neural and Evolutionary Computing · Computer Science 2022-03-07 Yihan Lin , Yifan Hu , Shijie Ma , Guoqi Li , Dongjie Yu

This paper introduces the first low-power hardware accelerator for Spiking Transformers, an emerging alternative to traditional artificial neural networks. By modifying the base Spikformer model to use IAND instead of residual addition, the…

Hardware Architecture · Computer Science 2025-03-26 Bo-Yu Chen , Tian-Sheuan Chang

Deep neural networks have surpassed human performance in key visual challenges such as object recognition, but require a large amount of energy, computation, and memory. In contrast, spiking neural networks (SNNs) have the potential to…

Neurons and Cognition · Quantitative Biology 2022-12-02 Melani Sanchez-Garcia , Tushar Chauhan , Benoit R. Cottereau , Michael Beyeler

Spiking Neural Networks (SNNs), with their brain-inspired spatiotemporal dynamics and spike-driven computation, have emerged as promising energy-efficient alternatives to Artificial Neural Networks (ANNs). However, existing SNNs typically…

Computer Vision and Pattern Recognition · Computer Science 2025-12-03 Fan Luo , Zeyu Gao , Xinhao Luo , Kai Zhao , Yanfeng Lu

Spiking Neural Networks (SNNs) offer a biologically plausible framework for energy-efficient neuromorphic computing. However, it is a challenge to train SNNs due to their non-differentiability, efficiently. Existing gradient approximation…

Computer Vision and Pattern Recognition · Computer Science 2025-08-04 Changqing Xu , Ziqiang Yang , Yi Liu , Xinfang Liao , Guiqi Mo , Hao Zeng , Yintang Yang

Spiking Neural Networks (SNNs) are increasingly favored for deployment on resource-constrained edge devices due to their energy-efficient and event-driven processing capabilities. However, training SNNs remains challenging because of the…

Hardware Architecture · Computer Science 2025-07-22 Haoxiong Ren , Yangu He , Kwunhang Wong , Rui Bao , Ning Lin , Zhongrui Wang , Dashan Shang

Hardware accelerators are essential for achieving low-latency, energy-efficient inference in edge applications like image recognition. Spiking Neural Networks (SNNs) are particularly promising due to their event-driven and temporally sparse…

Neural and Evolutionary Computing · Computer Science 2026-02-25 Alessio Caviglia , Filippo Marostica , Alessio Carpegna , Alessandro Savino , Stefano Di Carlo

Implantable brain-machine interfaces (iBMIs) are evolving to record from thousands of neurons wirelessly but face challenges in data bandwidth, power consumption, and implant size. We propose a novel Spiking Neural Network Spike Detector…

Signal Processing · Electrical Eng. & Systems 2025-05-13 Chanwook Hwang , Biyan Zhou , Ye Ke , Vivek Mohan , Jong Hwan Ko , Arindam Basu