English
Related papers

Related papers: Toward Efficient Spiking Transformers: Synapse Pru…

200 papers

Spiking neural networks (SNNs) are energy-efficient neural networks because of their spiking nature. However, as the spike firing rate of SNNs increases, the energy consumption does as well, and thus, the advantage of SNNs diminishes. Here,…

Machine Learning · Computer Science 2024-01-15 Kazuma Suetake , Takuya Ushimaru , Ryuji Saiin , Yoshihide Sawada

Although representation learning methods developed within the framework of traditional neural networks are relatively mature, developing a spiking representation model remains a challenging problem. This paper proposes an event-based method…

Neural and Evolutionary Computing · Computer Science 2018-06-15 Amirhossein Tavanaei , Timothee Masquelier , Anthony Maida

Spiking Neural Networks (SNNs) have attracted enormous research interest due to temporal information processing capability, low power consumption, and high biological plausibility. However, the formulation of efficient and high-performance…

Neural and Evolutionary Computing · Computer Science 2021-08-18 Wei Fang , Zhaofei Yu , Yanqi Chen , Timothee Masquelier , Tiejun Huang , Yonghong Tian

Spiking neural networks (SNNs) show great potential due to their energy efficiency, fast processing capabilities, and robustness. There are two main approaches to constructing SNNs. Direct training methods require much memory, while…

Computer Vision and Pattern Recognition · Computer Science 2025-03-03 Zihan Huang , Xinyu Shi , Zecheng Hao , Tong Bu , Jianhao Ding , Zhaofei Yu , Tiejun Huang

Spiking Neural Networks (SNNs) have garnered substantial attention in brain-like computing for their biological fidelity and the capacity to execute energy-efficient spike-driven operations. As the demand for heightened performance in SNNs…

Computer Vision and Pattern Recognition · Computer Science 2024-07-09 Yimeng Shan , Xuerui Qiu , Rui-jie Zhu , Jason K. Eshraghian , Malu Zhang , Haicheng Qu

Spiking neural networks (SNNs) are brain-inspired models that enable energy-efficient implementation on neuromorphic hardware. However, the supervised training of SNNs remains a hard problem due to the discontinuity of the spiking neuron…

Neural and Evolutionary Computing · Computer Science 2021-12-20 Mingqing Xiao , Qingyan Meng , Zongpeng Zhang , Yisen Wang , Zhouchen Lin

Despite basic differences between Spiking Neural Networks (SNN) and Artificial Neural Networks (ANN), most research on SNNs involve adapting ANN-based methods for SNNs. Pruning (dropping connections) and quantization (reducing precision)…

Neural and Evolutionary Computing · Computer Science 2024-08-07 Dylan Adams , Magda Zajaczkowska , Ashiq Anjum , Andrea Soltoggio , Shirin Dora

Brain-inspired Spiking neural networks (SNNs) promise energy-efficient intelligence via event-driven, sparse computation, but deeper architectures inflate parameters and computational cost, hindering their edge deployment. Recent progress…

Computer Vision and Pattern Recognition · Computer Science 2025-11-18 Shuhan Ye , Yi Yu , Qixin Zhang , Chenqi Kong , Qiangqiang Wu , Xudong Jiang , Dacheng Tao

Spiking neural networks are efficient computation models for low-power environments. Spike-based BP algorithms and ANN-to-SNN (ANN2SNN) conversions are successful techniques for SNN training. Nevertheless, the spike-base BP training is slow…

Neural and Evolutionary Computing · Computer Science 2023-08-31 Jianxiong Tang , Jianhuang Lai , Xiaohua Xie , Lingxiao Yang , Wei-Shi Zheng

Spiking neural networks (SNNs) are distributed trainable systems whose computing elements, or neurons, are characterized by internal analog dynamics and by digital and sparse synaptic communications. The sparsity of the synaptic spiking…

Machine Learning · Computer Science 2020-01-08 Hyeryung Jang , Osvaldo Simeone , Brian Gardner , André Grüning

Spiking Neural Networks (SNNs) have emerged as a popular spatio-temporal computing paradigm for complex vision tasks. Recently proposed SNN training algorithms have significantly reduced the number of time steps (down to 1) for improved…

Computer Vision and Pattern Recognition · Computer Science 2023-11-29 Gourav Datta , Zeyu Liu , Anni Li , Peter A. Beerel

Spiking neural networks (SNNs) take inspiration from the brain to enable energy-efficient computations. Since the advent of Transformers, SNNs have struggled to compete with artificial networks on modern sequential tasks, as they inherit…

Neural and Evolutionary Computing · Computer Science 2024-01-03 Matei Ioan Stan , Oliver Rhodes

As deep neural networks are growing in size and being increasingly deployed to more resource-limited devices, there has been a recent surge of interest in network pruning methods, which aim to remove less important weights or activations of…

Machine Learning · Computer Science 2020-06-23 Minyoung Song , Jaehong Yoon , Eunho Yang , Sung Ju Hwang

This paper introduces a Spiking Diffusion Policy (SDP) learning method for robotic manipulation by integrating Spiking Neurons and Learnable Channel-wise Membrane Thresholds (LCMT) into the diffusion policy model, thereby enhancing…

Robotics · Computer Science 2024-09-18 Zhixing Hou , Maoxu Gao , Hang Yu , Mengyu Yang , Chio-In Ieong

Spiking Neural Networks (SNNs) are seen as an energy-efficient alternative to traditional Artificial Neural Networks (ANNs), but the performance gap remains a challenge. While this gap is narrowing through ANN-to-SNN conversion, substantial…

Computer Vision and Pattern Recognition · Computer Science 2024-12-24 Ziqing Wang , Yuetong Fang , Jiahang Cao , Hongwei Ren , Renjing Xu

Spiking Neural Networks (SNNs) that operate in an event-driven manner and employ binary spike representation have recently emerged as promising candidates for energy-efficient computing. However, a cost bottleneck arises in obtaining…

Neural and Evolutionary Computing · Computer Science 2024-01-22 Yunpeng Yao , Man Wu , Zheng Chen , Renyuan Zhang

Spiking neural networks (SNNs) are artificial neural networks based on simulated biological neurons and have attracted much attention in recent artificial intelligence technology studies. The dendrites in biological neurons have efficient…

Neurons and Cognition · Quantitative Biology 2025-10-14 Wuque Cai , Hongze Sun , Jiayi He , Qianqian Liao , Yunliang Zang , Duo Chen , Dezhong Yao , Daqing Guo

Artificial neural networks (ANNs) have demonstrated outstanding performance in numerous tasks, but deployment in resource-constrained environments remains a challenge due to their high computational and memory requirements. Spiking neural…

Machine Learning · Computer Science 2025-06-04 Chang Liu , Jiangrong Shen , Xuming Ran , Mingkun Xu , Qi Xu , Yi Xu , Gang Pan

The problem of training spiking neural networks (SNNs) is a necessary precondition to understanding computations within the brain, a field still in its infancy. Previous work has shown that supervised learning in multi-layer SNNs enables…

Neural and Evolutionary Computing · Computer Science 2018-03-12 Amirhossein Tavanaei , Anthony S. Maida

Spiking neural networks (SNNs) employing unsupervised learning methods inspired by neural plasticity are expected to be a new framework for artificial intelligence. In this study, we investigated the effect of multiple types of neural…

Neural and Evolutionary Computing · Computer Science 2026-01-19 Shinnosuke Touda , Hirotsugu Okuno
‹ Prev 1 3 4 5 6 7 10 Next ›