English
Related papers

Related papers: On Reducing Activity with Distillation and Regular…

200 papers

Spiking neural networks (SNNs) have made great progress on both performance and efficiency over the last few years,but their unique working pattern makes it hard to train a high-performance low-latency SNN.Thus the development of SNNs still…

Neural and Evolutionary Computing · Computer Science 2022-11-22 Yudong Li , Yunlin Lei , Xu Yang

Deep Neural Networks (DNNs) have significantly advanced the field of computer vision. To improve DNN training process, knowledge distillation methods demonstrate their effectiveness in accelerating network training by introducing a fixed…

Computer Vision and Pattern Recognition · Computer Science 2025-07-01 Daqian Shi , Xiaolei Diao , Xu Chen , Cédric M. John

Artificial neural networks (ANNs), particularly large language models (LLMs), demonstrate powerful inference capabilities but consume substantial energy. Conversely, spiking neural networks (SNNs) exhibit exceptional energy efficiency due…

Machine Learning · Computer Science 2026-02-10 Chenyu Wang , Zhanglu Yan , Zhi Zhou , Xu Chen , Weng-Fai Wong

Spiking Neural Networks (SNNs) have attracted great attention due to their distinctive characteristics of low power consumption and temporal information processing. ANN-SNN conversion, as the most commonly used training method for applying…

Neural and Evolutionary Computing · Computer Science 2023-02-22 Zecheng Hao , Jianhao Ding , Tong Bu , Tiejun Huang , Zhaofei Yu

Inspired by the human brain's ability to adapt to new tasks without erasing prior knowledge, we develop spiking neural networks (SNNs) with dynamic structures for Class Incremental Learning (CIL). Our comparative experiments reveal that…

Computer Vision and Pattern Recognition · Computer Science 2024-12-18 Wenyao Ni , Jiangrong Shen , Qi Xu , Huajin Tang

Spiking neural networks (SNNs), known for their low-power, event-driven computation and intrinsic temporal dynamics, are emerging as promising solutions for processing dynamic, asynchronous signals from event-based sensors. Despite their…

Computer Vision and Pattern Recognition · Computer Science 2024-08-05 Rui Zhang , Luziwei Leng , Kaiwei Che , Hu Zhang , Jie Cheng , Qinghai Guo , Jiangxing Liao , Ran Cheng

Spiking Neural Networks (SNNs) have emerged as a promising alternative to traditional Deep Neural Networks for low-power computing. However, the effectiveness of SNNs is not solely determined by their performance but also by their energy…

Neural and Evolutionary Computing · Computer Science 2023-05-19 Florian Bacho , Dominique Chu

Spiking Neural Networks (SNNs) have emerged as an attractive spatio-temporal computing paradigm for complex vision tasks. However, most existing works yield models that require many time steps and do not leverage the inherent temporal…

Neural and Evolutionary Computing · Computer Science 2022-10-25 Gourav Datta , Haoqin Deng , Robert Aviles , Peter A. Beerel

Spiking neural networks (SNNs) have advantages in latency and energy efficiency over traditional artificial neural networks (ANNs) due to its event-driven computation mechanism and replacement of energy-consuming weight multiplications with…

Neural and Evolutionary Computing · Computer Science 2023-11-03 Zhehui Wang , Xiaozhe Gu , Rick Goh , Joey Tianyi Zhou , Tao Luo

In recent years, spiking neural networks (SNNs) have attracted substantial interest due to their potential to replicate the energy-efficient and event-driven processing of biological neurons. Despite this, the application of SNNs in graph…

Artificial Intelligence · Computer Science 2024-07-31 Mingkun Xu , Huifeng Yin , Yujie Wu , Guoqi Li , Faqiang Liu , Jing Pei , Shuai Zhong , Lei Deng

Despite basic differences between Spiking Neural Networks (SNN) and Artificial Neural Networks (ANN), most research on SNNs involve adapting ANN-based methods for SNNs. Pruning (dropping connections) and quantization (reducing precision)…

Neural and Evolutionary Computing · Computer Science 2024-08-07 Dylan Adams , Magda Zajaczkowska , Ashiq Anjum , Andrea Soltoggio , Shirin Dora

Spiking Neural Networks (SNNs) have been attached great importance due to the distinctive properties of low power consumption, biological plausibility, and adversarial robustness. The most effective way to train deep SNNs is through…

Neural and Evolutionary Computing · Computer Science 2022-02-04 Tong Bu , Jianhao Ding , Zhaofei Yu , Tiejun Huang

As spiking neural networks (SNNs) are event-driven, energy efficiency is higher than conventional artificial neural networks (ANNs). Since SNN delivers data through discrete spikes, it is difficult to use gradient methods for training,…

Neural and Evolutionary Computing · Computer Science 2024-03-15 Sangwoo Hwang , Jaeha Kung

Deep Neural Networks (DNNs) are the current state-of-the-art models in many speech related tasks. There is a growing interest, though, for more biologically realistic, hardware friendly and energy efficient models, named Spiking Neural…

Machine Learning · Computer Science 2020-11-16 Thomas Pellegrini , Romain Zimmer , Timothée Masquelier

Recent years have witnessed Spiking Neural Networks (SNNs) gaining attention for their ultra-low energy consumption and high biological plausibility compared with traditional Artificial Neural Networks (ANNs). Despite their distinguished…

Neural and Evolutionary Computing · Computer Science 2024-08-30 Jiahang Cao , Hanzhong Guo , Ziqing Wang , Deming Zhou , Hao Cheng , Qiang Zhang , Renjing Xu

Spiking Neural Networks (SNNs) have emerged as a promising energy-efficient alternative to traditional Artificial Neural Networks (ANNs). Despite this, bridging the performance gap with ANNs in practical scenarios remains a significant…

Computer Vision and Pattern Recognition · Computer Science 2024-03-19 Ziqing Wang , Yuetong Fang , Jiahang Cao , Renjing Xu

A Spiking Neural Network (SNN) can be trained indirectly by first training an Artificial Neural Network (ANN) with the conventional backpropagation algorithm, then converting it into an SNN. The conventional rate-coding method for SNNs uses…

Neural and Evolutionary Computing · Computer Science 2021-06-15 Ming Zhang , Nenggan Zheng , De Ma , Gang Pan , Zonghua Gu

Spiking neural networks (SNNs) offer an inherent ability to process spatial-temporal data, or in other words, realworld sensory data, but suffer from the difficulty of training high accuracy models. A major thread of research on SNNs is on…

Computer Vision and Pattern Recognition · Computer Science 2022-05-27 Dengyu Wu , Xinping Yi , Xiaowei Huang

Spiking neural networks (SNNs) for event-based optical flow are claimed to be computationally more efficient than their artificial neural networks (ANNs) counterparts, but a fair comparison is missing in the literature. In this work, we…

Neural and Evolutionary Computing · Computer Science 2024-07-31 Yingfu Xu , Guangzhi Tang , Amirreza Yousefzadeh , Guido de Croon , Manolis Sifalakis

Artificial Neural Network (ANN) based techniques have dominated state-of-the-art results in most problems related to computer vision, audio recognition, and natural language processing in the past few years, resulting in strong industrial…

Neural and Evolutionary Computing · Computer Science 2019-06-24 Khaled F. Hussain , Mohamed Yousef Bassyouni , Erol Gelenbe