English
Related papers

Related papers: Brain-Inspired Efficient Pruning: Exploiting Criti…

200 papers

Bio-inspired Spiking Neural Networks (SNN) are now demonstrating comparable accuracy to intricate convolutional neural networks (CNN), all while delivering remarkable energy and latency efficiency when deployed on neuromorphic hardware. In…

Computer Vision and Pattern Recognition · Computer Science 2023-12-13 Gourav Datta , Zeyu Liu , James Diffenderfer , Bhavya Kailkhura , Peter A. Beerel

Spiking Neural Networks (SNNs) are inspired by the sparse and event-driven nature of biological neural processing, and offer the potential for ultra-low-power artificial intelligence. However, realizing their efficiency benefits requires…

Hardware Architecture · Computer Science 2024-08-27 Ilkin Aliyev , Kama Svoboda , Tosiron Adegbija , Jean-Marc Fellous

With the rapid development of deep learning, Deep Spiking Neural Networks (DSNNs) have emerged as promising due to their unique spike event processing and asynchronous computation. When deployed on neuromorphic chips, DSNNs offer…

Neural and Evolutionary Computing · Computer Science 2024-07-15 Hui Xie , Ge Yang , Wenjuan Gao

As a foundational architecture of artificial intelligence models, Transformer has been recently adapted to spiking neural networks with promising performance across various tasks. However, existing spiking Transformer(ST)-based models…

Machine Learning · Computer Science 2026-01-06 Hongze Sun , Wuque Cai , Duo Chen , Quan Tang , Shifeng Mao , Jiayi He , Zhenxing Wang , Yan Cui , Dezhong Yao , Daqing Guo

Neural networks (NNs) are making a large impact both on research and industry. Nevertheless, as NNs' accuracy increases, it is followed by an expansion in their size, required number of compute operations and energy consumption. Increase in…

Machine Learning · Computer Science 2021-12-21 Martin Ferianc , Anush Sankaran , Olivier Mastropietro , Ehsan Saboori , Quentin Cappart

We introduce a pruning algorithm that provably sparsifies the parameters of a trained model in a way that approximately preserves the model's predictive accuracy. Our algorithm uses a small batch of input points to construct a data-informed…

Machine Learning · Computer Science 2021-03-16 Cenk Baykal , Lucas Liebenwein , Igor Gilitschenski , Dan Feldman , Daniela Rus

Spiking Neural Networks (SNNs) have gained attention for their energy-efficient machine learning capabilities, utilizing bio-inspired activation functions and sparse binary spike-data representations. While recent SNN algorithmic advances…

Neural and Evolutionary Computing · Computer Science 2023-09-08 Abhiroop Bhattacharjee , Ruokai Yin , Abhishek Moitra , Priyadarshini Panda

State-of-the-art neural networks are getting deeper and wider. While their performance increases with the increasing number of layers and neurons, it is crucial to design an efficient deep architecture in order to reduce computational and…

Neural and Evolutionary Computing · Computer Science 2016-07-13 Hengyuan Hu , Rui Peng , Yu-Wing Tai , Chi-Keung Tang

Biologically-inspired Spiking Neural Networks (SNNs), processing information using discrete-time events known as spikes rather than continuous values, have garnered significant attention due to their hardware-friendly and energy-efficient…

Neural and Evolutionary Computing · Computer Science 2023-08-21 Bin Lei , Sheng Lin , Pei-Hung Lin , Chunhua Liao , Caiwen Ding

Spiking Neural Network (SNN) is the third generation of Neural Network (NN) mimicking the natural behavior of the brain. By processing based on binary input/output, SNNs offer lower complexity, higher density and lower power consumption.…

Neural and Evolutionary Computing · Computer Science 2020-03-24 Khanh N. Dang , Abderazek Ben Abdallah

Spiking Neural Networks (SNNs) represent the forefront of neuromorphic computing, promising energy-efficient and biologically plausible models for complex tasks. This paper weaves together three groundbreaking studies that revolutionize SNN…

Neural and Evolutionary Computing · Computer Science 2024-07-10 Biswadeep Chakraborty , Saibal Mukhopadhyay

Spiking neural networks (SNNs) are a viable alternative to conventional artificial neural networks when resource efficiency and computational complexity are of importance. A major advantage of SNNs is their binary information transfer…

Neural and Evolutionary Computing · Computer Science 2023-10-18 Daniel Gerlinghoff , Tao Luo , Rick Siow Mong Goh , Weng-Fai Wong

Spiking neural networks (SNNs) have manifested remarkable advantages in power consumption and event-driven property during the inference process. To take full advantage of low power consumption and improve the efficiency of these models…

Neural and Evolutionary Computing · Computer Science 2023-06-07 Jiangrong Shen , Qi Xu , Jian K. Liu , Yueming Wang , Gang Pan , Huajin Tang

Spiking Neural Networks (SNNs) represent the latest generation of neural computation, offering a brain-inspired alternative to conventional Artificial Neural Networks (ANNs). Unlike ANNs, which depend on continuous-valued signals, SNNs…

Neural and Evolutionary Computing · Computer Science 2025-11-03 Sales G. Aribe

Spiking Neural Networks (SNNs) promise higher energy efficiency over conventional Quantized Artificial Neural Networks (QNNs) due to their event-driven, spike-based computation. However, prevailing energy evaluations often oversimplify,…

Neural and Evolutionary Computing · Computer Science 2026-05-13 Zhanglu Yan , Zhenyu Bai , Weng-Fai Wong

Spiking neural networks (SNNs) are artificial neural networks based on simulated biological neurons and have attracted much attention in recent artificial intelligence technology studies. The dendrites in biological neurons have efficient…

Neurons and Cognition · Quantitative Biology 2025-10-14 Wuque Cai , Hongze Sun , Jiayi He , Qianqian Liao , Yunliang Zang , Duo Chen , Dezhong Yao , Daqing Guo

Spiking Neural Networks (SNNs) offer an energy-efficient paradigm for machine intelligence, but their continued scaling poses challenges for resource-limited deployment. Despite recent advances in binary SNNs, the storage and computational…

Computer Vision and Pattern Recognition · Computer Science 2025-10-27 Wenjie Wei , Malu Zhang , Jieyuan Zhang , Ammar Belatreche , Shuai Wang , Yimeng Shan , Hanwen Liu , Honglin Cao , Guoqing Wang , Yang Yang , Haizhou Li

The machine learning community has become increasingly interested in the energy efficiency of neural networks. The Spiking Neural Network (SNN) is a promising approach to energy-efficient computing, since its activation levels are quantized…

Machine Learning · Computer Science 2021-03-03 Aaron R. Voelker , Daniel Rasmussen , Chris Eliasmith

Artificial Spiking Neural Networks (ASNNs) promise greater information processing efficiency because of discrete event-based (i.e., spike) computation. Several Machine Learning (ML) applications use biologically inspired plasticity…

Machine Learning · Computer Science 2022-03-15 Mahima Milinda Alwis Weerasinghe , David Parry , Grace Wang , Jacqueline Whalley

Spiking neural networks (SNNs) are biology-inspired artificial neural networks (ANNs) that comprise of spiking neurons to process asynchronous discrete signals. While more efficient in power consumption and inference speed on the…

Neural and Evolutionary Computing · Computer Science 2021-03-02 Shikuang Deng , Shi Gu