English
Related papers

Related papers: Comprehensive SNN Compression Using ADMM Optimizat…

200 papers

Recent years have witnessed Spiking Neural Networks (SNNs) gaining attention for their ultra-low energy consumption and high biological plausibility compared with traditional Artificial Neural Networks (ANNs). Despite their distinguished…

Neural and Evolutionary Computing · Computer Science 2024-08-30 Jiahang Cao , Hanzhong Guo , Ziqing Wang , Deming Zhou , Hao Cheng , Qiang Zhang , Renjing Xu

Compressing Deep Neural Network (DNN) models to alleviate the storage and computation requirements is essential for practical applications, especially for resource limited devices. Although capable of reducing a reasonable amount of model…

Machine Learning · Computer Science 2021-06-17 Sheng Lin , Wei Jiang , Wei Wang , Kaidi Xu , Yanzhi Wang , Shan Liu , Songnan Li

Spiking Neural Networks (SNNs) have been widely praised for their high energy efficiency and immense potential. However, comprehensive research that critically contrasts and correlates SNNs with quantized Artificial Neural Networks (ANNs)…

Neural and Evolutionary Computing · Computer Science 2023-11-21 Guobin Shen , Dongcheng Zhao , Tenglong Li , Jindong Li , Yi Zeng

Spiking neural networks (SNNs) are well known as the brain-inspired models with high computing efficiency, due to a key component that they utilize spikes as information units, close to the biological neural systems. Although spiking based…

Neural and Evolutionary Computing · Computer Science 2023-04-18 Qi Xu , Yaxin Li , Jiangrong Shen , Jian K Liu , Huajin Tang , Gang Pan

Deep artificial neural networks (ANNs) can represent a wide range of complex functions. Implementing ANNs in Von Neumann computing systems, though, incurs a high energy cost due to the bottleneck created between CPU and memory.…

Neural and Evolutionary Computing · Computer Science 2018-02-21 John Mern , Jayesh K Gupta , Mykel Kochenderfer

The machine learning community has become increasingly interested in the energy efficiency of neural networks. The Spiking Neural Network (SNN) is a promising approach to energy-efficient computing, since its activation levels are quantized…

Machine Learning · Computer Science 2021-03-03 Aaron R. Voelker , Daniel Rasmussen , Chris Eliasmith

The increase in capacity provided by coupled SDM systems is fundamentally limited by MDG and ASE noise. Therefore, monitoring MDG and optical SNR is essential for accurate performance evaluation and troubleshooting. Recent works show that…

In recent years, newly developed methods to train spiking neural networks (SNNs) have rendered them as a plausible alternative to Artificial Neural Networks (ANNs) in terms of accuracy, while at the same time being much more energy…

Neural and Evolutionary Computing · Computer Science 2023-05-17 Nicolas Perez-Nieves , Dan F. M Goodman

Spiking neural networks (SNNs) provide an energy-efficient alternative to a variety of artificial neural network (ANN) based AI applications. As the progress in neuromorphic computing with SNNs expands their use in applications, the problem…

Neural and Evolutionary Computing · Computer Science 2024-04-15 Ozan Özdenizci , Robert Legenstein

Weight pruning of deep neural networks (DNNs) has been proposed to satisfy the limited storage and computing capability of mobile edge devices. However, previous pruning methods mainly focus on reducing the model size and/or improving…

Machine Learning · Computer Science 2022-03-29 Yifan Gong , Zheng Zhan , Zhengang Li , Wei Niu , Xiaolong Ma , Wenhao Wang , Bin Ren , Caiwen Ding , Xue Lin , Xiaolin Xu , Yanzhi Wang

Spiking neural networks (SNNs), particularly the single-spike variant in which neurons spike at most once, are considerably more energy efficient than standard artificial neural networks (ANNs). However, single-spike SSNs are difficult to…

Neural and Evolutionary Computing · Computer Science 2022-10-13 Luke Taylor , Andrew King , Nicol Harper

Spiking Neural Networks (SNNs) offer a promising and energy-efficient alternative to conventional neural networks, thanks to their sparse binary activation. However, they face challenges regarding memory and computation overhead due to…

Neural and Evolutionary Computing · Computer Science 2026-01-06 Donghyun Lee , Abhishek Moitra , Youngeun Kim , Ruokai Yin , Priyadarshini Panda

Communication by rare, binary spikes is a key factor for the energy efficiency of biological brains. However, it is harder to train biologically-inspired spiking neural networks (SNNs) than artificial neural networks (ANNs). This is…

Neural and Evolutionary Computing · Computer Science 2023-11-21 Ana Stanojevic , Stanisław Woźniak , Guillaume Bellec , Giovanni Cherubini , Angeliki Pantazi , Wulfram Gerstner

Spiking Neural Network (SNN), originating from the neural behavior in biology, has been recognized as one of the next-generation neural networks. Conventionally, SNNs can be obtained by converting from pre-trained Artificial Neural Networks…

Neural and Evolutionary Computing · Computer Science 2022-05-23 Yuhang Li , Shikuang Deng , Xin Dong , Shi Gu

Training deep neural networks (DNNs) on edge devices has attracted increasing attention due to its potential to address challenges related to domain adaptation and privacy preservation. However, DNNs typically rely on large datasets for…

Machine Learning · Computer Science 2025-08-05 Boran Zhao , Haiduo Huang , Qiwei Dang , Wenzhe Zhao , Tian Xia , Pengju Ren

Spiking Neural Networks (SNNs) have received extensive academic attention due to the unique properties of low power consumption and high-speed computing on neuromorphic chips. Among various training methods of SNNs, ANN-SNN conversion has…

Neural and Evolutionary Computing · Computer Science 2023-02-07 Zecheng Hao , Tong Bu , Jianhao Ding , Tiejun Huang , Zhaofei Yu

Compression and efficient storage of neural network (NN) parameters is critical for applications that run on resource-constrained devices. Despite the significant progress in NN model compression, there has been considerably less…

Machine Learning · Computer Science 2023-03-15 Berivan Isik , Kristy Choi , Xin Zheng , Tsachy Weissman , Stefano Ermon , H. -S. Philip Wong , Armin Alaghi

The ambition of brain-inspired Spiking Neural Networks (SNNs) is to become a low-power alternative to traditional Artificial Neural Networks (ANNs). This work addresses two major challenges in realizing this vision: the performance gap…

Computer Vision and Pattern Recognition · Computer Science 2025-01-22 Man Yao , Xuerui Qiu , Tianxiang Hu , Jiakui Hu , Yuhong Chou , Keyu Tian , Jianxing Liao , Luziwei Leng , Bo Xu , Guoqi Li

One of the most exciting advancements in AI over the last decade is the wide adoption of ANNs, such as DNN and CNN, in many real-world applications. However, the underlying massive amounts of computation and storage requirement greatly…

Neural and Evolutionary Computing · Computer Science 2018-03-15 Tao Liu , Lei Jiang , Yier Jin , Gang Quan , Wujie Wen

Spiking Neural Networks (SNNs) have emerged as a promising approach to improve the energy efficiency of machine learning models, as they naturally implement event-driven computations while avoiding expensive multiplication operations. In…

Neural and Evolutionary Computing · Computer Science 2024-10-31 Anagha Nimbekar , Prabodh Katti , Chen Li , Bashir M. Al-Hashimi , Amit Acharyya , Bipin Rajendran