English
Related papers

Related papers: Solving the Spike Feature Information Vanishing Pr…

200 papers

The field of neuromorphic computing promises extremely low-power and low-latency sensing and processing. Challenges in transferring learning algorithms from traditional artificial neural networks (ANNs) to spiking neural networks (SNNs)…

Computer Vision and Pattern Recognition · Computer Science 2021-10-27 Jesse Hagenaars , Federico Paredes-Vallés , Guido de Croon

Spiking neural networks (SNNs), particularly the single-spike variant in which neurons spike at most once, are considerably more energy efficient than standard artificial neural networks (ANNs). However, single-spike SSNs are difficult to…

Neural and Evolutionary Computing · Computer Science 2022-10-13 Luke Taylor , Andrew King , Nicol Harper

Communication by rare, binary spikes is a key factor for the energy efficiency of biological brains. However, it is harder to train biologically-inspired spiking neural networks (SNNs) than artificial neural networks (ANNs). This is…

Neural and Evolutionary Computing · Computer Science 2023-11-21 Ana Stanojevic , Stanisław Woźniak , Guillaume Bellec , Giovanni Cherubini , Angeliki Pantazi , Wulfram Gerstner

Deep neural networks have been proven to be highly effective tools in various domains, yet their computational and memory costs restrict them from being widely deployed on portable devices. The recent rapid increase of edge computing…

Neural and Evolutionary Computing · Computer Science 2023-06-01 Ayan Shymyrbay , Mohammed E. Fouda , Ahmed Eltawil

How can we bring both privacy and energy-efficiency to a neural system? In this paper, we propose PrivateSNN, which aims to build low-power Spiking Neural Networks (SNNs) from a pre-trained ANN model without leaking sensitive information…

Computer Vision and Pattern Recognition · Computer Science 2022-05-24 Youngeun Kim , Yeshwanth Venkatesha , Priyadarshini Panda

Spiking neural networks (SNNs) aim to realize brain-inspired intelligence on neuromorphic chips with high energy efficiency by introducing neural dynamics and spike properties. As the emerging spiking deep learning paradigm attracts…

Neural and Evolutionary Computing · Computer Science 2023-10-26 Wei Fang , Yanqi Chen , Jianhao Ding , Zhaofei Yu , Timothée Masquelier , Ding Chen , Liwei Huang , Huihui Zhou , Guoqi Li , Yonghong Tian

Recurrent spiking neural networks (RSNNs) are notoriously difficult to train because of the vanishing gradient problem that is enhanced by the binary nature of the spikes. In this paper, we review the ability of the current state-of-the-art…

Neural and Evolutionary Computing · Computer Science 2023-10-31 Ismael Balafrej , Fabien Alibart , Jean Rouat

Spiking Neural Networks (SNNs) are distributed trainable systems whose computing elements, or neurons, are characterized by internal analog dynamics and by digital and sparse synaptic communications. The sparsity of the synaptic spiking…

Signal Processing · Electrical Eng. & Systems 2019-10-22 Hyeryung Jang , Osvaldo Simeone , Brian Gardner , André Grüning

The ambition of brain-inspired Spiking Neural Networks (SNNs) is to become a low-power alternative to traditional Artificial Neural Networks (ANNs). This work addresses two major challenges in realizing this vision: the performance gap…

Computer Vision and Pattern Recognition · Computer Science 2025-01-22 Man Yao , Xuerui Qiu , Tianxiang Hu , Jiakui Hu , Yuhong Chou , Keyu Tian , Jianxing Liao , Luziwei Leng , Bo Xu , Guoqi Li

Deep convolutional neural networks (CNNs) have shown great potential for numerous real-world machine learning applications, but performing inference in large CNNs in real-time remains a challenge. We have previously demonstrated that…

Machine Learning · Statistics 2016-12-14 Bodo Rueckauer , Iulia-Alexandra Lungu , Yuhuang Hu , Michael Pfeiffer

Spiking Neural Networks (SNNs) have recently emerged as the low-power alternative to Artificial Neural Networks (ANNs) because of their sparse, asynchronous, and binary event-driven processing. Due to their energy efficiency, SNNs have a…

Computer Vision and Pattern Recognition · Computer Science 2021-10-18 Youngeun Kim , Joshua Chough , Priyadarshini Panda

Spiking neural networks (SNNs) are emerging as a promising alternative to traditional artificial neural networks (ANNs), offering biological plausibility and energy efficiency. Despite these merits, SNNs are frequently hampered by limited…

Computer Vision and Pattern Recognition · Computer Science 2025-10-10 Yi Xiao , Qiangqiang Yuan , Kui Jiang , Wenke Huang , Qiang Zhang , Tingting Zheng , Chia-Wen Lin , Liangpei Zhang

Spiking neural networks (SNNs) are bio-inspired neural networks with asynchronous discrete and sparse characteristics, which have increasingly manifested their superiority in low energy consumption. Recent research is devoted to utilizing…

Neural and Evolutionary Computing · Computer Science 2023-04-20 Lang Feng , Qianhui Liu , Huajin Tang , De Ma , Gang Pan

Spiking Neural Networks (SNNs) have recently attracted significant research interest as the third generation of artificial neural networks that can enable low-power event-driven data analytics. The best performing SNNs for image recognition…

Neural and Evolutionary Computing · Computer Science 2020-04-02 Bing Han , Gopalakrishnan Srinivasan , Kaushik Roy

As one of the energy-efficient alternatives of conventional neural networks (CNNs), spiking neural networks (SNNs) have gained more and more interest recently. To train the deep models, some effective batch normalization (BN) techniques are…

Computer Vision and Pattern Recognition · Computer Science 2023-08-17 Yufei Guo , Yuhan Zhang , Yuanpei Chen , Weihang Peng , Xiaode Liu , Liwen Zhang , Xuhui Huang , Zhe Ma

Machine learning with artificial neural networks (ANNs), provides solutions for the growing complexity of modern communication systems. This complexity, however, increases power consumption, making the systems energy-intensive. Spiking…

Signal Processing · Electrical Eng. & Systems 2026-01-26 Eike-Manuel Edelmann

Artificial neural networks (ANN) have become the mainstream acoustic modeling technique for large vocabulary automatic speech recognition (ASR). A conventional ANN features a multi-layer architecture that requires massive amounts of…

Neural and Evolutionary Computing · Computer Science 2019-11-20 Jibin Wu , Emre Yilmaz , Malu Zhang , Haizhou Li , Kay Chen Tan

Spiking Neural Networks (SNNs) emerged as a promising solution in the field of Artificial Neural Networks (ANNs), attracting the attention of researchers due to their ability to mimic the human brain and process complex information with…

Neural and Evolutionary Computing · Computer Science 2023-09-12 Pavithra Koralalage , Ireoluwa Fakeye , Pedro Machado , Jason Smith , Isibor Kennedy Ihianle , Salisu Wada Yahaya , Andreas Oikonomou , Ahmad Lotfi

In recent years, Spiking Neural Networks (SNNs) have demonstrated great successes in completing various Machine Learning tasks. We introduce a method for learning image features by \textit{locally connected layers} in SNNs using…

Neural and Evolutionary Computing · Computer Science 2019-04-15 Daniel J. Saunders , Devdhar Patel , Hananel Hazan , Hava T. Siegelmann , Robert Kozma

Spiking Neural Networks (SNNs) as one of the biology-inspired models have received much attention recently. It can significantly reduce energy consumption since they quantize the real-valued membrane potentials to 0/1 spikes to transmit…

Computer Vision and Pattern Recognition · Computer Science 2023-08-15 Yufei Guo , Xiaode Liu , Yuanpei Chen , Liwen Zhang , Weihang Peng , Yuhan Zhang , Xuhui Huang , Zhe Ma