English
Related papers

Related papers: Twin Network Augmentation: A Novel Training Strate…

200 papers

Biological neurons communicate with a sparing exchange of pulses - spikes. It is an open question how real spiking neurons produce the kind of powerful neural computation that is possible with deep artificial neural networks, using only so…

Neural and Evolutionary Computing · Computer Science 2016-09-08 Davide Zambrano , Sander M. Bohte

Spiking Neural Networks (SNNs) offer a promising and energy-efficient alternative to conventional neural networks, thanks to their sparse binary activation. However, they face challenges regarding memory and computation overhead due to…

Neural and Evolutionary Computing · Computer Science 2026-01-06 Donghyun Lee , Abhishek Moitra , Youngeun Kim , Ruokai Yin , Priyadarshini Panda

Spiking neural networks (SNNs) have demonstrated excellent capabilities in various intelligent scenarios. Most existing methods for training SNNs are based on the concept of synaptic plasticity; however, learning in the realistic brain also…

Neural and Evolutionary Computing · Computer Science 2023-04-04 Hongze Sun , Wuque Cai , Baoxin Yang , Yan Cui , Yang Xia , Dezhong Yao , Daqing Guo

In the low-bit quantization field, training Binary Neural Networks (BNNs) is the extreme solution to ease the deployment of deep models on resource-constrained devices, having the lowest storage cost and significantly cheaper bit-wise…

Computer Vision and Pattern Recognition · Computer Science 2021-10-19 Yikai Wang , Yi Yang , Fuchun Sun , Anbang Yao

Spiking Neural Networks (SNNs) have been attached great importance due to the distinctive properties of low power consumption, biological plausibility, and adversarial robustness. The most effective way to train deep SNNs is through…

Neural and Evolutionary Computing · Computer Science 2022-02-04 Tong Bu , Jianhao Ding , Zhaofei Yu , Tiejun Huang

Spiking neural networks (SNNs) are distributed trainable systems whose computing elements, or neurons, are characterized by internal analog dynamics and by digital and sparse synaptic communications. The sparsity of the synaptic spiking…

Machine Learning · Computer Science 2020-01-08 Hyeryung Jang , Osvaldo Simeone , Brian Gardner , André Grüning

Efficient communication is central to both biological and artificial intelligence (AI) systems. In biological brains, the challenge of long-range communication across regions is addressed through sparse, spike-based signaling, minimizing…

Hardware Architecture · Computer Science 2025-04-15 Joshua Nardone , Ruijie Zhu , Joseph Callenes , Mohammed E. Elbtity , Ramtin Zand , Jason Eshraghian

Deep convolutional neural networks (CNNs) have shown great potential for numerous real-world machine learning applications, but performing inference in large CNNs in real-time remains a challenge. We have previously demonstrated that…

Machine Learning · Statistics 2016-12-14 Bodo Rueckauer , Iulia-Alexandra Lungu , Yuhuang Hu , Michael Pfeiffer

Compared to traditional Artificial Neural Network (ANN), Spiking Neural Network (SNN) has garnered widespread academic interest for its intrinsic ability to transmit information in a more energy-efficient manner. However, despite previous…

Neural and Evolutionary Computing · Computer Science 2024-10-10 Zecheng Hao , Xinyu Shi , Yujia Liu , Zhaofei Yu , Tiejun Huang

Spiking neural networks (SNNs) provide an energy-efficient alternative to a variety of artificial neural network (ANN) based AI applications. As the progress in neuromorphic computing with SNNs expands their use in applications, the problem…

Neural and Evolutionary Computing · Computer Science 2024-04-15 Ozan Özdenizci , Robert Legenstein

We propose a new learning algorithm to train spiking neural networks (SNN) using conventional artificial neural networks (ANN) as proxy. We couple two SNN and ANN networks, respectively, made of integrate-and-fire (IF) and ReLU neurons with…

Neural and Evolutionary Computing · Computer Science 2022-08-02 Saeed Reza Kheradpisheh , Maryam Mirsadeghi , Timothée Masquelier

Spiking neural networks (SNN) are artificial computational models that have been inspired by the brain's ability to naturally encode and process information in the time domain. The added temporal dimension is believed to render them more…

Emerging Technologies · Computer Science 2019-05-29 S. R. Nandakumar , Irem Boybat , Manuel Le Gallo , Evangelos Eleftheriou , Abu Sebastian , Bipin Rajendran

The computation and storage requirements for Deep Neural Networks (DNNs) are usually high. This issue limits their deployability on ubiquitous computing devices such as smart phones, wearables and autonomous drones. In this paper, we…

Machine Learning · Computer Science 2017-02-28 Hande Alemdar , Vincent Leroy , Adrien Prost-Boucle , Frédéric Pétrot

Despite advances in artificial intelligence models, neural networks still cannot achieve human performance, partly due to differences in how information is encoded and processed compared to human brain. Information in an artificial neural…

Neural and Evolutionary Computing · Computer Science 2021-11-18 Yinqian Sun , Yi Zeng , Tielin Zhang

Spiking neural networks (SNNs) are a viable alternative to conventional artificial neural networks when resource efficiency and computational complexity are of importance. A major advantage of SNNs is their binary information transfer…

Neural and Evolutionary Computing · Computer Science 2023-10-18 Daniel Gerlinghoff , Tao Luo , Rick Siow Mong Goh , Weng-Fai Wong

Brain-inspired spiking neural networks (SNNs) promise to be a low-power alternative to computationally intensive artificial neural networks (ANNs), although performance gaps persist. Recent studies have improved the performance of SNNs…

Machine Learning · Computer Science 2025-10-10 Yongqi Ding , Lin Zuo , Mengmeng Jing , Kunshan Yang , Pei He , Tonglan Xie

Spiking neural networks (SNNs) promise ultra-low-power applications by exploiting temporal and spatial sparsity. The number of binary activations, called spikes, is proportional to the power consumed when executed on neuromorphic hardware.…

Computer Vision and Pattern Recognition · Computer Science 2024-06-25 Gregor Lenz , Garrick Orchard , Sadique Sheik

Spiking Neural Networks (SNNs) have gained attention for their energy-efficient machine learning capabilities, utilizing bio-inspired activation functions and sparse binary spike-data representations. While recent SNN algorithmic advances…

Neural and Evolutionary Computing · Computer Science 2023-09-08 Abhiroop Bhattacharjee , Ruokai Yin , Abhishek Moitra , Priyadarshini Panda

This survey paper presents a comprehensive examination of Spiking Neural Network (SNN) architecture search (SNNaS) from a unique hardware/software co-design perspective. SNNs, inspired by biological neurons, have emerged as a promising…

Neural and Evolutionary Computing · Computer Science 2026-04-06 Kama Svoboda , Tosiron Adegbija

Spiking neural networks (SNNs) that enables energy efficient implementation on emerging neuromorphic hardware are gaining more attention. Yet now, SNNs have not shown competitive performance compared with artificial neural networks (ANNs),…

Neural and Evolutionary Computing · Computer Science 2018-11-26 Yujie Wu , Lei Deng , Guoqi Li , Jun Zhu , Luping Shi