English
Related papers

Related papers: BiSNN: Training Spiking Neural Networks with Binar…

200 papers

Spiking Neural Networks (SNNs) are a promising approach to low-power applications on neuromorphic hardware due to their energy efficiency. However, training SNNs is challenging because of the non-differentiable spike generation function. To…

Neural and Evolutionary Computing · Computer Science 2025-08-19 Qingyan Meng , Mingqing Xiao , Zhengyu Ma , Huihui Zhou , Yonghong Tian , Zhouchen Lin

We propose a Bayesian framework for training binary and spiking neural networks that achieves state-of-the-art performance without normalisation layers. Unlike commonly used surrogate gradient methods -- often heuristic and sensitive to…

Machine Learning · Computer Science 2025-05-26 James A. Walker , Moein Khajehnejad , Adeel Razi

The spiking neural network (SNN) computes and communicates information through discrete binary events. It is considered more biologically plausible and more energy-efficient than artificial neural networks (ANN) in emerging neuromorphic…

Neural and Evolutionary Computing · Computer Science 2021-05-28 Yang Li , Yi Zeng , Dongcheng Zhao

With the continued innovations of deep neural networks, spiking neural networks (SNNs) that more closely resemble biological brain synapses have attracted attention owing to their low power consumption.However, for continuous data values,…

Neural and Evolutionary Computing · Computer Science 2021-03-02 Naoya Muramatsu , Hai-Tao Yu

Recent advances in Voice Activity Detection (VAD) are driven by artificial and Recurrent Neural Networks (RNNs), however, using a VAD system in battery-operated devices requires further power efficiency. This can be achieved by neuromorphic…

Audio and Speech Processing · Electrical Eng. & Systems 2020-05-01 Flavio Martinelli , Giorgia Dellaferrera , Pablo Mainar , Milos Cernak

The proliferation of Artificial Neural Networks (ANNs) has led to increased energy consumption, raising concerns about their sustainability. Spiking Neural Networks (SNNs), which are inspired by biological neural systems and operate using…

Neural and Evolutionary Computing · Computer Science 2024-09-25 Lucas Deckers , Benjamin Vandersmissen , Ing Jyh Tsang , Werner Van Leekwijck , Steven Latré

Spiking Neural Networks (SNNs) have been widely praised for their high energy efficiency and immense potential. However, comprehensive research that critically contrasts and correlates SNNs with quantized Artificial Neural Networks (ANNs)…

Neural and Evolutionary Computing · Computer Science 2023-11-21 Guobin Shen , Dongcheng Zhao , Tenglong Li , Jindong Li , Yi Zeng

Spiking neural networks (SNNs) are energy-efficient neural networks because of their spiking nature. However, as the spike firing rate of SNNs increases, the energy consumption does as well, and thus, the advantage of SNNs diminishes. Here,…

Machine Learning · Computer Science 2024-01-15 Kazuma Suetake , Takuya Ushimaru , Ryuji Saiin , Yoshihide Sawada

Spiking neural networks (SNNs) are gaining increasing attention as potential computationally efficient alternatives to traditional artificial neural networks(ANNs). However, the unique information propagation mechanisms and the complexity…

Neural and Evolutionary Computing · Computer Science 2024-06-19 Shuaijie Shen , Rui Zhang , Chao Wang , Renzhuo Huang , Aiersi Tuerhong , Qinghai Guo , Zhichao Lu , Jianguo Zhang , Luziwei Leng

Spiking Neural Networks (SNNs) offer a more energy-efficient alternative to Artificial Neural Networks (ANNs) by mimicking biological neural principles, establishing them as a promising approach to mitigate the increasing energy demands of…

Machine Learning · Computer Science 2025-02-24 Velibor Bojković , Xiaofeng Wu , Bin Gu

Spiking Neural Networks (SNNs) are one of the most promising bio-inspired neural networks models and have drawn increasing attention in recent years. The event-driven communication mechanism of SNNs allows for sparse and theoretically…

Neural and Evolutionary Computing · Computer Science 2025-10-29 Andrea Castagnetti , Alain Pegatoquet , Benoît Miramond

Spiking Neural Networks (SNNs) promise higher energy efficiency over conventional Quantized Artificial Neural Networks (QNNs) due to their event-driven, spike-based computation. However, prevailing energy evaluations often oversimplify,…

Neural and Evolutionary Computing · Computer Science 2026-05-13 Zhanglu Yan , Zhenyu Bai , Weng-Fai Wong

We introduce a method to train Binarized Neural Networks (BNNs) - neural networks with binary weights and activations at run-time. At training-time the binary weights and activations are used for computing the parameters gradients. During…

Machine Learning · Computer Science 2016-03-18 Matthieu Courbariaux , Itay Hubara , Daniel Soudry , Ran El-Yaniv , Yoshua Bengio

We recently proposed the S4NN algorithm, essentially an adaptation of backpropagation to multilayer spiking neural networks that use simple non-leaky integrate-and-fire neurons and a form of temporal coding known as time-to-first-spike…

Neural and Evolutionary Computing · Computer Science 2021-12-30 Saeed Reza Kheradpisheh , Maryam Mirsadeghi , Timothée Masquelier

The machine learning community has become increasingly interested in the energy efficiency of neural networks. The Spiking Neural Network (SNN) is a promising approach to energy-efficient computing, since its activation levels are quantized…

Machine Learning · Computer Science 2021-03-03 Aaron R. Voelker , Daniel Rasmussen , Chris Eliasmith

Artificial neural networks (ANNs) have demonstrated outstanding performance in numerous tasks, but deployment in resource-constrained environments remains a challenge due to their high computational and memory requirements. Spiking neural…

Machine Learning · Computer Science 2025-06-04 Chang Liu , Jiangrong Shen , Xuming Ran , Mingkun Xu , Qi Xu , Yi Xu , Gang Pan

We introduce a method to convert Physics-Informed Neural Networks (PINNs), commonly used in scientific machine learning, to Spiking Neural Networks (SNNs), which are expected to have higher energy efficiency compared to traditional…

Neural and Evolutionary Computing · Computer Science 2023-09-01 Qian Zhang , Chenxi Wu , Adar Kahana , Youngeun Kim , Yuhang Li , George Em Karniadakis , Priyadarshini Panda

We present a general framework for training spiking neural networks (SNNs) to perform binary classification on multivariate time series, with a focus on step-wise prediction and high precision at low false alarm rates. The approach uses the…

Machine Learning · Computer Science 2025-11-24 James Ghawaly , Andrew Nicholson , Catherine Schuman , Dalton Diez , Aaron Young , Brett Witherspoon

In this work, we propose stochastic Binary Spiking Neural Network (sBSNN) composed of stochastic spiking neurons and binary synapses (stochastic only during training) that computes probabilistically with one-bit precision for…

Emerging Technologies · Computer Science 2020-02-27 Minsuk Koo , Gopalakrishnan Srinivasan , Yong Shim , Kaushik Roy

Inspired by more detailed modeling of biological neurons, Spiking neural networks (SNNs) have been investigated both as more biologically plausible and potentially more powerful models of neural computation, and also with the aim of…

Neural and Evolutionary Computing · Computer Science 2021-03-24 Bojian Yin , Federico Corradi , Sander M. Bohte