English
Related papers

Related papers: Towards Accurate Binary Spiking Neural Networks: L…

200 papers

Recently, backpropagation through time inspired learning algorithms are widely introduced into SNNs to improve the performance, which brings the possibility to attack the models accurately given Spatio-temporal gradient maps. We propose two…

Neural and Evolutionary Computing · Computer Science 2020-10-02 Ling Liang , Xing Hu , Lei Deng , Yujie Wu , Guoqi Li , Yufei Ding , Peng Li , Yuan Xie

Spiking Neural Networks (SNNs) have emerged as a promising third generation of neural networks, offering unique characteristics such as binary outputs, high sparsity, and biological plausibility. However, the lack of effective learning…

Neural and Evolutionary Computing · Computer Science 2024-03-01 Liuzhenghao Lv , Wei Fang , Li Yuan , Yonghong Tian

Binary Neural Networks (BNNs) are an extremely promising method to reduce deep neural networks' complexity and power consumption massively. Binarization techniques, however, suffer from ineligible performance degradation compared to their…

Machine Learning · Computer Science 2022-04-06 Tal Rozen , Moshe Kimhi , Brian Chmiel , Avi Mendelson , Chaim Baskin

Spiking Neural Networks (SNNs) have emerged as an attractive spatio-temporal computing paradigm for complex vision tasks. However, most existing works yield models that require many time steps and do not leverage the inherent temporal…

Neural and Evolutionary Computing · Computer Science 2022-10-25 Gourav Datta , Haoqin Deng , Robert Aviles , Peter A. Beerel

Neural networks have become the key technology of artificial intelligence and have contributed to breakthroughs in several machine learning tasks, primarily owing to advances in deep learning applied to Artificial Neural Networks (ANNs).…

Neural and Evolutionary Computing · Computer Science 2021-03-18 Stanisław Woźniak , Angeliki Pantazi , Thomas Bohnstingl , Evangelos Eleftheriou

Spiking Neural Networks (SNNs) may offer an energy-efficient alternative for implementing deep learning applications. In recent years, there have been several proposals focused on supervised (conversion, spike-based gradient descent) and…

Computer Vision and Pattern Recognition · Computer Science 2019-10-31 Priyadarshini Panda , Aparna Aketi , Kaushik Roy

Binary neural networks (BNNs) that use 1-bit weights and activations have garnered interest as extreme quantization provides low power dissipation. By implementing BNNs as computing-in-memory (CIM), which computes multiplication and…

Machine Learning · Computer Science 2021-10-20 Minh-Son Le , Thi-Nhan Pham , Thanh-Dat Nguyen , Ik-Joon Chang

Spiking Neural Network (SNN) has been recognized as one of the next generation of neural networks. Conventionally, SNN can be converted from a pre-trained ANN by only replacing the ReLU activation to spike activation while keeping the…

Machine Learning · Computer Science 2021-06-15 Yuhang Li , Shikuang Deng , Xin Dong , Ruihao Gong , Shi Gu

The Spiking Neural Network (SNN) is a biologically inspired neural network infrastructure that has recently garnered significant attention. It utilizes binary spike activations to transmit information, thereby replacing multiplications with…

Computer Vision and Pattern Recognition · Computer Science 2024-10-01 Yufei Guo , Yuanpei Chen , Zecheng Hao , Weihang Peng , Zhou Jie , Yuhan Zhang , Xiaode Liu , Zhe Ma

Inspired by the human brain's ability to adapt to new tasks without erasing prior knowledge, we develop spiking neural networks (SNNs) with dynamic structures for Class Incremental Learning (CIL). Our comparative experiments reveal that…

Computer Vision and Pattern Recognition · Computer Science 2024-12-18 Wenyao Ni , Jiangrong Shen , Qi Xu , Huajin Tang

Spiking neural networks (SNNs), known for their low-power, event-driven computation and intrinsic temporal dynamics, are emerging as promising solutions for processing dynamic, asynchronous signals from event-based sensors. Despite their…

Computer Vision and Pattern Recognition · Computer Science 2024-08-05 Rui Zhang , Luziwei Leng , Kaiwei Che , Hu Zhang , Jie Cheng , Qinghai Guo , Jiangxing Liao , Ran Cheng

Computation using brain-inspired spiking neural networks (SNNs) with neuromorphic hardware may offer orders of magnitude higher energy efficiency compared to the current analog neural networks (ANNs). Unfortunately, training SNNs with the…

Neural and Evolutionary Computing · Computer Science 2020-06-09 Eimantas Ledinauskas , Julius Ruseckas , Alfonsas Juršėnas , Giedrius Buračas

Intracortical brain-machine interfaces demand low-latency, energy-efficient solutions for neural decoding. Spiking Neural Networks (SNNs) deployed on neuromorphic hardware have demonstrated remarkable efficiency in neural decoding by…

Neural and Evolutionary Computing · Computer Science 2025-04-17 Francesca Rivelli , Martin Popov , Charalampos S. Kouzinopoulos , Guangzhi Tang

In this work, we study the binary neural networks (BNNs) of which both the weights and activations are binary (i.e., 1-bit representation). Feature representation is critical for deep neural networks, while in BNNs, the features only differ…

Computer Vision and Pattern Recognition · Computer Science 2022-03-01 Ping Xue , Yang Lu , Jingfei Chang , Xing Wei , Zhen Wei

We introduce a method to convert Physics-Informed Neural Networks (PINNs), commonly used in scientific machine learning, to Spiking Neural Networks (SNNs), which are expected to have higher energy efficiency compared to traditional…

Neural and Evolutionary Computing · Computer Science 2023-09-01 Qian Zhang , Chenxi Wu , Adar Kahana , Youngeun Kim , Yuhang Li , George Em Karniadakis , Priyadarshini Panda

Event cameras, with their high dynamic range and temporal resolution, are ideally suited for object detection, especially under scenarios with motion blur and challenging lighting conditions. However, while most existing approaches…

Computer Vision and Pattern Recognition · Computer Science 2024-08-27 Ziming Wang , Ziling Wang , Huaning Li , Lang Qin , Runhao Jiang , De Ma , Huajin Tang

Early diagnosis of Alzheimer's Disease (AD), particularly at the mild cognitive impairment stage, is essential for timely intervention. However, this process faces significant barriers, including reliance on subjective assessments and the…

Computer Vision and Pattern Recognition · Computer Science 2025-12-19 Changwei Wu , Yifei Chen , Yuxin Du , Jinying Zong , Jie Dong , Mingxuan Liu , Feiwei Qin , Yong Peng , Jin Fan , Changmiao Wang

We propose a Bayesian framework for training binary and spiking neural networks that achieves state-of-the-art performance without normalisation layers. Unlike commonly used surrogate gradient methods -- often heuristic and sensitive to…

Machine Learning · Computer Science 2025-05-26 James A. Walker , Moein Khajehnejad , Adeel Razi

In this work, we propose stochastic Binary Spiking Neural Network (sBSNN) composed of stochastic spiking neurons and binary synapses (stochastic only during training) that computes probabilistically with one-bit precision for…

Emerging Technologies · Computer Science 2020-02-27 Minsuk Koo , Gopalakrishnan Srinivasan , Yong Shim , Kaushik Roy

Bio-inspired Spiking Neural Networks (SNN) are now demonstrating comparable accuracy to intricate convolutional neural networks (CNN), all while delivering remarkable energy and latency efficiency when deployed on neuromorphic hardware. In…

Computer Vision and Pattern Recognition · Computer Science 2023-12-13 Gourav Datta , Zeyu Liu , James Diffenderfer , Bhavya Kailkhura , Peter A. Beerel