English
Related papers

Related papers: Direct Training Needs Regularisation: Anytime Opti…

200 papers

Spiking neural networks (SNNs), inspired by the spiking behavior of biological neurons, provide a unique pathway for capturing the intricacies of temporal data. However, applying SNNs to time-series forecasting is challenging due to…

Neural and Evolutionary Computing · Computer Science 2024-05-30 Changze Lv , Yansen Wang , Dongqi Han , Xiaoqing Zheng , Xuanjing Huang , Dongsheng Li

Deep 'Analog Artificial Neural Networks' (ANNs) perform complex classification problems with remarkably high accuracy. However, they rely on humongous amount of power to perform the calculations, veiling the accuracy benefits. The…

Emerging Technologies · Computer Science 2018-04-17 Parami Wijesinghe , Aayush Ankit , Abhronil Sengupta , Kaushik Roy

Spiking neural networks (SNNs) that mimic information transmission in the brain can energy-efficiently process spatio-temporal information through discrete and sparse spikes, thereby receiving considerable attention. To improve accuracy and…

Neural and Evolutionary Computing · Computer Science 2022-06-14 Byunggook Na , Jisoo Mok , Seongsik Park , Dongjin Lee , Hyeokjun Choe , Sungroh Yoon

The backpropagation algorithm has promoted the rapid development of deep learning, but it relies on a large amount of labeled data and still has a large gap with how humans learn. The human brain can quickly learn various conceptual…

Neural and Evolutionary Computing · Computer Science 2023-04-25 Yiting Dong , Dongcheng Zhao , Yang Li , Yi Zeng

Brain-inspired Spiking Neural Networks (SNNs) have attracted attention for their event-driven characteristics and high energy efficiency. However, the temporal dependency and irregularity of spikes present significant challenges for…

Hardware Architecture · Computer Science 2025-06-11 Kainan Wang , Chengyi Yang , Chengting Yu , Yee Sin Ang , Bo Wang , Aili Wang

Spiking Neural Networks (SNNs) have received extensive academic attention due to the unique properties of low power consumption and high-speed computing on neuromorphic chips. Among various training methods of SNNs, ANN-SNN conversion has…

Neural and Evolutionary Computing · Computer Science 2023-02-07 Zecheng Hao , Tong Bu , Jianhao Ding , Tiejun Huang , Zhaofei Yu

Gradient descent training techniques are remarkably successful in training analog-valued artificial neural networks (ANNs). Such training techniques, however, do not transfer easily to spiking networks due to the spike generation hard…

Neural and Evolutionary Computing · Computer Science 2017-08-17 Hesham Mostafa

Brain-inspired Spiking Neural Networks (SNNs) have bio-plausibility and low-power advantages over Artificial Neural Networks (ANNs). Applications of SNNs are currently limited to simple classification tasks because of their poor…

Artificial Intelligence · Computer Science 2025-04-16 Xinhao Luo , Man Yao , Yuhong Chou , Bo Xu , Guoqi Li

Spiking Neural Networks (SNNs) as Machine Learning (ML) models have recently received a lot of attention as a potentially more energy-efficient alternative to conventional Artificial Neural Networks. The non-differentiability and sparsity…

Machine Learning · Computer Science 2025-12-05 Maximilian Gollwitzer , Felix Dietrich

The machine learning community has become increasingly interested in the energy efficiency of neural networks. The Spiking Neural Network (SNN) is a promising approach to energy-efficient computing, since its activation levels are quantized…

Machine Learning · Computer Science 2021-03-03 Aaron R. Voelker , Daniel Rasmussen , Chris Eliasmith

In the reinforcement learning (RL) tasks, the ability to predict receiving reward in the near or more distant future means the ability to evaluate the current state as more or less close to the target state (labelled by the reward signal).…

Neural and Evolutionary Computing · Computer Science 2023-11-10 Mikhail Kiselev

Spiking Neural Networks (SNNs) have garnered attention over recent years due to their increased energy efficiency and advantages in terms of operational complexity compared to traditional Artificial Neural Networks (ANNs). Two important…

Neural and Evolutionary Computing · Computer Science 2025-01-15 Daniel Windhager , Lothar Ratschbacher , Bernhard A. Moser , Michael Lunglmayr

Spiking neural networks are a promising approach towards next-generation models of the brain in computational neuroscience. Moreover, compared to classic artificial neural networks, they could serve as an energy-efficient deployment of AI…

Neural and Evolutionary Computing · Computer Science 2021-09-24 Justus F. Hübotter , Pablo Lanillos , Jakub M. Tomczak

Hardware-based spiking neural networks (SNNs) are regarded as promising candidates for the cognitive computing system due to low power consumption and highly parallel operation. In this work, we train the SNN in which the firing time…

Neural and Evolutionary Computing · Computer Science 2022-03-17 Seongbin Oh , Dongseok Kwon , Gyuho Yeom , Won-Mook Kang , Soochang Lee , Sung Yun Woo , Jang Saeng Kim , Min Kyu Park , Jong-Ho Lee

Spiking Neural Networks (SNNs) are biologically-inspired models that are capable of processing information in streams of action potentials. However, simulating and training SNNs is computationally expensive due to the need to solve large…

Neurons and Cognition · Quantitative Biology 2023-12-29 Rainer Engelken

Brain-inspired spiking neural networks (SNNs) are recognized as a promising avenue for achieving efficient, low-energy neuromorphic computing. Direct training of SNNs typically relies on surrogate gradient (SG) learning to estimate…

Neural and Evolutionary Computing · Computer Science 2025-11-18 Jiaqiang Jiang , Wenfeng Xu , Jing Fan , Rui Yan

Autonomous mobile agents require low-power/energy-efficient machine learning (ML) algorithms to complete their ML-based tasks while adapting to diverse environments, as mobile agents are usually powered by batteries. These requirements can…

Neural and Evolutionary Computing · Computer Science 2024-04-08 Rachmad Vidya Wicaksana Putra , Muhammad Shafique

Spiking neural networks are efficient computation models for low-power environments. Spike-based BP algorithms and ANN-to-SNN (ANN2SNN) conversions are successful techniques for SNN training. Nevertheless, the spike-base BP training is slow…

Neural and Evolutionary Computing · Computer Science 2023-08-31 Jianxiong Tang , Jianhuang Lai , Xiaohua Xie , Lingxiao Yang , Wei-Shi Zheng

Spiking neural networks (SNNs) process time-series data via internal event-driven neural dynamics. The energy consumption of an SNN depends on the number of spikes exchanged between neurons over the course of the input presentation.…

Neural and Evolutionary Computing · Computer Science 2024-07-02 Jiechen Chen , Sangwoo Park , Osvaldo Simeone

Deep spiking neural networks (SNNs) hold great potential for improving the latency and energy efficiency of deep neural networks through event-based computation. However, training such networks is difficult due to the non-differentiable…

Neural and Evolutionary Computing · Computer Science 2016-09-01 Jun Haeng Lee , Tobi Delbruck , Michael Pfeiffer