中文
相关论文

相关论文: Hybrid Macro/Micro Level Backpropagation for Train…

200 篇论文

We propose a novel backpropagation algorithm for training spiking neural networks (SNNs) that encodes information in the relative multiple spike timing of individual neurons without single-spike restrictions. The proposed algorithm inherits…

神经与进化计算 · 计算机科学 2026-05-15 Kakei Yamamoto , Yusuke Sakemi , Kazuyuki Aihara

Spiking neural networks (SNNs) with leaky integrate and fire (LIF) neurons, can be operated in an event-driven manner and have internal states to retain information over time, providing opportunities for energy-efficient neuromorphic…

神经与进化计算 · 计算机科学 2021-09-07 Wachirawit Ponghiran , Kaushik Roy

Communication by rare, binary spikes is a key factor for the energy efficiency of biological brains. However, it is harder to train biologically-inspired spiking neural networks (SNNs) than artificial neural networks (ANNs). This is…

神经与进化计算 · 计算机科学 2023-11-21 Ana Stanojevic , Stanisław Woźniak , Guillaume Bellec , Giovanni Cherubini , Angeliki Pantazi , Wulfram Gerstner

Computation using brain-inspired spiking neural networks (SNNs) with neuromorphic hardware may offer orders of magnitude higher energy efficiency compared to the current analog neural networks (ANNs). Unfortunately, training SNNs with the…

神经与进化计算 · 计算机科学 2020-06-09 Eimantas Ledinauskas , Julius Ruseckas , Alfonsas Juršėnas , Giedrius Buračas

Spiking neural networks (SNNs) represent a promising approach in machine learning, combining the hierarchical learning capabilities of deep neural networks with the energy efficiency of spike-based computations. Traditional end-to-end…

神经与进化计算 · 计算机科学 2024-11-12 Ruyin Wan , Qian Zhang , George Em Karniadakis

We present a fully memristive spiking neural network (MSNN) consisting of novel memristive neurons trained using the backpropagation through time (BPTT) learning rule. Gradient descent is applied directly to the memristive…

神经与进化计算 · 计算机科学 2022-03-11 Peng Zhou , Jason K. Eshraghian , Dong-Uk Choi , Sung-Mo Kang

Spiking neural networks (SNNs) transmit information through discrete spikes, which performs well in processing spatial-temporal information. Due to the non-differentiable characteristic, there still exist difficulties in designing…

神经与进化计算 · 计算机科学 2021-05-28 Dongcheng Zhao , Yi Zeng , Yang Li

Nowadays deep learning is dominating the field of machine learning with state-of-the-art performance in various application areas. Recently, spiking neural networks (SNNs) have been attracting a great deal of attention, notably owning to…

机器学习 · 计算机科学 2019-02-28 Seongsik Park , Sang-gil Lee , Hyunha Nam , Sungroh Yoon

Spiking Neural Networks (SNNs) offer a biologically inspired computational paradigm that emulates neuronal activity through discrete spike-based processing. Despite their advantages, training SNNs with traditional backpropagation (BP)…

神经与进化计算 · 计算机科学 2025-05-28 Mohammadnavid Ghader , Saeed Reza Kheradpisheh , Bahar Farahani , Mahmood Fazlali

Spiking Neural Networks (SNNs) represent the latest generation of neural computation, offering a brain-inspired alternative to conventional Artificial Neural Networks (ANNs). Unlike ANNs, which depend on continuous-valued signals, SNNs…

神经与进化计算 · 计算机科学 2025-11-03 Sales G. Aribe

Spiking neural networks (SNNs) are brain-inspired models that enable energy-efficient implementation on neuromorphic hardware. However, the supervised training of SNNs remains a hard problem due to the discontinuity of the spiking neuron…

神经与进化计算 · 计算机科学 2021-12-20 Mingqing Xiao , Qingyan Meng , Zongpeng Zhang , Yisen Wang , Zhouchen Lin

Over the past decade, artificial neural networks (ANNs) have made tremendous advances, in part due to the increased availability of annotated data. However, ANNs typically require significant power and memory consumptions to reach their…

神经与进化计算 · 计算机科学 2023-02-16 Ye Yue , Marc Baltes , Nidal Abujahar , Tao Sun , Charles D. Smith , Trevor Bihl , Jundong Liu

Spiking neural networks combine analog computation with event-based communication using discrete spikes. While the impressive advances of deep learning are enabled by training non-spiking artificial neural networks using the backpropagation…

神经元与认知 · 定量生物学 2021-06-22 Timo C. Wunderlich , Christian Pehle

Brain-inspired spiking neural networks (SNNs) are recognized as a promising avenue for achieving efficient, low-energy neuromorphic computing. Direct training of SNNs typically relies on surrogate gradient (SG) learning to estimate…

神经与进化计算 · 计算机科学 2025-11-18 Jiaqiang Jiang , Wenfeng Xu , Jing Fan , Rui Yan

Event-based neuromorphic systems promise to reduce the energy consumption of deep learning tasks by replacing expensive floating point operations on dense matrices by low power sparse and asynchronous operations on spike events. While these…

神经与进化计算 · 计算机科学 2019-06-04 Johannes Christian Thiele , Olivier Bichler , Antoine Dupret

Spiking Neural Networks (SNNs) are promising for neuromorphic computing due to their biological plausibility and energy efficiency. However, training methods like Backpropagation Through Time (BPTT) and Real Time Recurrent Learning (RTRL)…

神经与进化计算 · 计算机科学 2025-09-09 Ismael Gomez , Guangzhi Tang

Recent advances in event-based neuromorphic systems have resulted in significant interest in the use and development of spiking neural networks (SNNs). However, the non-differentiable nature of spiking neurons makes SNNs incompatible with…

神经与进化计算 · 计算机科学 2020-07-10 Ali Lotfi Rezaabad , Sriram Vishwanath

Recent insights have revealed that rate-coding is a primary form of information representation captured by surrogate-gradient-based Backpropagation Through Time (BPTT) in training deep Spiking Neural Networks (SNNs). Motivated by these…

机器学习 · 计算机科学 2024-10-23 Chengting Yu , Lei Liu , Gaoang Wang , Erping Li , Aili Wang

In this work we propose a new supervised learning method for temporally-encoded multilayer spiking networks to perform classification. The method employs a reinforcement signal that mimics backpropagation but is far less computationally…

神经与进化计算 · 计算机科学 2020-07-28 Andrew Stephan , Brian Gardner , Steven J. Koester , Andre Gruning

Configuring deep Spiking Neural Networks (SNNs) is an exciting research avenue for low power spike event based computation. However, the spike generation function is non-differentiable and therefore not directly compatible with the standard…

神经与进化计算 · 计算机科学 2018-10-23 Sumit Bam Shrestha , Garrick Orchard