中文
相关论文

相关论文: Take A Shortcut Back: Mitigating the Gradient Vani…

200 篇论文

Recent insights have revealed that rate-coding is a primary form of information representation captured by surrogate-gradient-based Backpropagation Through Time (BPTT) in training deep Spiking Neural Networks (SNNs). Motivated by these…

机器学习 · 计算机科学 2024-10-23 Chengting Yu , Lei Liu , Gaoang Wang , Erping Li , Aili Wang

Spiking Neural Networks (SNNs) have gained significant traction in both computational neuroscience and artificial intelligence for their potential in energy-efficient computing. In contrast, artificial neural networks (ANNs) excel at…

神经与进化计算 · 计算机科学 2025-09-30 Nhan T. Luu , Duong T. Luu , Pham Ngoc Nam , Truong Cong Thang

Spiking neural networks (SNNs) have garnered a great amount of interest for supervised and unsupervised learning applications. This paper deals with the problem of training multi-layer feedforward SNNs. The non-linear integrate-and-fire…

神经与进化计算 · 计算机科学 2019-07-30 Navin Anwani , Bipin Rajendran

Spiking neural networks (SNN) are delivering energy-efficient, massively parallel, and low-latency solutions to AI problems, facilitated by the emerging neuromorphic chips. To harness these computational benefits, SNN need to be trained by…

神经与进化计算 · 计算机科学 2021-10-28 Guangzhi Tang , Neelesh Kumar , Ioannis Polykretis , Konstantinos P. Michmizos

Adaptive "life-long" learning at the edge and during online task performance is an aspirational goal of AI research. Neuromorphic hardware implementing Spiking Neural Networks (SNNs) are particularly attractive in this regard, as their…

神经与进化计算 · 计算机科学 2022-01-27 Kenneth Stewart , Emre Neftci

Brain-inspired spiking neural networks (SNNs) are recognized as a promising avenue for achieving efficient, low-energy neuromorphic computing. Recent advancements have focused on directly training high-performance SNNs by estimating the…

神经与进化计算 · 计算机科学 2025-05-20 Jiaqiang Jiang , Lei Wang , Runhao Jiang , Jing Fan , Rui Yan

Spiking Neural Networks (SNNs) are highly energy-efficient due to event-driven, sparse computation, but their training is challenged by spike non-differentiability and trade-offs among performance, efficiency, and biological plausibility.…

神经与进化计算 · 计算机科学 2026-01-30 Zihan Huang , Zijie Xu , Yihan Huang , Shanshan Jia , Tong Bu , Yiting Dong , Wenxuan Liu , Jianhao Ding , Zhaofei Yu , Tiejun Huang

Spiking neural networks (SNNs) are different from the classical networks used in deep learning: the neurons communicate using electrical impulses called spikes, just like biological neurons. SNNs are appealing for AI technology, because…

神经与进化计算 · 计算机科学 2022-01-10 Nandan Meda

Spiking neural networks (SNNs) are promising in a bio-plausible coding for spatio-temporal information and event-driven signal processing, which is very suited for energy-efficient implementation in neuromorphic hardware. However, the…

神经与进化计算 · 计算机科学 2020-12-21 Hanle Zheng , Yujie Wu , Lei Deng , Yifan Hu , Guoqi Li

Communication by rare, binary spikes is a key factor for the energy efficiency of biological brains. However, it is harder to train biologically-inspired spiking neural networks (SNNs) than artificial neural networks (ANNs). This is…

神经与进化计算 · 计算机科学 2023-11-21 Ana Stanojevic , Stanisław Woźniak , Guillaume Bellec , Giovanni Cherubini , Angeliki Pantazi , Wulfram Gerstner

The integration of Spiking Neural Networks (SNNs) and Graph Neural Networks (GNNs) is gradually attracting attention due to the low power consumption and high efficiency in processing the non-Euclidean data represented by graphs. However,…

神经与进化计算 · 计算机科学 2025-07-15 Nan Yin , Mengzhu Wang , Zhenghan Chen , Giulia De Masi , Bin Gu , Huan Xiong

Despite the rapid progress of neuromorphic computing, inadequate capacity and insufficient representation power of spiking neural networks (SNNs) severely restrict their application scope in practice. Residual learning and shortcuts have…

神经与进化计算 · 计算机科学 2023-03-13 Yifan Hu , Lei Deng , Yujie Wu , Man Yao , Guoqi Li

Spiking neural networks (SNNs) transmit information through discrete spikes, which performs well in processing spatial-temporal information. Due to the non-differentiable characteristic, there still exist difficulties in designing…

神经与进化计算 · 计算机科学 2021-05-28 Dongcheng Zhao , Yi Zeng , Yang Li

Spiking and Quantized Neural Networks (NNs) are becoming exceedingly important for hyper-efficient implementations of Deep Learning (DL) algorithms. However, these networks face challenges when trained using error backpropagation, due to…

机器学习 · 计算机科学 2022-02-16 Jason K. Eshraghian , Corey Lammie , Mostafa Rahimi Azghadi , Wei D. Lu

Spiking neural networks (SNNs) are promising brain-inspired energy-efficient models. Recent progress in training methods has enabled successful deep SNNs on large-scale tasks with low latency. Particularly, backpropagation through time…

神经与进化计算 · 计算机科学 2023-01-03 Mingqing Xiao , Qingyan Meng , Zongpeng Zhang , Di He , Zhouchen Lin

Recent advances in Voice Activity Detection (VAD) are driven by artificial and Recurrent Neural Networks (RNNs), however, using a VAD system in battery-operated devices requires further power efficiency. This can be achieved by neuromorphic…

音频与语音处理 · 电气工程与系统科学 2020-05-01 Flavio Martinelli , Giorgia Dellaferrera , Pablo Mainar , Milos Cernak

Spiking neural networks (SNNs) with event-based computation are promising brain-inspired models for energy-efficient applications on neuromorphic hardware. However, most supervised SNN training methods, such as conversion from artificial…

神经与进化计算 · 计算机科学 2023-02-02 Mingqing Xiao , Qingyan Meng , Zongpeng Zhang , Yisen Wang , Zhouchen Lin

Spiking Neural Networks (SNNs) have attracted great attention for their energy-efficient operations and biologically inspired structures, offering potential advantages over Artificial Neural Networks (ANNs) in terms of energy efficiency and…

神经与进化计算 · 计算机科学 2024-06-03 Yujia Liu , Tong Bu , Jianhao Ding , Zecheng Hao , Tiejun Huang , Zhaofei Yu

Machine learning with artificial neural networks (ANNs), provides solutions for the growing complexity of modern communication systems. This complexity, however, increases power consumption, making the systems energy-intensive. Spiking…

信号处理 · 电气工程与系统科学 2026-01-26 Eike-Manuel Edelmann

Spiking neural networks (SNN) are usually more energy-efficient as compared to Artificial neural networks (ANN), and the way they work has a great similarity with our brain. Back-propagation (BP) has shown its strong power in training ANN…

神经与进化计算 · 计算机科学 2020-11-20 Yukun Yang