中文
相关论文

相关论文: Energy Efficient Training of SNN using Local Zerot…

200 篇论文

Recently, we proposed to transform the outputs of each hidden neuron in a multi-layer perceptron network to have zero output and zero slope on average, and use separate shortcut connections to model the linear dependencies instead. We…

机器学习 · 计算机科学 2013-03-12 Tommi Vatanen , Tapani Raiko , Harri Valpola , Yann LeCun

Spiking Neural Networks (SNNs) are distributed trainable systems whose computing elements, or neurons, are characterized by internal analog dynamics and by digital and sparse synaptic communications. The sparsity of the synaptic spiking…

信号处理 · 电气工程与系统科学 2019-10-22 Hyeryung Jang , Osvaldo Simeone , Brian Gardner , André Grüning

Spiking neural networks (SNNs) promise orders-of-magnitude efficiency gains by communicating with sparse, event-driven spikes rather than dense numerical activations. However, most training pipelines either rely on surrogate-gradient…

神经与进化计算 · 计算机科学 2025-12-17 Arman Ferdowsi , Atakan Aral

Spiking neural networks (SNNs), which mimic biological neural system to convey information via discrete spikes, are well known as brain-inspired models with excellent computing efficiency. By utilizing the surrogate gradient estimation for…

神经与进化计算 · 计算机科学 2024-08-21 Zekai Xu , Kang You , Qinghai Guo , Xiang Wang , Zhezhi He

Spiking neural networks (SNNs) well support spatiotemporal learning and energy-efficient event-driven hardware neuromorphic processors. As an important class of SNNs, recurrent spiking neural networks (RSNNs) possess great computational…

神经与进化计算 · 计算机科学 2020-02-25 Wenrui Zhang , Peng Li

Spiking neural networks (SNNs) are well suited for resource-constrained applications as they do not need expensive multipliers. In a typical rate-encoded SNN, a series of binary spikes within a globally fixed time window is used to fire the…

神经与进化计算 · 计算机科学 2022-11-16 Zhanglu Yan , Jun Zhou , Weng-Fai Wong

Spiking neural networks (SNNs) can be used in low-power and embedded systems (such as emerging neuromorphic chips) due to their event-based nature. Also, they have the advantage of low computation cost in contrast to conventional artificial…

计算机视觉与模式识别 · 计算机科学 2021-01-20 Ali Samadzadeh , Fatemeh Sadat Tabatabaei Far , Ali Javadi , Ahmad Nickabadi , Morteza Haghir Chehreghani

Spiking neural networks (SNNs) are well suited for spatio-temporal learning and implementations on energy-efficient event-driven neuromorphic processors. However, existing SNN error backpropagation (BP) methods lack proper handling of…

神经与进化计算 · 计算机科学 2021-06-08 Wenrui Zhang , Peng Li

The human brain can self-organize rich and diverse sparse neural pathways to incrementally master hundreds of cognitive tasks. However, most existing continual learning algorithms for deep artificial and spiking neural networks are unable…

神经与进化计算 · 计算机科学 2026-05-06 Bing Han , Feifei Zhao , Wenxuan Pan , Zhuoya Zhao , Xianqi Li , Qingqun Kong , Yi Zeng

Drawing on the intricate structures of the brain, Spiking Neural Networks (SNNs) emerge as a transformative development in artificial intelligence, closely emulating the complex dynamics of biological neural networks. While SNNs show…

人工智能 · 计算机科学 2024-08-02 Yanchen Li , Jiachun Li , Kebin Sun , Luziwei Leng , Ran Cheng

We propose a new supervised learning rule for multilayer spiking neural networks (SNNs) that use a form of temporal coding known as rank-order-coding. With this coding scheme, all neurons fire exactly one spike per stimulus, but the firing…

神经与进化计算 · 计算机科学 2020-06-16 Saeed Reza Kheradpisheh , Timothée Masquelier

Brain-inspired spiking neural networks (SNNs) have gained prominence in the field of neuromorphic computing owing to their low energy consumption during feedforward inference on neuromorphic hardware. However, it remains an open challenge…

神经与进化计算 · 计算机科学 2024-03-04 Wenjie Wei , Malu Zhang , Jilin Zhang , Ammar Belatreche , Jibin Wu , Zijing Xu , Xuerui Qiu , Hong Chen , Yang Yang , Haizhou Li

Spiking Neural Networks (SNNs) have emerged as a popular spatio-temporal computing paradigm for complex vision tasks. Recently proposed SNN training algorithms have significantly reduced the number of time steps (down to 1) for improved…

计算机视觉与模式识别 · 计算机科学 2023-11-29 Gourav Datta , Zeyu Liu , Anni Li , Peter A. Beerel

Emerged as a biology-inspired method, Spiking Neural Networks (SNNs) mimic the spiking nature of brain neurons and have received lots of research attention. SNNs deal with binary spikes as their activation and therefore derive extreme…

计算机视觉与模式识别 · 计算机科学 2023-05-04 Yufei Guo , Weihang Peng , Yuanpei Chen , Liwen Zhang , Xiaode Liu , Xuhui Huang , Zhe Ma

Spiking neural networks (SNNs) promise ultra-low-power applications by exploiting temporal and spatial sparsity. The number of binary activations, called spikes, is proportional to the power consumed when executed on neuromorphic hardware.…

计算机视觉与模式识别 · 计算机科学 2024-06-25 Gregor Lenz , Garrick Orchard , Sadique Sheik

Large-scale distributed training of deep neural networks results in models with worse generalization performance as a result of the increase in the effective mini-batch size. Previous approaches attempt to address this problem by varying…

机器学习 · 计算机科学 2020-02-17 Kazuki Osawa , Yohei Tsuji , Yuichiro Ueno , Akira Naruse , Chuan-Sheng Foo , Rio Yokota

Spiking neural network (SNN), as a brain-inspired energy-efficient neural network, has attracted the interest of researchers. While the training of spiking neural networks is still an open problem. One effective way is to map the weight of…

神经与进化计算 · 计算机科学 2022-05-10 Yang Li , Yi Zeng

Spiking neural networks (SNNs) are different from the classical networks used in deep learning: the neurons communicate using electrical impulses called spikes, just like biological neurons. SNNs are appealing for AI technology, because…

神经与进化计算 · 计算机科学 2022-01-10 Nandan Meda

The machine learning community has become increasingly interested in the energy efficiency of neural networks. The Spiking Neural Network (SNN) is a promising approach to energy-efficient computing, since its activation levels are quantized…

机器学习 · 计算机科学 2021-03-03 Aaron R. Voelker , Daniel Rasmussen , Chris Eliasmith

Spiking Neural Networks (SNNs) offer a promising avenue for energy-efficient computing compared with Artificial Neural Networks (ANNs), closely mirroring biological neural processes. However, this potential comes with inherent challenges in…

人工智能 · 计算机科学 2024-03-28 Xiaofeng Wu , Velibor Bojkovic , Bin Gu , Kun Suo , Kai Zou
‹ 上一页 1 8 9 10 下一页 ›