中文
相关论文

相关论文: Deep activity propagation via weight initializatio…

200 篇论文

Spiking neural networks (SNNs) that enables energy efficient implementation on emerging neuromorphic hardware are gaining more attention. Yet now, SNNs have not shown competitive performance compared with artificial neural networks (ANNs),…

神经与进化计算 · 计算机科学 2018-11-26 Yujie Wu , Lei Deng , Guoqi Li , Jun Zhu , Luping Shi

We present a new back propagation based training algorithm for discrete-time spiking neural networks (SNN). Inspired by recent deep learning algorithms on binarized neural networks, binary activation with a straight-through gradient…

神经与进化计算 · 计算机科学 2017-09-20 Shihui Yin , Shreyas K. Venkataramanaiah , Gregory K. Chen , Ram Krishnamurthy , Yu Cao , Chaitali Chakrabarti , Jae-sun Seo

Spiking neural networks (SNNs) can utilize spatio-temporal information and have a nature of energy efficiency which is a good alternative to deep neural networks(DNNs). The event-driven information processing makes SNNs can reduce the…

神经与进化计算 · 计算机科学 2021-12-15 Changqing Xu , Yi Liu , Yintang Yang

Spiking neural networks (SNNs) have shown clear advantages over traditional artificial neural networks (ANNs) for low latency and high computational efficiency, due to their event-driven nature and sparse communication. However, the…

神经与进化计算 · 计算机科学 2020-07-03 Jibin Wu , Chenglin Xu , Daquan Zhou , Haizhou Li , Kay Chen Tan

There is an increasing interest in emulating Spiking Neural Networks (SNNs) on neuromorphic computing devices due to their low energy consumption. Recent advances have allowed training SNNs to a point where they start to compete with…

神经与进化计算 · 计算机科学 2022-01-14 Nicolas Perez-Nieves , Dan F. M. Goodman

Appropriate weight initialization settings, along with the ReLU activation function, have become cornerstones of modern deep learning, enabling the training and deployment of highly effective and efficient neural network models across…

机器学习 · 计算机科学 2024-04-02 Hyunwoo Lee , Yunho Kim , Seung Yeop Yang , Hayoung Choi

Although existing deep learning-based Ultra-Wide Band (UWB) channel estimation methods achieve high accuracy, their computational intensity clashes sharply with the resource constraints of low-cost edge devices. Motivated by this, this…

新兴技术 · 计算机科学 2026-01-01 Youdong Zhang , Xu He , Xiaolin Meng

The weight initialization and the activation function of deep neural networks have a crucial impact on the performance of the training procedure. An inappropriate selection can lead to the loss of information of the input during forward…

机器学习 · 统计学 2019-05-28 Soufiane Hayou , Arnaud Doucet , Judith Rousseau

Spiking Neural Network (SNN), as a brain-inspired and energy-efficient network, is currently facing the pivotal challenge of exploring a suitable and efficient learning framework. The predominant training methodologies, namely…

神经与进化计算 · 计算机科学 2025-05-27 Zecheng Hao , Qichao Ma , Kang Chen , Yi Zhang , Zhaofei Yu , Tiejun Huang

Emergence of deep neural networks (DNNs) has raised enormous attention towards artificial neural networks (ANNs) once again. They have become the state-of-the-art models and have won different machine learning challenges. Although these…

神经与进化计算 · 计算机科学 2022-12-09 Shahriar Rezghi Shirsavar , Abdol-Hossein Vahabie , Mohammad-Reza A. Dehaqani

The human brain utilizes spikes for information transmission and dynamically reorganizes its network structure to boost energy efficiency and cognitive capabilities throughout its lifespan. Drawing inspiration from this spike-based…

人机交互 · 计算机科学 2025-02-20 Jiangrong Shen , Qi Xu , Gang Pan , Badong Chen

Spiking neural networks (SNNs), particularly the single-spike variant in which neurons spike at most once, are considerably more energy efficient than standard artificial neural networks (ANNs). However, single-spike SSNs are difficult to…

神经与进化计算 · 计算机科学 2022-10-13 Luke Taylor , Andrew King , Nicol Harper

Spiking Neural Networks (SNNs) have attracted enormous research interest due to temporal information processing capability, low power consumption, and high biological plausibility. However, the formulation of efficient and high-performance…

神经与进化计算 · 计算机科学 2021-08-18 Wei Fang , Zhaofei Yu , Yanqi Chen , Timothee Masquelier , Tiejun Huang , Yonghong Tian

Spiking Neural Networks (SNNs), recognized as the third generation of neural networks, are known for their bio-plausibility and energy efficiency, especially when implemented on neuromorphic hardware. However, the majority of existing…

神经与进化计算 · 计算机科学 2024-07-02 Yi Jiang , Sen Lu , Abhronil Sengupta

Input-Convex Neural Networks (ICNNs) are networks that guarantee convexity in their input-output mapping. These networks have been successfully applied for energy-based modelling, optimal transport problems and learning invariances. The…

机器学习 · 计算机科学 2023-12-21 Pieter-Jan Hoedt , Günter Klambauer

Spiking Neural Networks (SNNs) have been attached great importance due to their biological plausibility and high energy-efficiency on neuromorphic chips. As these chips are usually resource-constrained, the compression of SNNs is thus…

神经与进化计算 · 计算机科学 2021-08-19 Yanqi Chen , Zhaofei Yu , Wei Fang , Tiejun Huang , Yonghong Tian

Spiking Neural Networks (SNNs) are one of the most promising bio-inspired neural networks models and have drawn increasing attention in recent years. The event-driven communication mechanism of SNNs allows for sparse and theoretically…

神经与进化计算 · 计算机科学 2025-10-29 Andrea Castagnetti , Alain Pegatoquet , Benoît Miramond

Spiking neural networks (SNNs) are distributed trainable systems whose computing elements, or neurons, are characterized by internal analog dynamics and by digital and sparse synaptic communications. The sparsity of the synaptic spiking…

机器学习 · 计算机科学 2020-01-08 Hyeryung Jang , Osvaldo Simeone , Brian Gardner , André Grüning

Spiking Neural Networks (SNNs) are distributed trainable systems whose computing elements, or neurons, are characterized by internal analog dynamics and by digital and sparse synaptic communications. The sparsity of the synaptic spiking…

信号处理 · 电气工程与系统科学 2019-10-22 Hyeryung Jang , Osvaldo Simeone , Brian Gardner , André Grüning

In the last few years, spiking neural networks have been demonstrated to perform on par with regular convolutional neural networks. Several works have proposed methods to convert a pre-trained CNN to a Spiking CNN without a significant…

神经与进化计算 · 计算机科学 2020-05-05 Martino Sorbaro , Qian Liu , Massimo Bortone , Sadique Sheik