中文
相关论文

相关论文: Towards High-performance Spiking Transformers from…

200 篇论文

Spiking Neural Networks (SNNs) have gained popularity due to their high energy efficiency. Prior works have proposed various methods for training SNNs, including backpropagation-based methods. Training SNNs is computationally expensive…

信号处理 · 电气工程与系统科学 2024-11-18 Sai Sanjeet , Bibhu Datta Sahoo , Keshab K. Parhi

Spiking Neural Networks (SNNs) provide an energy-efficient deep learning option due to their unique spike-based event-driven (i.e., spike-driven) paradigm. In this paper, we incorporate the spike-driven paradigm into Transformer by the…

神经与进化计算 · 计算机科学 2023-07-06 Man Yao , Jiakui Hu , Zhaokun Zhou , Li Yuan , Yonghong Tian , Bo Xu , Guoqi Li

Multi-bit spiking neural networks (SNNs) have recently become a heated research spot, pursuing energy-efficient and high-accurate AI. However, with more bits involved, the associated memory and computation demands escalate to the point…

神经与进化计算 · 计算机科学 2025-12-02 Xingting Yao , Qinghao Hu , Fei Zhou , Tielong Liu , Gang Li , Peisong Wang , Jian Cheng

Convolutional Neural Networks (CNNs) are widely employed to solve various problems, e.g., image classification. Due to their compute- and data-intensive nature, CNN accelerators have been developed as ASICs or on FPGAs. Increasing…

硬件体系结构 · 计算机科学 2023-06-23 Patrick Plagwitz , Frank Hannig , Jürgen Teich , Oliver Keszocze

Spiking Neural Networks (SNNs) have gained increasing attention due to their potential for low-power computation on neuromorphic hardware. A widely adopted training strategy for SNNs is direct coding, which enable backpropagation on neuron…

神经与进化计算 · 计算机科学 2026-05-11 Nhan Trong Luu , Duong Trung Luu , Pham Ngoc Nam , Truong Cong Thang

Spiking neural network (SNN) is interesting both theoretically and practically because of its strong bio-inspiration nature and potentially outstanding energy efficiency. Unfortunately, its development has fallen far behind the conventional…

计算机视觉与模式识别 · 计算机科学 2021-09-20 Shibo Zhou , Xiaohua LI , Ying Chen , Sanjeev T. Chandrasekaran , Arindam Sanyal

Spiking neural networks (SNNs) have great potential for energy-efficient implementation of Deep Neural Networks (DNNs) on dedicated neuromorphic hardware. Recent studies demonstrated competitive performance of SNNs compared with DNNs on…

神经与进化计算 · 计算机科学 2020-12-24 Weihao Tan , Devdhar Patel , Robert Kozma

Brain-inspired Spiking Neural Networks (SNNs) have the characteristics of event-driven and high energy-efficient, which are different from traditional Artificial Neural Networks (ANNs) when deployed on edge devices such as neuromorphic…

计算机视觉与模式识别 · 计算机科学 2023-08-10 Jue Chen , Huan Yuan , Jianchao Tan , Bin Chen , Chengru Song , Di Zhang

Spiking Neural Networks (SNNs) have emerged as an attractive spatio-temporal computing paradigm for complex vision tasks. However, most existing works yield models that require many time steps and do not leverage the inherent temporal…

神经与进化计算 · 计算机科学 2022-10-25 Gourav Datta , Haoqin Deng , Robert Aviles , Peter A. Beerel

Spiking neural networks (SNNs) promise orders-of-magnitude efficiency gains by communicating with sparse, event-driven spikes rather than dense numerical activations. However, most training pipelines either rely on surrogate-gradient…

神经与进化计算 · 计算机科学 2025-12-17 Arman Ferdowsi , Atakan Aral

Spiking Neural Networks (SNNs) have attracted recent interest due to their energy efficiency and biological plausibility. However, the performance of SNNs still lags behind traditional Artificial Neural Networks (ANNs), as there is no…

神经与进化计算 · 计算机科学 2023-05-19 Henrique Branquinho , Nuno Lourenço , Ernesto Costa

Spiking Neural Networks (SNNs), particularly Spiking Transformers, offer energy-efficient processing of event-based sensor data for healthcare applications. Yet current architectures are rigid: they are trained and deployed as static…

神经与进化计算 · 计算机科学 2026-05-15 Alberto Ancilotto , Gianluca Amprimo , Stefano Di Carlo , Elisabetta Farella

We seek to investigate the scalability of neuromorphic computing for computer vision, with the objective of replicating non-neuromorphic performance on computer vision tasks while reducing power consumption. We convert the deep Artificial…

神经与进化计算 · 计算机科学 2021-06-17 Kinjal Patel , Eric Hunsberger , Sean Batir , Chris Eliasmith

Spiking Neural Network (SNN) is acknowledged as the next generation of Artificial Neural Network (ANN) and hold great promise in effectively processing spatial-temporal information. However, the choice of timestep becomes crucial as it…

神经与进化计算 · 计算机科学 2024-05-03 Dengyu Wu , Yi Qi , Kaiwen Cai , Gaojie Jin , Xinping Yi , Xiaowei Huang

Spiking neural networks (SNNs) represent a promising approach in machine learning, combining the hierarchical learning capabilities of deep neural networks with the energy efficiency of spike-based computations. Traditional end-to-end…

神经与进化计算 · 计算机科学 2024-11-12 Ruyin Wan , Qian Zhang , George Em Karniadakis

The integration of neuromorphic computing and transformers through spiking neural networks (SNNs) offers a promising path to energy-efficient sequence modeling, with the potential to overcome the energy-intensive nature of the artificial…

硬件体系结构 · 计算机科学 2025-04-23 Zihang Song , Prabodh Katti , Osvaldo Simeone , Bipin Rajendran

Spiking Neural Networks (SNNs) can reduce energy consumption compared to conventional Artificial Neural Networks (ANNs) when spiking activity is sparse and the neuron model is hardware-friendly. However, biologically faithful models are…

神经与进化计算 · 计算机科学 2026-05-13 Pascal Harmeling , Florent De Geeter , Guillaume Drion

Spiking Neural Networks (SNNs), providing more realistic neuronal dynamics, have been shown to achieve performance comparable to Artificial Neural Networks (ANNs) in several machine learning tasks. Information is processed as spikes within…

神经与进化计算 · 计算机科学 2025-07-01 Jiaqi Lin , Sen Lu , Malyaban Bal , Abhronil Sengupta

Spiking neural networks (SNN) distinguish themselves from artificial neural networks (ANN) because of their inherent temporal processing and spike-based computations, enabling a power-efficient implementation in neuromorphic hardware. In…

神经与进化计算 · 计算机科学 2023-11-29 Lucas Deckers , Laurens Van Damme , Ing Jyh Tsang , Werner Van Leekwijck , Steven Latré

The energy-efficient and brain-like information processing abilities of Spiking Neural Networks (SNNs) have attracted considerable attention, establishing them as a crucial element of brain-inspired computing. One prevalent challenge…

神经与进化计算 · 计算机科学 2025-10-27 Zhichao Zhu , Yang Qi , Wenlian Lu , Zhigang Wang , Lu Cao , Jianfeng Feng
‹ 上一页 1 8 9 10 下一页 ›