English
Related papers

Related papers: Spiking Transformer Hardware Accelerators in 3D In…

200 papers

Spiking neural networks (SNNs) have low power consumption and bio-interpretable characteristics, and are considered to have tremendous potential for energy-efficient computing. However, the exploration of SNNs on image generation tasks…

Computer Vision and Pattern Recognition · Computer Science 2024-02-27 Shu Yang , Hanzhi Ma , Chengting Yu , Aili Wang , Er-Ping Li

Neuromorphic Computing (NC) and Spiking Neural Networks (SNNs) in particular are often viewed as the next generation of Neural Networks (NNs). NC is a novel bio-inspired paradigm for energy efficient neural computation, often relying on…

Robotics · Computer Science 2024-09-18 Andreas Ziegler , Karl Vetter , Thomas Gossard , Jonas Tebbe , Sebastian Otte , Andreas Zell

Spiking Neural Networks (SNNs) have garnered attention over recent years due to their increased energy efficiency and advantages in terms of operational complexity compared to traditional Artificial Neural Networks (ANNs). Two important…

Neural and Evolutionary Computing · Computer Science 2025-01-15 Daniel Windhager , Lothar Ratschbacher , Bernhard A. Moser , Michael Lunglmayr

Spiking Neural Networks have attracted significant attention in recent years due to their distinctive low-power characteristics. Meanwhile, Transformer models, known for their powerful self-attention mechanisms and parallel processing…

Neural and Evolutionary Computing · Computer Science 2024-12-19 Hangming Zhang , Alexander Sboev , Roman Rybka , Qiang Yu

Spiking Neural Networks (SNNs) are extensively utilized in brain-inspired computing and neuroscience research. To enhance the speed and energy efficiency of SNNs, several many-core accelerators have been developed. However, maintaining the…

Neural and Evolutionary Computing · Computer Science 2024-07-31 Zhuo Chen , De Ma , Xiaofei Jin , Qinghui Xing , Ouwen Jin , Xin Du , Shuibing He , Gang Pan

Convolutional Neural Networks (CNNs) are widely employed to solve various problems, e.g., image classification. Due to their compute- and data-intensive nature, CNN accelerators have been developed as ASICs or on FPGAs. Increasing…

Hardware Architecture · Computer Science 2023-06-23 Patrick Plagwitz , Frank Hannig , Jürgen Teich , Oliver Keszocze

Spiking neural networks (SNNs) show great potential due to their energy efficiency, fast processing capabilities, and robustness. There are two main approaches to constructing SNNs. Direct training methods require much memory, while…

Computer Vision and Pattern Recognition · Computer Science 2025-03-03 Zihan Huang , Xinyu Shi , Zecheng Hao , Tong Bu , Jianhao Ding , Zhaofei Yu , Tiejun Huang

Spiking neural networks (SNNs) that mimic information transmission in the brain can energy-efficiently process spatio-temporal information through discrete and sparse spikes, thereby receiving considerable attention. To improve accuracy and…

Neural and Evolutionary Computing · Computer Science 2022-06-14 Byunggook Na , Jisoo Mok , Seongsik Park , Dongjin Lee , Hyeokjun Choe , Sungroh Yoon

Spiking Neural Networks (SNN) represent a biologically inspired computation model capable of emulating neural computation in human brain and brain-like structures. The main promise is very low energy consumption. Unfortunately, classic Von…

Spiking Neural Networks (SNNs) offer an attractive and energy-efficient alternative to conventional Artificial Neural Networks (ANNs) due to their sparse binary activation. When SNN meets Transformer, it shows great potential in 2D image…

Machine Learning · Computer Science 2025-02-27 Peixi Wu , Bosong Chai , Hebei Li , Menghua Zheng , Yansong Peng , Zeyu Wang , Xuan Nie , Yueyi Zhang , Xiaoyan Sun

Spiking Neural Networks (SNNs) have been recently integrated into Transformer architectures due to their potential to reduce computational demands and to improve power efficiency. Yet, the implementation of the attention mechanism using…

Hardware Architecture · Computer Science 2024-11-12 Zihang Song , Prabodh Katti , Osvaldo Simeone , Bipin Rajendran

The remarkable success of Vision Transformers in Artificial Neural Networks (ANNs) has led to a growing interest in incorporating the self-attention mechanism and transformer-based architecture into Spiking Neural Networks (SNNs). While…

Neural and Evolutionary Computing · Computer Science 2024-03-29 Xinyu Shi , Zecheng Hao , Zhaofei Yu

Spiking neural networks (SNNs) aim to realize brain-inspired intelligence on neuromorphic chips with high energy efficiency by introducing neural dynamics and spike properties. As the emerging spiking deep learning paradigm attracts…

Neural and Evolutionary Computing · Computer Science 2023-10-26 Wei Fang , Yanqi Chen , Jianhao Ding , Zhaofei Yu , Timothée Masquelier , Ding Chen , Liwei Huang , Huihui Zhou , Guoqi Li , Yonghong Tian

Recently, both industry and academia have proposed several different neuromorphic systems to execute machine learning applications that are designed using Spiking Neural Networks (SNNs). With the growing complexity on design and technology…

Neural and Evolutionary Computing · Computer Science 2022-02-21 Phu Khanh Huynh , M. Lakshmi Varshika , Ankita Paul , Murat Isik , Adarsha Balaji , Anup Das

The ambition of brain-inspired Spiking Neural Networks (SNNs) is to become a low-power alternative to traditional Artificial Neural Networks (ANNs). This work addresses two major challenges in realizing this vision: the performance gap…

Computer Vision and Pattern Recognition · Computer Science 2025-01-22 Man Yao , Xuerui Qiu , Tianxiang Hu , Jiakui Hu , Yuhong Chou , Keyu Tian , Jianxing Liao , Luziwei Leng , Bo Xu , Guoqi Li

Neuromorphic computing, which exploits Spiking Neural Networks (SNNs) on neuromorphic chips, is a promising energy-efficient alternative to traditional AI. CNN-based SNNs are the current mainstream of neuromorphic computing. By contrast, no…

Neural and Evolutionary Computing · Computer Science 2024-04-08 Man Yao , Jiakui Hu , Tianxiang Hu , Yifan Xu , Zhaokun Zhou , Yonghong Tian , Bo Xu , Guoqi Li

Spiking Neural Networks (SNNs) have a low-power advantage but perform poorly in image segmentation tasks. The reason is that directly converting neural networks with complex architectural designs for segmentation tasks into spiking versions…

Computer Vision and Pattern Recognition · Computer Science 2024-12-20 Zhenxin Lei , Man Yao , Jiakui Hu , Xinhao Luo , Yanye Lu , Bo Xu , Guoqi Li

Spiking neural networks (SNNs) have closer dynamics to the brain than current deep neural networks. Their low power consumption and sample efficiency make these networks interesting. Recently, several deep convolutional spiking neural…

Computer Vision and Pattern Recognition · Computer Science 2022-11-01 Shahriar Rezghi Shirsavar , Mohammad-Reza A. Dehaqani

The efficiency of modern machine intelligence depends on high accuracy with minimal computational cost. In spiking neural networks (SNNs), synaptic delays are crucial for encoding temporal structure, yet existing models treat them as fully…

Neural and Evolutionary Computing · Computer Science 2025-12-19 Lennart P. L. Landsmeer , Amirreza Movahedin , Mario Negrello , Said Hamdioui , Christos Strydis

The rising demand for energy-efficient edge AI systems (e.g., mobile agents/robots) has increased the interest in neuromorphic computing, since it offers ultra-low power/energy AI computation through spiking neural network (SNN) algorithms…

Neural and Evolutionary Computing · Computer Science 2026-01-06 Rachmad Vidya Wicaksana Putra , Pasindu Wickramasinghe , Muhammad Shafique