English
Related papers

Related papers: VESTA: A Versatile SNN-Based Transformer Accelerat…

200 papers

Convolutional Neural Networks (CNNs) are widely employed to solve various problems, e.g., image classification. Due to their compute- and data-intensive nature, CNN accelerators have been developed as ASICs or on FPGAs. Increasing…

Hardware Architecture · Computer Science 2023-06-23 Patrick Plagwitz , Frank Hannig , Jürgen Teich , Oliver Keszocze

Spiking Neural Networks (SNNs), known for their biologically plausible architecture, face the challenge of limited performance. The self-attention mechanism, which is the cornerstone of the high-performance Transformer and also a…

Neural and Evolutionary Computing · Computer Science 2024-01-05 Zhaokun Zhou , Kaiwei Che , Wei Fang , Keyu Tian , Yuesheng Zhu , Shuicheng Yan , Yonghong Tian , Li Yuan

The integration of neuromorphic computing and transformers through spiking neural networks (SNNs) offers a promising path to energy-efficient sequence modeling, with the potential to overcome the energy-intensive nature of the artificial…

Hardware Architecture · Computer Science 2025-04-23 Zihang Song , Prabodh Katti , Osvaldo Simeone , Bipin Rajendran

Spiking neural networks (SNNs) can be run on neuromorphic devices with ultra-high speed and ultra-low energy consumption because of their binary and event-driven nature. Therefore, SNNs are expected to have various applications, including…

Neural and Evolutionary Computing · Computer Science 2021-12-15 Hiromichi Kamata , Yusuke Mukuta , Tatsuya Harada

Spiking neural networks (SNNs), that operate via binary spikes distributed over time, have emerged as a promising energy efficient ML paradigm for resource-constrained devices. However, the current state-of-the-art (SOTA) SNNs require…

Computer Vision and Pattern Recognition · Computer Science 2021-12-23 Gourav Datta , Peter A. Beerel

Vision Transformer models, such as ViT, Swin Transformer, and Transformer-in-Transformer, have recently gained significant traction in computer vision tasks due to their ability to capture the global relation between features which leads to…

Hardware Architecture · Computer Science 2023-09-13 Shashank Nag , Gourav Datta , Souvik Kundu , Nitin Chandrachoodan , Peter A. Beerel

Including Artificial Neural Networks in embedded systems at the edge allows applications to exploit Artificial Intelligence capabilities directly within devices operating at the network periphery. This paper introduces Spiker+, a…

Neural and Evolutionary Computing · Computer Science 2024-12-23 Alessio Carpegna , Alessandro Savino , Stefano Di Carlo

Spiking neural networks (SNNs), which are inspired by the human brain, have recently gained popularity due to their relatively simple and low-power hardware for transmitting binary spikes and highly sparse activation maps. However, because…

Hardware Architecture · Computer Science 2022-05-03 Hong-Han Lien , Tian-Sheuan Chang

Spiking Neural Networks (SNNs), particularly Spiking Transformers, offer energy-efficient processing of event-based sensor data for healthcare applications. Yet current architectures are rigid: they are trained and deployed as static…

Neural and Evolutionary Computing · Computer Science 2026-05-15 Alberto Ancilotto , Gianluca Amprimo , Stefano Di Carlo , Elisabetta Farella

Spiking neural networks (SNNs) have gained attention in recent years due to their ability to handle sparse and event-based data better than regular artificial neural networks (ANNs). Since the structure of SNNs is less suited for typically…

Signal Processing · Electrical Eng. & Systems 2023-11-27 Daniel Windhager , Bernhard A. Moser , Michael Lunglmayr

Spiking Neural Networks (SNNs), with their inherent recurrence, offer an efficient method for processing the asynchronous temporal data generated by Dynamic Vision Sensors (DVS), making them well-suited for event-based vision applications.…

Hardware Architecture · Computer Science 2024-11-06 Deepika Sharma , Shubham Negi , Trishit Dutta , Amogh Agrawal , Kaushik Roy

Spiking neural networks (SNNs) offer both compelling potential advantages, including energy efficiency and low latencies and challenges including the non-differentiable nature of event spikes. Much of the initial research in this area has…

Computer Vision and Pattern Recognition · Computer Science 2022-02-11 Somayeh Hussaini , Michael Milford , Tobias Fischer

There exists a significant scale gap between photonic neural network integrated chips and neural networks, which hinders the deployment and application of photonic neural network. Here, we propose hardware-aware lightweight spiking neural…

Depth estimation is a critical task in computer vision, with applications in autonomous navigation, robotics, and augmented reality. Event cameras, which encode temporal changes in light intensity as asynchronous binary spikes, offer unique…

Computer Vision and Pattern Recognition · Computer Science 2025-02-25 Xin Zhang , Liangxiu Han , Tam Sobeih , Lianghao Han , Darren Dancey

Spiking Neural Networks (SNNs) are one of the most promising bio-inspired neural networks models and have drawn increasing attention in recent years. The event-driven communication mechanism of SNNs allows for sparse and theoretically…

Neural and Evolutionary Computing · Computer Science 2025-10-29 Andrea Castagnetti , Alain Pegatoquet , Benoît Miramond

Event-based semantic segmentation has great potential in autonomous driving and robotics due to the advantages of event cameras, such as high dynamic range, low latency, and low power cost. Unfortunately, current artificial neural network…

Computer Vision and Pattern Recognition · Computer Science 2026-01-01 Xianlei Long , Xiaxin Zhu , Fangming Guo , Wanyi Zhang , Qingyi Gu , Chao Chen , Fuqiang Gu

Spiking neural networks (SNNs) show great potential due to their energy efficiency, fast processing capabilities, and robustness. There are two main approaches to constructing SNNs. Direct training methods require much memory, while…

Computer Vision and Pattern Recognition · Computer Science 2025-03-03 Zihan Huang , Xinyu Shi , Zecheng Hao , Tong Bu , Jianhao Ding , Zhaofei Yu , Tiejun Huang

Stochastic computing (SC) offers significant reductions in hardware complexity for traditional convolutional neural networks(CNNs). However, despite its advantages, stochastic computing neural networks (SCNNs) often suffer from high…

Hardware Architecture · Computer Science 2026-01-29 Sheng Lu , Qianhou Qu , Sungyong Jung , Qilian Liang , Chenyun Pan

Spiking neural networks (SNNs), known for their low-power, event-driven computation and intrinsic temporal dynamics, are emerging as promising solutions for processing dynamic, asynchronous signals from event-based sensors. Despite their…

Computer Vision and Pattern Recognition · Computer Science 2024-08-05 Rui Zhang , Luziwei Leng , Kaiwei Che , Hu Zhang , Jie Cheng , Qinghai Guo , Jiangxing Liao , Ran Cheng

Spiking Neural Network (SNN) is the third generation of Neural Network (NN) mimicking the natural behavior of the brain. By processing based on binary input/output, SNNs offer lower complexity, higher density and lower power consumption.…

Neural and Evolutionary Computing · Computer Science 2020-03-24 Khanh N. Dang , Abderazek Ben Abdallah