English
Related papers

Related papers: Hardware Efficient Accelerator for Spiking Transfo…

200 papers

Spiking neural networks (SNNs) offer an energy-efficient alternative to traditional neural networks due to their event-driven computing paradigm. However, recent advancements in spiking transformers have focused on improving accuracy with…

Computer Vision and Pattern Recognition · Computer Science 2026-03-03 Wenjie Wei , Xiaolong Zhou , Malu Zhang , Ammar Belatreche , Qian Sun , Yimeng Shan , Dehao Zhang , Zijian Zhou , Zeyu Ma , Yang Yang , Haizhou Li

Spiking neural networks (SNNs) are potential competitors to artificial neural networks (ANNs) due to their high energy-efficiency on neuromorphic hardware. However, SNNs are unfolded over simulation time steps during the training process.…

Computer Vision and Pattern Recognition · Computer Science 2023-12-14 Hong Zhang , Yu Zhang

Spiking Neural Networks (SNNs) compute in an event-based matter to achieve a more efficient computation than standard Neural Networks. In SNNs, neuronal outputs (i.e. activations) are not encoded with real-valued activations but with…

Hardware Architecture · Computer Science 2023-08-08 Jan Sommer , M. Akif Özkan , Oliver Keszocze , Jürgen Teich

In the past decade, advances in Artificial Neural Networks (ANNs) have allowed them to perform extremely well for a wide range of tasks. In fact, they have reached human parity when performing image recognition, for example. Unfortunately,…

Neural and Evolutionary Computing · Computer Science 2024-10-30 Srivatsa P , Kyle Timothy Ng Chu , Burin Amornpaisannon , Yaswanth Tavva , Venkata Pavan Kumar Miriyala , Jibin Wu , Malu Zhang , Haizhou Li , Trevor E. Carlson

We discuss a high-performance and high-throughput hardware accelerator for probabilistic Spiking Neural Networks (SNNs) based on Generalized Linear Model (GLM) neurons, that uses binary STT-RAM devices as synapses and digital CMOS logic for…

Neural and Evolutionary Computing · Computer Science 2020-08-06 Anakha V Babu , Osvaldo Simeone , Bipin Rajendran

Spiking Neural Networks (SNNs) are increasingly recognized for their biological plausibility and energy efficiency, positioning them as strong alternatives to Artificial Neural Networks (ANNs) in neuromorphic computing applications. SNNs…

Neural and Evolutionary Computing · Computer Science 2025-07-14 Kairong Yu , Tianqing Zhang , Qi Xu , Gang Pan , Hongwei Wang

With the sensor scaling of next-generation Brain-Machine Interface (BMI) systems, the massive A/D conversion and analog multiplexing at the neural frontend poses a challenge in terms of power and data rates for wireless and implantable…

Signal Processing · Electrical Eng. & Systems 2024-05-15 Ye Ke , Arindam Basu

Recent research has focused on accelerating stencil computations by exploiting emerging hardware like Tensor Cores. To leverage these accelerators, the stencil operation must be transformed to matrix multiplications. However, this…

Distributed, Parallel, and Cluster Computing · Computer Science 2026-01-27 Qiqi GU , Chenpeng Wu , Heng Shi , Jianguo Yao

Energy efficiency and low latency are crucial requirements for designing wearable AI-empowered human activity recognition systems, due to the hard constraints of battery operations and closed-loop feedback. While neural network models have…

Neural and Evolutionary Computing · Computer Science 2023-08-03 Sizhen Bian , Michele Magno

With more and more event-based neuromorphic hardware systems being developed at universities and in industry, there is a growing need for assessing their performance with domain specific measures. In this work, we use the methodology of…

Neural and Evolutionary Computing · Computer Science 2020-10-28 Christoph Ostrau , Jonas Homburg , Christian Klarhorst , Michael Thies , Ulrich Rückert

Deploying adaptive intelligence at the edge remains challenging due to the high computational and energy cost of training neural models. Spiking Neural Networks (SNNs) offer a promising alternative, but enabling on-device learning requires…

Neural and Evolutionary Computing · Computer Science 2026-05-19 Alessio Caviglia , Filippo Marostica , Alessandro Savino , Stefano Di Carlo

One of today's main concerns is to bring Artificial Intelligence power to embedded systems for edge applications. The hardware resources and power consumption required by state-of-the-art models are incompatible with the constrained…

Neural and Evolutionary Computing · Computer Science 2024-05-03 Dario Padovano , Alessio Carpegna , Alessandro Savino , Stefano Di Carlo

Spiking neural networks (SNNs) offer energy efficiency over artificial neural networks (ANNs) but suffer from high latency and computational overhead due to their multi-timestep operational nature. While various dynamic computation methods…

Machine Learning · Computer Science 2025-08-21 Donghwa Kang , Doohyun Kim , Sang-Ki Ko , Jinkyu Lee , Brent ByungHoon Kang , Hyeongboo Baek

Spiking Neural Networks (SNNs) offer an attractive and energy-efficient alternative to conventional Artificial Neural Networks (ANNs) due to their sparse binary activation. When SNN meets Transformer, it shows great potential in 2D image…

Machine Learning · Computer Science 2025-02-27 Peixi Wu , Bosong Chai , Hebei Li , Menghua Zheng , Yansong Peng , Zeyu Wang , Xuan Nie , Yueyi Zhang , Xiaoyan Sun

Spike-based encoders represent information as sequences of spikes or pulses, which are transmitted between neurons. A prevailing consensus suggests that spike-based approaches demonstrate exceptional capabilities in capturing the temporal…

Signal Processing · Electrical Eng. & Systems 2025-06-03 MHD Anas Alsakkal , Runze Wang , Jayawan Wijekoon , Huajin Tang

This short note regards a comparison of instantaneous power, total energy consumption, execution time and energetic cost per synaptic event of a spiking neural network simulator (DPSNN-STDP) distributed on MPI processes when executed either…

Spiking Neural Networks (SNNs) have garnered attention over recent years due to their increased energy efficiency and advantages in terms of operational complexity compared to traditional Artificial Neural Networks (ANNs). Two important…

Neural and Evolutionary Computing · Computer Science 2025-01-15 Daniel Windhager , Lothar Ratschbacher , Bernhard A. Moser , Michael Lunglmayr

Spiking neural networks (SNNs) have made great progress on both performance and efficiency over the last few years,but their unique working pattern makes it hard to train a high-performance low-latency SNN.Thus the development of SNNs still…

Neural and Evolutionary Computing · Computer Science 2022-11-22 Yudong Li , Yunlin Lei , Xu Yang

Graph Transformers (GTs) with powerful representation learning ability make a huge success in wide range of graph tasks. However, the costs behind outstanding performances of GTs are higher energy consumption and computational overhead. The…

Neural and Evolutionary Computing · Computer Science 2024-03-27 Huizhe Zhang , Jintang Li , Liang Chen , Zibin Zheng

Intracortical brain-machine interfaces demand low-latency, energy-efficient solutions for neural decoding. Spiking Neural Networks (SNNs) deployed on neuromorphic hardware have demonstrated remarkable efficiency in neural decoding by…

Neural and Evolutionary Computing · Computer Science 2025-04-17 Francesca Rivelli , Martin Popov , Charalampos S. Kouzinopoulos , Guangzhi Tang