English
Related papers

Related papers: Hardware Efficient Accelerator for Spiking Transfo…

200 papers

Processing-in-memory (PIM) architectures have demonstrated great potential in accelerating numerous deep learning tasks. Particularly, resistive random-access memory (RRAM) devices provide a promising hardware substrate to build PIM…

Hardware Architecture · Computer Science 2022-02-01 Weidong Cao , Yilong Zhao , Adith Boloor , Yinhe Han , Xuan Zhang , Li Jiang

Spiking Neural Networks (SNNs) are expected to be a promising alternative to Artificial Neural Networks (ANNs) due to their strong biological interpretability and high energy efficiency. Specialized SNN hardware offers clear advantages over…

Neural and Evolutionary Computing · Computer Science 2023-09-29 Jindong Li , Guobin Shen , Dongcheng Zhao , Qian Zhang , Yi Zeng

Deploying mixed-precision neural networks on edge devices is friendly to hardware resources and power consumption. To support fully mixed-precision neural network inference, it is necessary to design flexible hardware accelerators for…

Hardware Architecture · Computer Science 2025-02-04 Liang Zhao , Kunming Shao , Fengshi Tian , Tim Kwang-Ting Cheng , Chi-Ying Tsui , Yi Zou

Transformer-based models are becoming more and more intelligent and are revolutionizing a wide range of human tasks. To support their deployment, AI labs offer inference services that consume hundreds of GWh of energy annually and charge…

Systems and Control · Electrical Eng. & Systems 2025-08-29 Ching-Yi Lin , Sahil Shah

The rapid growth of brain-inspired computing coupled with the inefficiencies in the CMOS implementations of neuromrphic systems has led to intense exploration of efficient hardware implementations of the functional units of the brain,…

Emerging Technologies · Computer Science 2018-08-29 Indranil Chakraborty , Gobinda Saha , Abhronil Sengupta , Kaushik Roy

This paper presents SynapticCore-X, a modular and resource-efficient neural processing architecture optimized for deployment on low-cost FPGA platforms. The design integrates a lightweight RV32IMC RISC-V control core with a configurable…

Hardware Architecture · Computer Science 2025-11-18 Arya Parameshwara

Spiking neural networks (SNNs) have gained attention in recent years due to their ability to handle sparse and event-based data better than regular artificial neural networks (ANNs). Since the structure of SNNs is less suited for typically…

Signal Processing · Electrical Eng. & Systems 2023-11-27 Daniel Windhager , Bernhard A. Moser , Michael Lunglmayr

The combination of Spiking Neural Networks (SNNs) and Transformers has attracted significant attention due to their potential for high energy efficiency and high-performance nature. However, existing works on this topic typically rely on…

Neural and Evolutionary Computing · Computer Science 2023-07-18 Ziqing Wang , Yuetong Fang , Jiahang Cao , Qiang Zhang , Zhongrui Wang , Renjing Xu

Multimodal Large Language Models (MLLMs) have achieved remarkable progress but incur substantial computational overhead and energy consumption during inference, limiting deployment in resource-constrained environments. Spiking Neural…

Neural and Evolutionary Computing · Computer Science 2026-04-22 Han Xu , Zhiyong Qin , Di Shang , Jiahong Zhang , Xuerui Qiu , Bo Lei , Tiejun Huang , Bo Xu , Guoqi Li

This paper presents a comprehensive evaluation of Spiking Neural Network (SNN) neuron models for hardware acceleration by comparing event driven and clock-driven implementations. We begin our investigation in software, rapidly prototyping…

Neural and Evolutionary Computing · Computer Science 2025-12-24 Filippo Marostica , Alessio Carpegna , Alessandro Savino , Stefano Di Carlo

Stochastic computing (SC) offers significant reductions in hardware complexity for traditional convolutional neural networks(CNNs). However, despite its advantages, stochastic computing neural networks (SCNNs) often suffer from high…

Hardware Architecture · Computer Science 2026-01-29 Sheng Lu , Qianhou Qu , Sungyong Jung , Qilian Liang , Chenyun Pan

Spiking transformers are emerging as a promising architecture that combines the energy efficiency of Spiking Neural Networks (SNNs) with the powerful attention mechanisms of transformers. However, existing hardware accelerators lack support…

Hardware Architecture · Computer Science 2025-05-20 Tenglong Li , Jindong Li , Guobin Shen , Dongcheng Zhao , Qian Zhang , Yi Zeng

Spiking neural networks, also often referred to as the third generation of neural networks, carry the potential for a massive reduction in memory and energy consumption over traditional, second-generation neural networks. Inspired by the…

Neural and Evolutionary Computing · Computer Science 2022-10-27 Alexander Henkes , Jason K. Eshraghian , Henning Wessels

In recent years the field of neuromorphic low-power systems that consume orders of magnitude less power gained significant momentum. However, their wider use is still hindered by the lack of algorithms that can harness the strengths of such…

Neural and Evolutionary Computing · Computer Science 2016-01-19 Peter U. Diehl , Guido Zarrella , Andrew Cassidy , Bruno U. Pedroni , Emre Neftci

Spiking Transformers, which integrate Spiking Neural Networks (SNNs) with Transformer architectures, have attracted significant attention due to their potential for energy efficiency and high performance. However, existing models in this…

Neural and Evolutionary Computing · Computer Science 2026-05-22 Chenlin Zhou , Han Zhang , Zhaokun Zhou , Liutao Yu , Liwei Huang , Xiaopeng Fan , Li Yuan , Zhengyu Ma , Huihui Zhou , Yonghong Tian

Spiking Neural Network (SNN) is the third generation of Neural Network (NN) mimicking the natural behavior of the brain. By processing based on binary input/output, SNNs offer lower complexity, higher density and lower power consumption.…

Neural and Evolutionary Computing · Computer Science 2020-03-24 Khanh N. Dang , Abderazek Ben Abdallah

Spiking neural networks (SNNs) have garnered interest due to their energy efficiency and superior effectiveness on neuromorphic chips compared with traditional artificial neural networks (ANNs). One of the mainstream approaches to…

Neural and Evolutionary Computing · Computer Science 2024-04-29 Zhipeng Huang , Jianhao Ding , Zhiyu Pan , Haoran Li , Ying Fang , Zhaofei Yu , Jian K. Liu

Speech Emotion Recognition (SER) is widely deployed in Human-Computer Interaction, yet the high computational cost of conventional models hinders their implementation on resource-constrained edge devices. Spiking Neural Networks (SNNs)…

Artificial Intelligence · Computer Science 2026-02-10 Xun Su , Huamin Wang , Qi Zhang

Mass spectrometry (MS) is essential for proteomics and metabolomics but faces impending challenges in efficiently processing the vast volumes of data. This paper introduces SpecPCM, an in-memory computing (IMC) accelerator designed to…

Hardware Architecture · Computer Science 2024-11-18 Keming Fan , Ashkan Moradifirouzabadi , Xiangjin Wu , Zheyu Li , Flavio Ponzina , Anton Persson , Eric Pop , Tajana Rosing , Mingu Kang

Convolutional Neural Networks (CNNs) are widely employed to solve various problems, e.g., image classification. Due to their compute- and data-intensive nature, CNN accelerators have been developed as ASICs or on FPGAs. Increasing…

Hardware Architecture · Computer Science 2023-06-23 Patrick Plagwitz , Frank Hannig , Jürgen Teich , Oliver Keszocze