English
Related papers

Related papers: ASTER: Attention-based Spiking Transformer Engine …

200 papers

Spiking neural networks (SNNs) are potential competitors to artificial neural networks (ANNs) due to their high energy-efficiency on neuromorphic hardware. However, SNNs are unfolded over simulation time steps during the training process.…

Computer Vision and Pattern Recognition · Computer Science 2023-12-14 Hong Zhang , Yu Zhang

Current Artificial Intelligence (AI) computation systems face challenges, primarily from the memory-wall issue, limiting overall system-level performance, especially for Edge devices with constrained battery budgets, such as smartphones,…

Hardware Architecture · Computer Science 2024-10-15 Lucas Huijbregts , Liu Hsiao-Hsuan , Paul Detterer , Said Hamdioui , Amirreza Yousefzadeh , Rajendra Bishnoi

Spiking Neural Networks (SNNs) provide an energy-efficient deep learning option due to their unique spike-based event-driven (i.e., spike-driven) paradigm. In this paper, we incorporate the spike-driven paradigm into Transformer by the…

Neural and Evolutionary Computing · Computer Science 2023-07-06 Man Yao , Jiakui Hu , Zhaokun Zhou , Li Yuan , Yonghong Tian , Bo Xu , Guoqi Li

Transformers achieve state-of-the-art performance in natural language processing, vision, and scientific computing, but demand high computation and memory. To address these challenges, we present ASTRA, the first silicon-photonic…

Hardware Architecture · Computer Science 2026-04-14 S. Afifi , O. Alo , I. Thakkar , S. Pasricha

The remarkable success of Vision Transformers in Artificial Neural Networks (ANNs) has led to a growing interest in incorporating the self-attention mechanism and transformer-based architecture into Spiking Neural Networks (SNNs). While…

Neural and Evolutionary Computing · Computer Science 2024-03-29 Xinyu Shi , Zecheng Hao , Zhaofei Yu

Recent hardware acceleration advances have enabled powerful specialized accelerators for finite element computations, spiking neural network inference, and sparse tensor operations. However, existing approaches face fundamental limitations:…

Hardware Architecture · Computer Science 2026-01-09 Chuanzhen Wang , Leo Zhang , Eric Liu

Spiking Neural Networks (SNNs) have attracted recent interest due to their energy efficiency and biological plausibility. However, the performance of SNNs still lags behind traditional Artificial Neural Networks (ANNs), as there is no…

Neural and Evolutionary Computing · Computer Science 2023-05-19 Henrique Branquinho , Nuno Lourenço , Ernesto Costa

The combination of Spiking Neural Networks (SNNs) with Vision Transformer architectures has garnered significant attention due to their potential for energy-efficient and high-performance computing paradigms. However, a substantial…

Computer Vision and Pattern Recognition · Computer Science 2025-06-19 Wei Hua , Chenlin Zhou , Jibin Wu , Yansong Chua , Yangyang Shu

This paper presents a PVT-resilient, subthreshold SRAM-based computing-in-memory (CIM) macro tailored for energy-efficient spiking neural networks (SNNs). The macro integrates in-situ current sensors and distributed voltage regulators to…

Event-based neuromorphic systems promise to reduce the energy consumption of deep learning tasks by replacing expensive floating point operations on dense matrices by low power sparse and asynchronous operations on spike events. While these…

Neural and Evolutionary Computing · Computer Science 2019-06-04 Johannes Christian Thiele , Olivier Bichler , Antoine Dupret

Spiking neural networks (SNN) are artificial computational models that have been inspired by the brain's ability to naturally encode and process information in the time domain. The added temporal dimension is believed to render them more…

Emerging Technologies · Computer Science 2019-05-29 S. R. Nandakumar , Irem Boybat , Manuel Le Gallo , Evangelos Eleftheriou , Abu Sebastian , Bipin Rajendran

Event-based cameras are attracting significant interest as they provide rich edge information, high dynamic range, and high temporal resolution. Many state-of-the-art event-based algorithms rely on splitting the events into fixed groups,…

Computer Vision and Pattern Recognition · Computer Science 2025-03-25 Jiahang Cao , Mingyuan Sun , Ziqing Wang , Hao Cheng , Qiang Zhang , Shibo Zhou , Renjing Xu

Spiking Neural Networks (SNNs) have emerged as a biologically inspired alternative to conventional deep networks, offering event-driven and energy-efficient computation. However, their throughput remains constrained by the serial update of…

Neural and Evolutionary Computing · Computer Science 2026-03-16 Hongyang Shang , Shuai Dong , Yahan Yang , Junyi Yang , Peng Zhou , Arindam Basu

Event-based cameras feature high temporal resolution, wide dynamic range, and low power consumption, which is ideal for high-speed and low-light object detection. Spiking neural networks (SNNs) are promising for event-based object…

Computer Vision and Pattern Recognition · Computer Science 2025-01-22 Ruixin Mao , Aoyu Shen , Lin Tang , Jun Zhou

Memristor-based Spiking Neural Networks (SNNs) with temporal spike encoding enable ultra-low-energy computation, making them ideal for battery-powered intelligent devices. This paper presents a circuit-level memristive spiking neural…

Emerging Technologies · Computer Science 2025-07-29 Santlal Prajapati , Susmita Sur-Kolay , Soumyadeep Dutta

Spiking neural networks (SNNs) have emerged as a promising alternative to artificial neural networks (ANNs), offering improved energy efficiency by leveraging sparse and event-driven computation. However, existing hardware implementations…

Hardware Architecture · Computer Science 2025-09-19 Yuehai Chen , Farhad Merchant

Event camera-based pattern recognition is a newly arising research topic in recent years. Current researchers usually transform the event streams into images, graphs, or voxels, and adopt deep neural networks for event-based classification.…

Computer Vision and Pattern Recognition · Computer Science 2025-05-06 Xiao Wang , Yao Rong , Zongzhen Wu , Lin Zhu , Bo Jiang , Jin Tang , Yonghong Tian

On-chip edge intelligence has necessitated the exploration of algorithmic techniques to reduce the compute requirements of current machine learning frameworks. This work aims to bridge the recent algorithmic progress in training Binary…

Machine Learning · Computer Science 2020-10-28 Sen Lu , Abhronil Sengupta

Neuromorphic engineering concentrates the efforts of a large number of researchers due to its great potential as a field of research, in a search for the exploitation of the advantages of the biological nervous system and the brain as a…

Neural and Evolutionary Computing · Computer Science 2022-06-09 Alvaro Ayuso-Martinez , Daniel Casanueva-Morato , Juan P. Dominguez-Morales , Angel Jimenez-Fernandez , Gabriel Jimenez-Moreno

Spiking neural networks (SNNs) are a promising paradigm for energy-efficient event-driven computation, but large-scale SNN execution remains challenging because sparse spike communication and synchronization can dominate runtime. Existing…

Hardware Architecture · Computer Science 2026-05-27 Muhammad Ihsan Al Hafiz , Artur Podobas