English
Related papers

Related papers: SpikeZIP-TF: Conversion is All You Need for Transf…

200 papers

The surge in interest in Artificial Intelligence (AI) over the past decade has been driven almost exclusively by advances in Artificial Neural Networks (ANNs). While ANNs set state-of-the-art performance for many previously intractable…

Neural and Evolutionary Computing · Computer Science 2022-09-02 Peter G. Stratton , Andrew Wabnitz , Chip Essam , Allen Cheung , Tara J. Hamilton

Event-based sensors, distinguished by their high temporal resolution of 1 $\mathrm{\mu}\text{s}$ and a dynamic range of 120 $\text{dB}$, stand out as ideal tools for deployment in fast-paced settings like vehicles and drones. Traditional…

Computer Vision and Pattern Recognition · Computer Science 2024-06-12 Hu Zhang , Yanchen Li , Luziwei Leng , Kaiwei Che , Qian Liu , Qinghai Guo , Jianxing Liao , Ran Cheng

Spiking neural networks (SNNs), that operate via binary spikes distributed over time, have emerged as a promising energy efficient ML paradigm for resource-constrained devices. However, the current state-of-the-art (SOTA) SNNs require…

Computer Vision and Pattern Recognition · Computer Science 2021-12-23 Gourav Datta , Peter A. Beerel

Spiking neural networks (SNNs) recently gained momentum due to their low-power multiplication-free computing and the closer resemblance of biological processes in the nervous system of humans. However, SNNs require very long spike trains…

Hardware Architecture · Computer Science 2022-06-07 Daniel Gerlinghoff , Zhehui Wang , Xiaozhe Gu , Rick Siow Mong Goh , Tao Luo

Several high specificity and sensitivity seizure prediction methods with convolutional neural networks (CNNs) are reported. However, CNNs are computationally expensive and power hungry. These inconveniences make CNN-based methods hard to be…

Neural and Evolutionary Computing · Computer Science 2022-08-25 Fengshi Tian , Jie Yang , Shiqi Zhao , Mohamad Sawan

In the last few years, spiking neural networks have been demonstrated to perform on par with regular convolutional neural networks. Several works have proposed methods to convert a pre-trained CNN to a Spiking CNN without a significant…

Neural and Evolutionary Computing · Computer Science 2020-05-05 Martino Sorbaro , Qian Liu , Massimo Bortone , Sadique Sheik

Spike-based Transformer presents a compelling and energy-efficient alternative to traditional Artificial Neural Network (ANN)-based Transformers, achieving impressive results through sparse binary computations. However, existing spike-based…

Neural and Evolutionary Computing · Computer Science 2025-03-04 Donghyun Lee , Yuhang Li , Youngeun Kim , Shiting Xiao , Priyadarshini Panda

Deep neural networks have been proven to be highly effective tools in various domains, yet their computational and memory costs restrict them from being widely deployed on portable devices. The recent rapid increase of edge computing…

Neural and Evolutionary Computing · Computer Science 2023-06-01 Ayan Shymyrbay , Mohammed E. Fouda , Ahmed Eltawil

The combination of Spiking Neural Networks (SNNs) with Vision Transformer architectures has garnered significant attention due to their potential for energy-efficient and high-performance computing paradigms. However, a substantial…

Computer Vision and Pattern Recognition · Computer Science 2025-06-19 Wei Hua , Chenlin Zhou , Jibin Wu , Yansong Chua , Yangyang Shu

Spiking Neural Networks (SNNs) have attracted recent interest due to their energy efficiency and biological plausibility. However, the performance of SNNs still lags behind traditional Artificial Neural Networks (ANNs), as there is no…

Neural and Evolutionary Computing · Computer Science 2023-05-19 Henrique Branquinho , Nuno Lourenço , Ernesto Costa

Spiking Neural Networks (SNNs) are developed as a promising alternative to Artificial Neural networks (ANNs) due to their more realistic brain-inspired computing models. SNNs have sparse neuron firing over time, i.e., spatio-temporal…

Hardware Architecture · Computer Science 2023-12-19 Qinyu Chen , Chang Gao , Xinyuan Fang , Haitao Luan

Biological neurons communicate with a sparing exchange of pulses - spikes. It is an open question how real spiking neurons produce the kind of powerful neural computation that is possible with deep artificial neural networks, using only so…

Neural and Evolutionary Computing · Computer Science 2016-09-08 Davide Zambrano , Sander M. Bohte

Spiking Neural Networks (SNNs) are biologically realistic and practically promising in low-power computation because of their event-driven mechanism. Usually, the training of SNNs suffers accuracy loss on various tasks, yielding an inferior…

Neural and Evolutionary Computing · Computer Science 2023-04-19 Di Hong , Jiangrong Shen , Yu Qi , Yueming Wang

Compared to traditional Artificial Neural Network (ANN), Spiking Neural Network (SNN) has garnered widespread academic interest for its intrinsic ability to transmit information in a more energy-efficient manner. However, despite previous…

Neural and Evolutionary Computing · Computer Science 2024-10-10 Zecheng Hao , Xinyu Shi , Yujia Liu , Zhaofei Yu , Tiejun Huang

Spiking Neural Networks (SNNs) that operate in an event-driven manner and employ binary spike representation have recently emerged as promising candidates for energy-efficient computing. However, a cost bottleneck arises in obtaining…

Neural and Evolutionary Computing · Computer Science 2024-01-22 Yunpeng Yao , Man Wu , Zheng Chen , Renyuan Zhang

Spiking neural networks (SNNs) have low power consumption and bio-interpretable characteristics, and are considered to have tremendous potential for energy-efficient computing. However, the exploration of SNNs on image generation tasks…

Computer Vision and Pattern Recognition · Computer Science 2024-02-27 Shu Yang , Hanzhi Ma , Chengting Yu , Aili Wang , Er-Ping Li

Over the past decade, artificial neural networks (ANNs) have made tremendous advances, in part due to the increased availability of annotated data. However, ANNs typically require significant power and memory consumptions to reach their…

Neural and Evolutionary Computing · Computer Science 2023-02-16 Ye Yue , Marc Baltes , Nidal Abujahar , Tao Sun , Charles D. Smith , Trevor Bihl , Jundong Liu

Spiking neural networks (SNNs) promise ultra-low-power applications by exploiting temporal and spatial sparsity. The number of binary activations, called spikes, is proportional to the power consumed when executed on neuromorphic hardware.…

Computer Vision and Pattern Recognition · Computer Science 2024-06-25 Gregor Lenz , Garrick Orchard , Sadique Sheik

We seek to investigate the scalability of neuromorphic computing for computer vision, with the objective of replicating non-neuromorphic performance on computer vision tasks while reducing power consumption. We convert the deep Artificial…

Neural and Evolutionary Computing · Computer Science 2021-06-17 Kinjal Patel , Eric Hunsberger , Sean Batir , Chris Eliasmith

Spiking neural networks (SNNs) are good candidates to produce ultra-energy-efficient hardware. However, the performance of these models is currently behind traditional methods. Introducing multi-layered SNNs is a promising way to reduce…

Computer Vision and Pattern Recognition · Computer Science 2019-04-04 Pierre Falez , Pierre Tirilly , Ioan Marius Bilasco , Philippe Devienne , Pierre Boulet