English
Related papers

Related papers: Gated Attention Coding for Training High-performan…

200 papers

With the continued innovations of deep neural networks, spiking neural networks (SNNs) that more closely resemble biological brain synapses have attracted attention owing to their low power consumption.However, for continuous data values,…

Neural and Evolutionary Computing · Computer Science 2021-03-02 Naoya Muramatsu , Hai-Tao Yu

Spiking Neural Networks have attracted significant attention in recent years due to their distinctive low-power characteristics. Meanwhile, Transformer models, known for their powerful self-attention mechanisms and parallel processing…

Neural and Evolutionary Computing · Computer Science 2024-12-19 Hangming Zhang , Alexander Sboev , Roman Rybka , Qiang Yu

Recent advances in Voice Activity Detection (VAD) are driven by artificial and Recurrent Neural Networks (RNNs), however, using a VAD system in battery-operated devices requires further power efficiency. This can be achieved by neuromorphic…

Audio and Speech Processing · Electrical Eng. & Systems 2020-05-01 Flavio Martinelli , Giorgia Dellaferrera , Pablo Mainar , Milos Cernak

Spiking neural networks (SNNs) aim to simulate real neural networks in the human brain with biologically plausible neurons. The leaky integrate-and-fire (LIF) neuron is one of the most widely studied SNN architectures. However, it has the…

Machine Learning · Computer Science 2024-12-03 Haoran Wang , Herui Zhang , Siyang Li , Dongrui Wu

Graph Neural Networks (GNNs) have demonstrated impressive capabilities in modeling graph-structured data, while Spiking Neural Networks (SNNs) offer high energy efficiency through sparse, event-driven computation. However, existing spiking…

Neural and Evolutionary Computing · Computer Science 2025-08-26 Bowen Zhang , Genan Dai , Hu Huang , Long Lan

The success of deep learning in the past decade is partially shrouded in the shadow of adversarial attacks. In contrast, the brain is far more robust at complex cognitive tasks. Utilizing the advantage that neurons in the brain communicate…

Neurons and Cognition · Quantitative Biology 2023-06-12 Jianhao Ding , Zhaofei Yu , Tiejun Huang , Jian K. Liu

Spiking Neural Networks (SNNs) offer high energy efficiency and event-driven computation, ideal for low-power edge AI. Their hardware implementation on FPGAs, however, faces challenges due to heavy computation, large memory use, and limited…

Hardware Architecture · Computer Science 2026-03-20 Mohammad Javad Sekonji , Ali Mahani , Maryam Mirsadeghi , Mahdi Taheri

Spike-based neuromorphic hardware has demonstrated substantial potential in low energy consumption and efficient inference. However, the direct training of deep spiking neural networks is challenging, and conversion-based methods still…

Neural and Evolutionary Computing · Computer Science 2024-06-11 Yang Li , Xiang He , Qingqun Kong , Yi Zeng

Due to the high activation sparsity and use of accumulates (AC) instead of expensive multiply-and-accumulates (MAC), neuromorphic spiking neural networks (SNNs) have emerged as a promising low-power alternative to traditional DNNs for…

Computer Vision and Pattern Recognition · Computer Science 2022-12-22 Gourav Datta , Zeyu Liu , Md Abdullah-Al Kaiser , Souvik Kundu , Joe Mathai , Zihan Yin , Ajey P. Jacob , Akhilesh R. Jaiswal , Peter A. Beerel

Spiking Neural Networks (SNNs) are bio-plausible models that hold great potential for realizing energy-efficient implementations of sequential tasks on resource-constrained edge devices. However, commercial edge platforms based on standard…

Neural and Evolutionary Computing · Computer Science 2023-09-26 Marco Paul E. Apolinario , Adarsh Kumar Kosta , Utkarsh Saxena , Kaushik Roy

One of the most exciting advancements in AI over the last decade is the wide adoption of ANNs, such as DNN and CNN, in many real-world applications. However, the underlying massive amounts of computation and storage requirement greatly…

Neural and Evolutionary Computing · Computer Science 2018-03-15 Tao Liu , Lei Jiang , Yier Jin , Gang Quan , Wujie Wen

Spiking neural networks (SNNs) are biology-inspired artificial neural networks (ANNs) that comprise of spiking neurons to process asynchronous discrete signals. While more efficient in power consumption and inference speed on the…

Neural and Evolutionary Computing · Computer Science 2021-03-02 Shikuang Deng , Shi Gu

Recent trends have shown that autonomous agents, such as Autonomous Ground Vehicles (AGVs), Unmanned Aerial Vehicles (UAVs), and mobile robots, effectively improve human productivity in solving diverse tasks. However, since these agents are…

Robotics · Computer Science 2024-06-19 Rachmad Vidya Wicaksana Putra , Alberto Marchisio , Muhammad Shafique

Event-based cameras have recently shown great potential for high-speed motion estimation owing to their ability to capture temporally rich information asynchronously. Spiking Neural Networks (SNNs), with their neuro-inspired event-driven…

Computer Vision and Pattern Recognition · Computer Science 2023-03-15 Adarsh Kumar Kosta , Kaushik Roy

Spiking Neural Networks (SNNs) have recently attracted widespread research interest as an efficient alternative to traditional Artificial Neural Networks (ANNs) because of their capability to process sparse and binary spike information and…

Neural and Evolutionary Computing · Computer Science 2023-05-30 Yuhang Li , Abhishek Moitra , Tamar Geller , Priyadarshini Panda

Spiking neural networks (SNNs) are the third generation of neural networks and can explore both rate and temporal coding for energy-efficient event-driven computation. However, the decision accuracy of existing SNN designs is contingent…

Neural and Evolutionary Computing · Computer Science 2020-02-25 Changqing Xu , Wenrui Zhang , Yu Liu , Peng Li

Graph Convolutional Networks (GCNs) achieve an impressive performance due to the remarkable representation ability in learning the graph information. However, GCNs, when implemented on a deep network, require expensive computation power,…

Machine Learning · Computer Science 2022-08-03 Zulun Zhu , Jiaying Peng , Jintang Li , Liang Chen , Qi Yu , Siqiang Luo

Spiking Neural Networks (SNNs) represent a biologically inspired paradigm offering an energy-efficient alternative to conventional artificial neural networks (ANNs) for Computer Vision (CV) applications. This paper presents a systematic…

Computer Vision and Pattern Recognition · Computer Science 2024-11-27 Craig Iaboni , Pramod Abichandani

Neuromorphic data carries information in spatio-temporal patterns encoded by spikes. Accordingly, a central problem in neuromorphic computing is training spiking neural networks (SNNs) to reproduce spatio-temporal spiking patterns in…

Machine Learning · Computer Science 2021-11-03 Bleema Rosenfeld , Osvaldo Simeone , Bipin Rajendran

Spiking Neural Networks (SNNs) are a promising, energy-efficient alternative to standard Artificial Neural Networks (ANNs) and are particularly well-suited to spatio-temporal tasks such as keyword spotting and video classification. However,…

Neural and Evolutionary Computing · Computer Science 2026-02-09 Zainab Aizaz , James C. Knight , Thomas Nowotny