English
Related papers

Related papers: Elastic Spiking Transformers for Efficient Gesture…

200 papers

Spiking Neural Networks (SNNs) provide an energy-efficient deep learning option due to their unique spike-based event-driven (i.e., spike-driven) paradigm. In this paper, we incorporate the spike-driven paradigm into Transformer by the…

Neural and Evolutionary Computing · Computer Science 2023-07-06 Man Yao , Jiakui Hu , Zhaokun Zhou , Li Yuan , Yonghong Tian , Bo Xu , Guoqi Li

Graph Neural Networks (GNNs) have demonstrated impressive capabilities in modeling graph-structured data, while Spiking Neural Networks (SNNs) offer high energy efficiency through sparse, event-driven computation. However, existing spiking…

Neural and Evolutionary Computing · Computer Science 2025-08-26 Bowen Zhang , Genan Dai , Hu Huang , Long Lan

As neural networks get widespread adoption in resource-constrained embedded devices, there is a growing need for low-power neural systems. Spiking Neural Networks (SNNs)are emerging to be an energy-efficient alternative to the traditional…

Machine Learning · Computer Science 2021-12-01 Yeshwanth Venkatesha , Youngeun Kim , Leandros Tassiulas , Priyadarshini Panda

Spiking neural networks (SNNs) take inspiration from the brain to enable energy-efficient computations. Since the advent of Transformers, SNNs have struggled to compete with artificial networks on modern sequential tasks, as they inherit…

Neural and Evolutionary Computing · Computer Science 2024-01-03 Matei Ioan Stan , Oliver Rhodes

Spiking neural networks (SNNs) with adaptive synapses reflect core properties of biological neural networks. Speech recognition, as an application involving audio coding and dynamic learning, provides a good test problem to study SNN…

Neural and Evolutionary Computing · Computer Science 2017-03-14 Amirhossein Tavanaei , Anthony S Maida

Biological spiking neurons with intrinsic dynamics underlie the powerful representation and learning capabilities of the brain for processing multimodal information in complex environments. Despite recent tremendous progress in spiking…

Neural and Evolutionary Computing · Computer Science 2021-07-15 Mingkun Xu , Yujie Wu , Lei Deng , Faqiang Liu , Guoqi Li , Jing Pei

Spiking Neural Networks (SNNs) are distinguished from Artificial Neural Networks (ANNs) for their complex neuronal dynamics and sparse binary activations (spikes) inspired by the biological neural system. Traditional neuron models use…

Neural and Evolutionary Computing · Computer Science 2025-10-31 Peng Xue , Wei Fang , Zhengyu Ma , Zihan Huang , Zhaokun Zhou , Yonghong Tian , Timothée Masquelier , Huihui Zhou

Neuromorphic vision systems based on spiking neural networks (SNNs) offer ultra-low-power perception for event-based and frame-based cameras, yet catastrophic forgetting remains a critical barrier to deployment in continually evolving…

Neural and Evolutionary Computing · Computer Science 2026-03-11 Anika Tabassum Meem , Muntasir Hossain Nadid , Md Zesun Ahmed Mia

Spiking neural networks (SNNs) have become an interesting alternative to conventional artificial neural networks (ANN) thanks to their temporal processing capabilities and energy efficient implementations in neuromorphic hardware. However…

Machine Learning · Computer Science 2022-09-22 Alex Vicente-Sola , Davide L. Manna , Paul Kirkland , Gaetano Di Caterina , Trevor Bihl

Artificial Neural Networks (ANNs) are bio-inspired models of neural computation that have proven highly effective. Still, ANNs lack a natural notion of time, and neural units in ANNs exchange analog values in a frame-based manner, a…

Neural and Evolutionary Computing · Computer Science 2017-10-16 Davide Zambrano , Roeland Nusselder , H. Steven Scholte , Sander Bohte

Spiking neural network (SNN) is interesting both theoretically and practically because of its strong bio-inspiration nature and potentially outstanding energy efficiency. Unfortunately, its development has fallen far behind the conventional…

Computer Vision and Pattern Recognition · Computer Science 2021-09-20 Shibo Zhou , Xiaohua LI , Ying Chen , Sanjeev T. Chandrasekaran , Arindam Sanyal

Spiking neural networks (SNNs) show great potential due to their energy efficiency, fast processing capabilities, and robustness. There are two main approaches to constructing SNNs. Direct training methods require much memory, while…

Computer Vision and Pattern Recognition · Computer Science 2025-03-03 Zihan Huang , Xinyu Shi , Zecheng Hao , Tong Bu , Jianhao Ding , Zhaofei Yu , Tiejun Huang

Spiking Neural Networks (SNNs) are inspired by the sparse and event-driven nature of biological neural processing, and offer the potential for ultra-low-power artificial intelligence. However, realizing their efficiency benefits requires…

Hardware Architecture · Computer Science 2024-08-27 Ilkin Aliyev , Kama Svoboda , Tosiron Adegbija , Jean-Marc Fellous

Spiking neural networks (SNNs) support energy-efficient machine intelligence because event-driven computation and sparse activity map naturally to low-power digital hardware. In practical implementations, however, membrane states, synaptic…

Neural and Evolutionary Computing · Computer Science 2026-04-02 Lei Zhang

Foundational models based on the transformer architecture are currently the state-of-the-art in general language modeling, as well as in scientific areas such as material science and climate. However, training and deploying these models is…

Machine Learning · Computer Science 2025-10-16 Adarsha Balaji , Sandeep Madireddy , Prasanna Balaprakash

Hardware accelerators are essential for achieving low-latency, energy-efficient inference in edge applications like image recognition. Spiking Neural Networks (SNNs) are particularly promising due to their event-driven and temporally sparse…

Neural and Evolutionary Computing · Computer Science 2026-02-25 Alessio Caviglia , Filippo Marostica , Alessio Carpegna , Alessandro Savino , Stefano Di Carlo

Spiking Neural Networks (SNNs) offer a more energy-efficient alternative to Artificial Neural Networks (ANNs) by mimicking biological neural principles, establishing them as a promising approach to mitigate the increasing energy demands of…

Machine Learning · Computer Science 2025-02-24 Velibor Bojković , Xiaofeng Wu , Bin Gu

Graph representation learning has become a crucial task in machine learning and data mining due to its potential for modeling complex structures such as social networks, chemical compounds, and biological systems. Spiking neural networks…

Artificial Intelligence · Computer Science 2024-03-27 Huifeng Yin , Mingkun Xu , Jing Pei , Lei Deng

Spiking neural networks (SNNs), inspired by the spiking behavior of biological neurons, provide a unique pathway for capturing the intricacies of temporal data. However, applying SNNs to time-series forecasting is challenging due to…

Neural and Evolutionary Computing · Computer Science 2024-05-30 Changze Lv , Yansen Wang , Dongqi Han , Xiaoqing Zheng , Xuanjing Huang , Dongsheng Li

Embedded AI systems are expected to incur low power/energy consumption for solving machine learning tasks, as these systems are usually power constrained (e.g., object recognition task in autonomous mobile agents with portable batteries).…

Neural and Evolutionary Computing · Computer Science 2025-07-04 Rachmad Vidya Wicaksana Putra , Muhammad Shafique