English
Related papers

Related papers: Sign Gradient Descent-based Neuronal Dynamics: ANN…

200 papers

Spiking neural networks (SNNs), that operate via binary spikes distributed over time, have emerged as a promising energy efficient ML paradigm for resource-constrained devices. However, the current state-of-the-art (SOTA) SNNs require…

Computer Vision and Pattern Recognition · Computer Science 2021-12-23 Gourav Datta , Peter A. Beerel

Spiking neural networks (SNNs) with leaky integrate and fire (LIF) neurons, can be operated in an event-driven manner and have internal states to retain information over time, providing opportunities for energy-efficient neuromorphic…

Neural and Evolutionary Computing · Computer Science 2021-09-07 Wachirawit Ponghiran , Kaushik Roy

Deep learning has revolutionized artificial intelligence (AI), achieving remarkable progress in fields such as computer vision, speech recognition, and natural language processing. Moreover, the recent success of large language models…

Machine Learning · Computer Science 2024-09-05 Yangfan Hu , Qian Zheng , Guoqi Li , Huajin Tang , Gang Pan

Spiking neural networks (SNNs) promise orders-of-magnitude efficiency gains by communicating with sparse, event-driven spikes rather than dense numerical activations. However, most training pipelines either rely on surrogate-gradient…

Neural and Evolutionary Computing · Computer Science 2025-12-17 Arman Ferdowsi , Atakan Aral

Agent-based Transformers have been widely adopted in recent reinforcement learning advances due to their demonstrated ability to solve complex tasks. However, the high computational complexity of Transformers often results in significant…

Machine Learning · Computer Science 2025-05-21 Mohammad Irfan Uddin , Nishad Tasnim , Md Omor Faruk , Zejian Zhou

Spiking Neural Networks (SNNs) offer a more energy-efficient alternative to Artificial Neural Networks (ANNs) by mimicking biological neural principles, establishing them as a promising approach to mitigate the increasing energy demands of…

Machine Learning · Computer Science 2025-02-24 Velibor Bojković , Xiaofeng Wu , Bin Gu

Spiking neural networks (SNNs), particularly the single-spike variant in which neurons spike at most once, are considerably more energy efficient than standard artificial neural networks (ANNs). However, single-spike SSNs are difficult to…

Neural and Evolutionary Computing · Computer Science 2022-10-13 Luke Taylor , Andrew King , Nicol Harper

Recent years have seen significant progress in developing spiking neural networks (SNNs) as a potential solution to the energy challenges posed by conventional artificial neural networks (ANNs). However, our theoretical understanding of…

Machine Learning · Computer Science 2025-06-16 Duc Anh Nguyen , Ernesto Araya , Adalbert Fono , Gitta Kutyniok

Spiking Neural Networks (SNNs) offer a biologically inspired alternative to conventional artificial neural networks, with potential advantages in power efficiency due to their event-driven computation. Despite their promise, SNNs have yet…

Neural and Evolutionary Computing · Computer Science 2024-11-27 Wangdan Liao , Weidong Wang

As spiking neural networks (SNNs) are deployed increasingly in real-world efficiency critical applications, the security concerns in SNNs attract more attention. Currently, researchers have already demonstrated an SNN can be attacked with…

Neural and Evolutionary Computing · Computer Science 2022-05-04 Ling Liang , Kaidi Xu , Xing Hu , Lei Deng , Yuan Xie

Neuromorphic data carries information in spatio-temporal patterns encoded by spikes. Accordingly, a central problem in neuromorphic computing is training spiking neural networks (SNNs) to reproduce spatio-temporal spiking patterns in…

Machine Learning · Computer Science 2021-11-03 Bleema Rosenfeld , Osvaldo Simeone , Bipin Rajendran

Spiking neural networks (SNNs) have shown their competence in handling spatial-temporal event-based data with low energy consumption. Similar to conventional artificial neural networks (ANNs), SNNs are also vulnerable to gradient-based…

Computer Vision and Pattern Recognition · Computer Science 2025-03-07 Li Lun , Kunyu Feng , Qinglong Ni , Ling Liang , Yuan Wang , Ying Li , Dunshan Yu , Xiaoxin Cui

Spiking Neural Networks (SNNs) have recently attracted widespread research interest as an efficient alternative to traditional Artificial Neural Networks (ANNs) because of their capability to process sparse and binary spike information and…

Neural and Evolutionary Computing · Computer Science 2023-05-30 Yuhang Li , Abhishek Moitra , Tamar Geller , Priyadarshini Panda

The field of neuromorphic computing promises extremely low-power and low-latency sensing and processing. Challenges in transferring learning algorithms from traditional artificial neural networks (ANNs) to spiking neural networks (SNNs)…

Computer Vision and Pattern Recognition · Computer Science 2021-10-27 Jesse Hagenaars , Federico Paredes-Vallés , Guido de Croon

Spiking Neural Networks (SNNs) are being explored for their potential energy efficiency resulting from sparse, event-driven computations. Many recent works have demonstrated effective backpropagation for deep Spiking Neural Networks (SNNs)…

Neural and Evolutionary Computing · Computer Science 2020-03-04 Jason M. Allred , Steven J. Spencer , Gopalakrishnan Srinivasan , Kaushik Roy

Spiking Neural Networks (SNNs) are considered to have enormous potential in the future development of Artificial Intelligence due to their brain-inspired and energy-efficient properties. Compared to vanilla Spatial-Temporal Back-propagation…

Neural and Evolutionary Computing · Computer Science 2026-03-10 Zecheng Hao , Yifan Huang , Zijie Xu , Wenxuan Liu , Yuanhong Tang , Zhaofei Yu , Tiejun Huang

Spiking Neural Networks (SNNs) can do inference with low power consumption due to their spike sparsity. ANN-SNN conversion is an efficient way to achieve deep SNNs by converting well-trained Artificial Neural Networks (ANNs). However, the…

Neural and Evolutionary Computing · Computer Science 2023-03-24 Xiang He , Yang Li , Dongcheng Zhao , Qingqun Kong , Yi Zeng

Spiking Neural Networks (SNNs) are distinguished from Artificial Neural Networks (ANNs) for their complex neuronal dynamics and sparse binary activations (spikes) inspired by the biological neural system. Traditional neuron models use…

Neural and Evolutionary Computing · Computer Science 2025-10-31 Peng Xue , Wei Fang , Zhengyu Ma , Zihan Huang , Zhaokun Zhou , Yonghong Tian , Timothée Masquelier , Huihui Zhou

Spiking neural networks (SNNs) communicate via discrete spikes in time rather than continuous activations. Their event-driven nature offers advantages for temporal processing and energy efficiency on resource-constrained hardware, but…

Computer Vision and Pattern Recognition · Computer Science 2025-11-18 Karol C. Jurzec , Tomasz Szydlo , Maciej Wielgosz

We present a new back propagation based training algorithm for discrete-time spiking neural networks (SNN). Inspired by recent deep learning algorithms on binarized neural networks, binary activation with a straight-through gradient…

Neural and Evolutionary Computing · Computer Science 2017-09-20 Shihui Yin , Shreyas K. Venkataramanaiah , Gregory K. Chen , Ram Krishnamurthy , Yu Cao , Chaitali Chakrabarti , Jae-sun Seo