English
Related papers

Related papers: Adaptive Spiking Neurons for Vision and Language M…

200 papers

Spiking Neural Networks (SNNs) have recently emerged as a prominent neural computing paradigm. However, the typical shallow SNN architectures have limited capacity for expressing complex representations while training deep SNNs using input…

Neural and Evolutionary Computing · Computer Science 2020-03-26 Chankyu Lee , Syed Shakib Sarwar , Priyadarshini Panda , Gopalakrishnan Srinivasan , Kaushik Roy

Neuromorphic computing and, in particular, spiking neural networks (SNNs) have become an attractive alternative to deep neural networks for a broad range of signal processing applications, processing static and/or temporal inputs from…

Hardware Architecture · Computer Science 2023-12-05 Souvik Kundu , Rui-Jie Zhu , Akhilesh Jaiswal , Peter A. Beerel

Spiking neural networks (SNNs), inspired by the spiking behavior of biological neurons, provide a unique pathway for capturing the intricacies of temporal data. However, applying SNNs to time-series forecasting is challenging due to…

Neural and Evolutionary Computing · Computer Science 2024-05-30 Changze Lv , Yansen Wang , Dongqi Han , Xiaoqing Zheng , Xuanjing Huang , Dongsheng Li

Spiking Neural Networks (SNNs) have attracted enormous research interest due to temporal information processing capability, low power consumption, and high biological plausibility. However, the formulation of efficient and high-performance…

Neural and Evolutionary Computing · Computer Science 2021-08-18 Wei Fang , Zhaofei Yu , Yanqi Chen , Timothee Masquelier , Tiejun Huang , Yonghong Tian

Spiking Neural Networks (SNNs) have been attached great importance due to the distinctive properties of low power consumption, biological plausibility, and adversarial robustness. The most effective way to train deep SNNs is through…

Neural and Evolutionary Computing · Computer Science 2022-02-04 Tong Bu , Jianhao Ding , Zhaofei Yu , Tiejun Huang

Spiking Neural Networks (SNNs) emerged as a promising solution in the field of Artificial Neural Networks (ANNs), attracting the attention of researchers due to their ability to mimic the human brain and process complex information with…

Neural and Evolutionary Computing · Computer Science 2023-09-12 Pavithra Koralalage , Ireoluwa Fakeye , Pedro Machado , Jason Smith , Isibor Kennedy Ihianle , Salisu Wada Yahaya , Andreas Oikonomou , Ahmad Lotfi

Spiking Neural Networks (SNNs) hold great potential to realize brain-inspired, energy-efficient computational systems. However, current SNNs still fall short in terms of multi-scale temporal processing compared to their biological…

Neural and Evolutionary Computing · Computer Science 2024-08-28 Xinyi Chen , Jibin Wu , Chenxiang Ma , Yinsong Yan , Yujie Wu , Kay Chen Tan

Over the past decade, artificial neural networks (ANNs) have made tremendous advances, in part due to the increased availability of annotated data. However, ANNs typically require significant power and memory consumptions to reach their…

Neural and Evolutionary Computing · Computer Science 2023-02-16 Ye Yue , Marc Baltes , Nidal Abujahar , Tao Sun , Charles D. Smith , Trevor Bihl , Jundong Liu

We propose a new learning algorithm to train spiking neural networks (SNN) using conventional artificial neural networks (ANN) as proxy. We couple two SNN and ANN networks, respectively, made of integrate-and-fire (IF) and ReLU neurons with…

Neural and Evolutionary Computing · Computer Science 2022-08-02 Saeed Reza Kheradpisheh , Maryam Mirsadeghi , Timothée Masquelier

We seek to investigate the scalability of neuromorphic computing for computer vision, with the objective of replicating non-neuromorphic performance on computer vision tasks while reducing power consumption. We convert the deep Artificial…

Neural and Evolutionary Computing · Computer Science 2021-06-17 Kinjal Patel , Eric Hunsberger , Sean Batir , Chris Eliasmith

One of the most exciting advancements in AI over the last decade is the wide adoption of ANNs, such as DNN and CNN, in many real-world applications. However, the underlying massive amounts of computation and storage requirement greatly…

Neural and Evolutionary Computing · Computer Science 2018-03-15 Tao Liu , Lei Jiang , Yier Jin , Gang Quan , Wujie Wen

Biologically-inspired Spiking Neural Networks (SNNs), processing information using discrete-time events known as spikes rather than continuous values, have garnered significant attention due to their hardware-friendly and energy-efficient…

Neural and Evolutionary Computing · Computer Science 2023-08-21 Bin Lei , Sheng Lin , Pei-Hung Lin , Chunhua Liao , Caiwen Ding

Spiking Neural Networks (SNNs) have emerged as an attractive spatio-temporal computing paradigm for complex vision tasks. However, most existing works yield models that require many time steps and do not leverage the inherent temporal…

Neural and Evolutionary Computing · Computer Science 2022-10-25 Gourav Datta , Haoqin Deng , Robert Aviles , Peter A. Beerel

Spiking neural networks (SNNs) are gaining popularity in the computational simulation and artificial intelligence fields owing to their biological plausibility and computational efficiency. This paper explores the historical development of…

Neural and Evolutionary Computing · Computer Science 2024-08-29 Tianyu Zheng , Liyuan Han , Tielin Zhang

Spiking neural networks (SNNs) have emerged as a class of bio -inspired networks that leverage sparse, event-driven signaling to achieve low-power computation while inherently modeling temporal dynamics. Such characteristics align closely…

Neural and Evolutionary Computing · Computer Science 2025-06-03 Hemanth Sabbella , Archit Mukherjee , Thivya Kandappu , Sounak Dey , Arpan Pal , Archan Misra , Dong Ma

Spiking Neural Networks (SNNs) have emerged as a promising alternative to conventional Artificial Neural Networks (ANNs), demonstrating comparable performance in both visual and linguistic tasks while offering the advantage of improved…

Neural and Evolutionary Computing · Computer Science 2025-05-22 Changze Lv , Tianlong Li , Wenhao Liu , Yufei Gu , Jianhan Xu , Cenyuan Zhang , Muling Wu , Xiaoqing Zheng , Xuanjing Huang

$\textbf{Formal version available at}$ https://cell.com/patterns/fulltext/S2666-3899(23)00200-3 Networks of spiking neurons underpin the extraordinary information-processing capabilities of the brain and have become pillar models in…

Neural and Evolutionary Computing · Computer Science 2023-09-18 Gehua Ma , Rui Yan , Huajin Tang

As the size of large language models continue to scale, so does the computational resources required to run it. Spiking Neural Networks (SNNs) have emerged as an energy-efficient approach to deep learning that leverage sparse and…

Computation and Language · Computer Science 2024-07-12 Rui-Jie Zhu , Qihang Zhao , Guoqi Li , Jason K. Eshraghian

The remarkable success of Vision Transformers in Artificial Neural Networks (ANNs) has led to a growing interest in incorporating the self-attention mechanism and transformer-based architecture into Spiking Neural Networks (SNNs). While…

Neural and Evolutionary Computing · Computer Science 2024-03-29 Xinyu Shi , Zecheng Hao , Zhaofei Yu

Spiking Neural Networks (SNNs) bear the potential of efficient unsupervised and continual learning capabilities because of their biological plausibility, but their complexity still poses a serious research challenge to enable their…

Neural and Evolutionary Computing · Computer Science 2023-03-06 Rachmad Vidya Wicaksana Putra , Muhammad Shafique