English
Related papers

Related papers: Plug-and-Play Spiking Operators: Breaking the Nonl…

200 papers

Artificial Neural Network (ANN) based techniques have dominated state-of-the-art results in most problems related to computer vision, audio recognition, and natural language processing in the past few years, resulting in strong industrial…

Neural and Evolutionary Computing · Computer Science 2019-06-24 Khaled F. Hussain , Mohamed Yousef Bassyouni , Erol Gelenbe

Spiking Neural Networks (SNNs) offer promising energy-efficient alternatives to large language models (LLMs) due to their event-driven nature and ultra-low power consumption. However, to preserve capacity, most existing spiking LLMs still…

Neural and Evolutionary Computing · Computer Science 2026-05-15 Sihang Guo , Chenlin Zhou , Jiaqi Wang , Kehai Chen , Qingyan Meng , Zhengyu Ma

Third-generation neural networks, or Spiking Neural Networks (SNNs), aim at harnessing the energy efficiency of spike-domain processing by building on computing elements that operate on, and exchange, spikes. In this paper, the problem of…

Machine Learning · Statistics 2018-02-23 Alireza Bagheri , Osvaldo Simeone , Bipin Rajendran

Spiking Neural Networks have attracted significant attention in recent years due to their distinctive low-power characteristics. Meanwhile, Transformer models, known for their powerful self-attention mechanisms and parallel processing…

Neural and Evolutionary Computing · Computer Science 2024-12-19 Hangming Zhang , Alexander Sboev , Roman Rybka , Qiang Yu

Spiking Neural Networks(SNNs) provide a brain-inspired and event-driven mechanism that is believed to be critical to unlock energy-efficient deep learning. The mixture-of-experts approach mirrors the parallel distributed processing of…

Neural and Evolutionary Computing · Computer Science 2024-12-10 Boxun Xu , Junyoung Hwang , Pruek Vanna-iampikul , Yuxuan Yin , Sung Kyu Lim , Peng Li

Spiking-neural-networks (SNNs) are promising at edge devices since the event-driven operations of SNNs provides significantly lower power compared to analog-neural-networks (ANNs). Although it is difficult to efficiently train SNNs, many…

Computer Vision and Pattern Recognition · Computer Science 2021-12-02 Nguyen-Dong Ho , Ik-Joon Chang

Spiking Neural Networks (SNNs) offer an attractive and energy-efficient alternative to conventional Artificial Neural Networks (ANNs) due to their sparse binary activation. When SNN meets Transformer, it shows great potential in 2D image…

Machine Learning · Computer Science 2025-02-27 Peixi Wu , Bosong Chai , Hebei Li , Menghua Zheng , Yansong Peng , Zeyu Wang , Xuan Nie , Yueyi Zhang , Xiaoyan Sun

Offline reinforcement learning (RL) enables policy training solely on pre-collected data, avoiding direct environment interaction - a crucial benefit for energy-constrained embodied AI applications. Although Artificial Neural Networks…

Machine Learning · Computer Science 2025-04-08 Wei Huang , Qinying Gu , Nanyang Ye

Artificial neural networks (ANNs), particularly large language models (LLMs), demonstrate powerful inference capabilities but consume substantial energy. Conversely, spiking neural networks (SNNs) exhibit exceptional energy efficiency due…

Machine Learning · Computer Science 2026-02-10 Chenyu Wang , Zhanglu Yan , Zhi Zhou , Xu Chen , Weng-Fai Wong

With serial and parallel processors introduced into Spiking Neural Networks (SNNs) execution, more and more researchers are dedicated to improving the performance of the computing paradigms by taking full advantage of the strengths of the…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-07-15 Jiaxin Huang , Bernhard Vogginger , Florian Kelber , Hector Gonzalez , Klaus Knobloch , Christian Georg Mayr

The combination of Spiking Neural Networks (SNNs) and Transformers has attracted significant attention due to their potential for high energy efficiency and high-performance nature. However, existing works on this topic typically rely on…

Neural and Evolutionary Computing · Computer Science 2023-07-18 Ziqing Wang , Yuetong Fang , Jiahang Cao , Qiang Zhang , Zhongrui Wang , Renjing Xu

Spiking Neural Networks (SNNs) offer a biologically inspired alternative to conventional artificial neural networks, with potential advantages in power efficiency due to their event-driven computation. Despite their promise, SNNs have yet…

Neural and Evolutionary Computing · Computer Science 2024-11-27 Wangdan Liao , Weidong Wang

Spiking neural networks (SNNs) are gaining popularity in deep learning due to their low energy budget on neuromorphic hardware. However, they still face challenges in lacking sufficient robustness to guard safety-critical applications such…

Neural and Evolutionary Computing · Computer Science 2024-06-03 Jianhao Ding , Zhiyu Pan , Yujia Liu , Zhaofei Yu , Tiejun Huang

Traditional drone-view geo-localization (DVGL) methods based on artificial neural networks (ANNs) have achieved remarkable performance. However, ANNs rely on dense computation, which results in high power consumption. In contrast, spiking…

Computer Vision and Pattern Recognition · Computer Science 2026-01-30 Zhongwei Chen , Hai-Jun Rong , Zhao-Xu Yang , Guoqi Li

In recent years, Artificial Neural Networks (ANN) have become a standard in robotic control. However, a significant drawback of large-scale ANNs is their increased power consumption. This becomes a critical concern when designing autonomous…

Robotics · Computer Science 2023-09-25 Tim Burgers , Stein Stroobants , Guido de Croon

In recent years, deep learning has been a revolution in the field of machine learning, for computer vision in particular. In this approach, a deep (multilayer) artificial neural network (ANN) is trained in a supervised manner using…

Neural and Evolutionary Computing · Computer Science 2019-01-23 Amirhossein Tavanaei , Masoud Ghodrati , Saeed Reza Kheradpisheh , Timothee Masquelier , Anthony S. Maida

Spiking Neural Networks (SNN) are third-generation Artificial Neural Networks (ANN) which are close to the biological neural system. In recent years SNN has become popular in the area of robotics and embedded applications, therefore, it has…

Neural and Evolutionary Computing · Computer Science 2020-10-06 Shikhar Gupta , Arpan Vyas , Gaurav Trivedi

This paper explores the synergistic potential of neuromorphic and edge computing to create a versatile machine learning (ML) system tailored for processing data captured by dynamic vision sensors. We construct and train hybrid models,…

Neural and Evolutionary Computing · Computer Science 2024-07-12 James Seekings , Peyton Chandarana , Mahsa Ardakani , MohammadReza Mohammadi , Ramtin Zand

As neural networks get widespread adoption in resource-constrained embedded devices, there is a growing need for low-power neural systems. Spiking Neural Networks (SNNs)are emerging to be an energy-efficient alternative to the traditional…

Machine Learning · Computer Science 2021-12-01 Yeshwanth Venkatesha , Youngeun Kim , Leandros Tassiulas , Priyadarshini Panda

Deep Reinforcement Learning (RL) demonstrates excellent performance on tasks that can be solved by trained policy. It plays a dominant role among cutting-edge machine learning approaches using multi-layer Neural networks (NNs). At the same…

Machine Learning · Computer Science 2019-08-20 Devdhar Patel , Hananel Hazan , Daniel J. Saunders , Hava Siegelmann , Robert Kozma