English
Related papers

Related papers: Deep Reinforcement Learning with Spiking Q-learnin…

200 papers

Reinforcement Learning (RL) has opened up new opportunities to enhance existing smart systems that generally include a complex decision-making process. However, modern RL algorithms, e.g., Deep Q-Networks (DQN), are based on deep neural…

Machine Learning · Computer Science 2023-06-22 Yang Ni , Danny Abraham , Mariam Issa , Yeseong Kim , Pietro Mercati , Mohsen Imani

Spiking Neural Networks (SNNs) offer a more energy-efficient alternative to Artificial Neural Networks (ANNs) by mimicking biological neural principles, establishing them as a promising approach to mitigate the increasing energy demands of…

Machine Learning · Computer Science 2025-02-24 Velibor Bojković , Xiaofeng Wu , Bin Gu

Spiking Neural Networks (SNNs) have emerged as a promising substitute for Artificial Neural Networks (ANNs) due to their advantages of fast inference and low power consumption. However, the lack of efficient training algorithms has hindered…

Neural and Evolutionary Computing · Computer Science 2025-03-06 Tong Bu , Maohua Li , Zhaofei Yu

Spiking neural networks (SNNs) are receiving increasing attention due to their low power consumption and strong bio-plausibility. Optimization of SNNs is a challenging task. Two main methods, artificial neural network (ANN)-to-SNN…

Neural and Evolutionary Computing · Computer Science 2023-05-30 Chunming Jiang , Yilei Zhang

Spiking neural networks (SNNs) take inspiration from the brain to enable energy-efficient computations. Since the advent of Transformers, SNNs have struggled to compete with artificial networks on modern sequential tasks, as they inherit…

Neural and Evolutionary Computing · Computer Science 2024-01-03 Matei Ioan Stan , Oliver Rhodes

Routing in multi-hop wireless networks is a complex problem, especially in heterogeneous networks where multiple wireless communication technologies coexist. Reinforcement learning (RL) methods, such as Q-learning, have been introduced for…

Signal Processing · Electrical Eng. & Systems 2025-08-21 Brian Kim , Justin H. Kong , Terrence J. Moore , Fikadu T. Dagefu

In the last few years, spiking neural networks have been demonstrated to perform on par with regular convolutional neural networks. Several works have proposed methods to convert a pre-trained CNN to a Spiking CNN without a significant…

Neural and Evolutionary Computing · Computer Science 2020-05-05 Martino Sorbaro , Qian Liu , Massimo Bortone , Sadique Sheik

Spiking Neural Networks (SNNs) have been attached great importance due to their biological plausibility and high energy-efficiency on neuromorphic chips. As these chips are usually resource-constrained, the compression of SNNs is thus…

Neural and Evolutionary Computing · Computer Science 2021-08-19 Yanqi Chen , Zhaofei Yu , Wei Fang , Tiejun Huang , Yonghong Tian

Spiking neural networks (SNNs) are brain-inspired energy-efficient models that encode information in spatiotemporal dynamics. Recently, deep SNNs trained directly have shown great success in achieving high performance on classification…

Computer Vision and Pattern Recognition · Computer Science 2023-07-28 Qiaoyi Su , Yuhong Chou , Yifan Hu , Jianing Li , Shijie Mei , Ziyang Zhang , Guoqi Li

Spiking neural network (SNN) is interesting due to its strong bio-plausibility and high energy efficiency. However, its performance is falling far behind conventional deep neural networks (DNNs). In this paper, considering a general class…

Machine Learning · Computer Science 2020-10-16 Shibo Zhou , Xiaohua Li

Deep reinforcement learning (DRL) methods such as the Deep Q-Network (DQN) have achieved state-of-the-art results in a variety of challenging, high-dimensional domains. This success is mainly attributed to the power of deep neural networks…

Artificial Intelligence · Computer Science 2017-11-06 Nir Levine , Tom Zahavy , Daniel J. Mankowitz , Aviv Tamar , Shie Mannor

Reducing energy consumption is a critical point for neural network models running on edge devices. In this regard, reducing the number of multiply-accumulate (MAC) operations of Deep Neural Networks (DNNs) running on edge hardware…

Neural and Evolutionary Computing · Computer Science 2022-04-05 Simon Narduzzi , Siavash A. Bigdeli , Shih-Chii Liu , L. Andrea Dunbar

The machine learning community has become increasingly interested in the energy efficiency of neural networks. The Spiking Neural Network (SNN) is a promising approach to energy-efficient computing, since its activation levels are quantized…

Machine Learning · Computer Science 2021-03-03 Aaron R. Voelker , Daniel Rasmussen , Chris Eliasmith

Spiking Neural Networks (SNNs) are distributed trainable systems whose computing elements, or neurons, are characterized by internal analog dynamics and by digital and sparse synaptic communications. The sparsity of the synaptic spiking…

Signal Processing · Electrical Eng. & Systems 2019-10-22 Hyeryung Jang , Osvaldo Simeone , Brian Gardner , André Grüning

Learning how to act when there are many available actions in each state is a challenging task for Reinforcement Learning (RL) agents, especially when many of the actions are redundant or irrelevant. In such cases, it is sometimes easier to…

Machine Learning · Computer Science 2019-02-26 Tom Zahavy , Matan Haroush , Nadav Merlis , Daniel J. Mankowitz , Shie Mannor

Brain-inspired spiking neural networks (SNNs) replace the multiply-accumulate operations of traditional neural networks by integrate-and-fire neurons, with the goal of achieving greater energy efficiency. Specialized hardware…

Neural and Evolutionary Computing · Computer Science 2023-05-10 Myat Thu Linn Aung , Daniel Gerlinghoff , Chuping Qu , Liwei Yang , Tian Huang , Rick Siow Mong Goh , Tao Luo , Weng-Fai Wong

The tremendous energy consumption of deep neural networks (DNNs) has become a serious problem in deep learning. Spiking neural networks (SNNs), which mimic the operations in the human brain, have been studied as prominent energy-efficient…

Neural and Evolutionary Computing · Computer Science 2021-06-07 Seongsik Park , Sungroh Yoon

The brain is the perfect place to look for inspiration to develop more efficient neural networks. The inner workings of our synapses and neurons provide a glimpse at what the future of deep learning might look like. This paper serves as a…

Neural and Evolutionary Computing · Computer Science 2023-08-15 Jason K. Eshraghian , Max Ward , Emre Neftci , Xinxin Wang , Gregor Lenz , Girish Dwivedi , Mohammed Bennamoun , Doo Seok Jeong , Wei D. Lu

In light of the increasing adoption of edge computing in areas such as intelligent furniture, robotics, and smart homes, this paper introduces HyperSNN, an innovative method for control tasks that uses spiking neural networks (SNNs) in…

Robotics · Computer Science 2023-08-21 Zhanglu Yan , Shida Wang , Kaiwen Tang , Weng-Fai Wong

Spiking neural networks (SNNs) offer biologically inspired computation but remain underexplored for continuous regression tasks in scientific machine learning. In this work, we introduce and systematically evaluate Quadratic…

Neural and Evolutionary Computing · Computer Science 2025-11-11 Ruyin Wan , George Em Karniadakis , Panos Stinis