English
Related papers

Related papers: Deep Reinforcement Learning with Population-Coded …

200 papers

Neuromorphic engineers aim to develop event-based spiking neural networks (SNNs) in hardware. These SNNs closer resemble dynamics of biological neurons than todays' artificial neural networks and achieve higher efficiency thanks to the…

Neurons and Cognition · Quantitative Biology 2019-06-25 Hajar Asgari , BabakMazloom-Nezhad Maybodi , Raphaela Kreiser , Yulia Sandamirskaya

Despite recent progress in training spiking neural networks (SNNs) for classification, their application to continuous motor control remains limited. Here, we demonstrate that fully spiking architectures can be trained end-to-end to control…

Robotics · Computer Science 2026-02-04 Justus Huebotter , Pablo Lanillos , Marcel van Gerven , Serge Thill

The spiking neural network (SNN) mimics the information processing operation in the human brain, represents and transmits information in spike trains containing wealthy spatial and temporal information, and shows superior performance on…

Neural and Evolutionary Computing · Computer Science 2021-10-25 Guobin Shen , Dongcheng Zhao , Yi Zeng

Autonomous obstacle avoidance is of vital importance for an intelligent agent such as a mobile robot to navigate in its environment. Existing state-of-the-art methods train a spiking neural network (SNN) with deep reinforcement learning…

Robotics · Computer Science 2023-10-05 Yang Wang , Bo Dong , Yuji Zhang , Yunduo Zhou , Haiyang Mei , Ziqi Wei , Xin Yang

Spiking neural networks (SNNs), particularly the single-spike variant in which neurons spike at most once, are considerably more energy efficient than standard artificial neural networks (ANNs). However, single-spike SSNs are difficult to…

Neural and Evolutionary Computing · Computer Science 2022-10-13 Luke Taylor , Andrew King , Nicol Harper

Spiking neural networks (SNNs) that enables energy efficient implementation on emerging neuromorphic hardware are gaining more attention. Yet now, SNNs have not shown competitive performance compared with artificial neural networks (ANNs),…

Neural and Evolutionary Computing · Computer Science 2018-11-26 Yujie Wu , Lei Deng , Guoqi Li , Jun Zhu , Luping Shi

Brain-inspired spiking neural networks (SNNs) have garnered significant research attention in algorithm design and perception applications. However, their potential in the decision-making domain, particularly in model-based reinforcement…

Neural and Evolutionary Computing · Computer Science 2025-03-20 Yinqian Sun , Feifei Zhao , Mingyang Lv , Yi Zeng

Spiking neural networks (SNNs) are gaining popularity in deep learning due to their low energy budget on neuromorphic hardware. However, they still face challenges in lacking sufficient robustness to guard safety-critical applications such…

Neural and Evolutionary Computing · Computer Science 2024-06-03 Jianhao Ding , Zhiyu Pan , Yujia Liu , Zhaofei Yu , Tiejun Huang

With the rapid development of deep learning, Deep Spiking Neural Networks (DSNNs) have emerged as promising due to their unique spike event processing and asynchronous computation. When deployed on neuromorphic chips, DSNNs offer…

Neural and Evolutionary Computing · Computer Science 2024-07-15 Hui Xie , Ge Yang , Wenjuan Gao

Reinforcement learning agents based on Transformer architectures have achieved impressive performance on sequential decision-making tasks, but their reliance on dense matrix operations makes them ill-suited for energy-constrained,…

Machine Learning · Computer Science 2025-09-01 Vishal Pandey , Debasmita Biswas

Spiking neural networks (SNNs), regarded as the third generation of artificial neural networks, are expected to bridge the gap between artificial intelligence and computational neuroscience. However, most mainstream SNN research directly…

Neural and Evolutionary Computing · Computer Science 2025-12-15 Yongsheng Huang , Peibo Duan , Yujie Wu , Kai Sun , Zhipeng Liu , Changsheng Zhang , Bin Zhang , Mingkun Xu

Spiking neural networks (SNNs) offer a promising pathway to implement deep neural networks (DNNs) in a more energy-efficient manner since their neurons are sparsely activated and inferences are event-driven. However, there have been very…

Neural and Evolutionary Computing · Computer Science 2024-06-28 Changze Lv , Jianhan Xu , Xiaoqing Zheng

Recent advancements in legged robots using deep reinforcement learning have led to significant progress. Quadruped robots can perform complex tasks in challenging environments, while bipedal and humanoid robots have also achieved…

Robotics · Computer Science 2024-09-17 Xiaoyang Jiang , Qiang Zhang , Jingkai Sun , Jiahang Cao , Jingtong Ma , Renjing Xu

$\textbf{Formal version available at}$ https://cell.com/patterns/fulltext/S2666-3899(23)00200-3 Networks of spiking neurons underpin the extraordinary information-processing capabilities of the brain and have become pillar models in…

Neural and Evolutionary Computing · Computer Science 2023-09-18 Gehua Ma , Rui Yan , Huajin Tang

As neural interfaces become more advanced, there has been an increase in the volume and complexity of neural data recordings. These interfaces capture rich information about neural dynamics that call for efficient, real-time processing…

Neural and Evolutionary Computing · Computer Science 2024-08-26 Sai Deepesh Pokala , Marie Bernert , Takuya Nanami , Takashi Kohno , Timothée Lévi , Blaise Yvert

Radio Frequency (RF) sensing holds the potential for enabling pervasive monitoring applications. However, modern sensing algorithms imply complex operations, which clash with the energy-constrained nature of edge sensing devices. This calls…

Signal Processing · Electrical Eng. & Systems 2024-01-30 Eleonora Cicciarella , Riccardo Mazzieri , Jacopo Pegoraro , Michele Rossi

Deep 'Analog Artificial Neural Networks' (ANNs) perform complex classification problems with remarkably high accuracy. However, they rely on humongous amount of power to perform the calculations, veiling the accuracy benefits. The…

Emerging Technologies · Computer Science 2018-04-17 Parami Wijesinghe , Aayush Ankit , Abhronil Sengupta , Kaushik Roy

Spiking Neural Networks (SNNs) that operate in an event-driven manner and employ binary spike representation have recently emerged as promising candidates for energy-efficient computing. However, a cost bottleneck arises in obtaining…

Neural and Evolutionary Computing · Computer Science 2024-01-22 Yunpeng Yao , Man Wu , Zheng Chen , Renyuan Zhang

Spiking neural networks (SNNs) represent the most prominent biologically inspired computing model for neuromorphic computing (NC) architectures. However, due to the non-differentiable nature of spiking neuronal functions, the standard error…

Neural and Evolutionary Computing · Computer Science 2020-07-01 Jibin Wu , Yansong Chua , Malu Zhang , Guoqi Li , Haizhou Li , Kay Chen Tan

With the increasing application scope of spiking neural networks (SNN), the complexity of SNN models has surged, leading to an exponential growth in demand for AI computility. As the new generation computing architecture of the neural…

Hardware Architecture · Computer Science 2025-05-21 Xueke Zhu , Wenjie Lin , Yanyu Lin , Yunhao Ma , Wenxiang Cheng , Zhengyu Ma , Yonghong Tian , Huihui Zhou