中文
相关论文

相关论文: Improving Performance of Spike-based Deep Q-Learni…

200 篇论文

In this study, we investigate the performance of Deep Q-Networks utilizing Convolutional Neural Networks (CNNs) and Transformer architectures across three different Atari games. The advent of DQNs has significantly advanced Reinforcement…

机器学习 · 计算机科学 2024-10-15 William A. Stigall

Spiking neural networks (SNNs) transmit information through discrete spikes, which performs well in processing spatial-temporal information. Due to the non-differentiable characteristic, there still exist difficulties in designing…

神经与进化计算 · 计算机科学 2021-05-28 Dongcheng Zhao , Yi Zeng , Yang Li

Spiking neural networks play an important role in brain-like neuromorphic computations and in studying working mechanisms of neural circuits. One drawback of training a large scale spiking neural network is that updating all weights is…

神经元与认知 · 定量生物学 2024-08-15 Zhanghan Lin , Haiping Huang

Spiking Neural Networks (SNNs) have recently emerged as a prominent neural computing paradigm. However, the typical shallow SNN architectures have limited capacity for expressing complex representations while training deep SNNs using input…

神经与进化计算 · 计算机科学 2020-03-26 Chankyu Lee , Syed Shakib Sarwar , Priyadarshini Panda , Gopalakrishnan Srinivasan , Kaushik Roy

Spiking Neural Networks (SNNs) exhibit exceptional energy efficiency on neuromorphic hardware due to their sparse activation patterns. However, conventional training methods based on surrogate gradients and Backpropagation Through Time…

计算机视觉与模式识别 · 计算机科学 2025-10-09 Xiaochen Zhao , Chengting Yu , Kairong Yu , Lei Liu , Aili Wang

Spiking neural networks are a promising approach towards next-generation models of the brain in computational neuroscience. Moreover, compared to classic artificial neural networks, they could serve as an energy-efficient deployment of AI…

神经与进化计算 · 计算机科学 2021-09-24 Justus F. Hübotter , Pablo Lanillos , Jakub M. Tomczak

Machine learning with artificial neural networks (ANNs), provides solutions for the growing complexity of modern communication systems. This complexity, however, increases power consumption, making the systems energy-intensive. Spiking…

信号处理 · 电气工程与系统科学 2026-01-26 Eike-Manuel Edelmann

Spiking neural networks (SNNs) offer both compelling potential advantages, including energy efficiency and low latencies and challenges including the non-differentiable nature of event spikes. Much of the initial research in this area has…

计算机视觉与模式识别 · 计算机科学 2022-02-11 Somayeh Hussaini , Michael Milford , Tobias Fischer

In the past years, artificial neural networks (ANNs) have become the de-facto standard to solve tasks in communications engineering that are difficult to solve with traditional methods. In parallel, the artificial intelligence community…

信号处理 · 电气工程与系统科学 2023-01-19 Eike-Manuel Bansbach , Alexander von Bank , Laurent Schmalen

Brain-inspired spiking neural networks (SNNs) have garnered significant research attention in algorithm design and perception applications. However, their potential in the decision-making domain, particularly in model-based reinforcement…

神经与进化计算 · 计算机科学 2025-03-20 Yinqian Sun , Feifei Zhao , Mingyang Lv , Yi Zeng

Spiking neural networks (SNNs) are promising for neuromorphic computing, but high-performing models still rely on dense multilayer architectures with substantial communication and state-storage costs. Inspired by autapses, we propose…

神经与进化计算 · 计算机科学 2026-03-27 Wuque Cai , Hongze Sun , Quan Tang , Shifeng Mao , Zhenxing Wang , Jiayi He , Duo Chen , Dezhong Yao , Daqing Guo

The brain is the perfect place to look for inspiration to develop more efficient neural networks. The inner workings of our synapses and neurons provide a glimpse at what the future of deep learning might look like. This paper serves as a…

神经与进化计算 · 计算机科学 2023-08-15 Jason K. Eshraghian , Max Ward , Emre Neftci , Xinxin Wang , Gregor Lenz , Girish Dwivedi , Mohammed Bennamoun , Doo Seok Jeong , Wei D. Lu

Spiking Neural Networks (SNNs) hold great potential to realize brain-inspired, energy-efficient computational systems. However, current SNNs still fall short in terms of multi-scale temporal processing compared to their biological…

神经与进化计算 · 计算机科学 2024-08-28 Xinyi Chen , Jibin Wu , Chenxiang Ma , Yinsong Yan , Yujie Wu , Kay Chen Tan

Deep Q-Networks algorithm (DQN) was the first reinforcement learning algorithm using deep neural network to successfully surpass human level performance in a number of Atari learning environments. However, divergent and unstable behaviour…

机器学习 · 计算机科学 2022-10-10 Adrian Ly , Richard Dazeley , Peter Vamplew , Francisco Cruz , Sunil Aryal

Neuromorphic computing has recently gained momentum with the emergence of various neuromorphic processors. As the field advances, there is an increasing focus on developing training methods that can effectively leverage the unique…

新兴技术 · 计算机科学 2025-04-15 Sanaz Mahmoodi Takaghaj , Jack Sampson

Children possess the ability to learn multiple cognitive tasks sequentially, which is a major challenge toward the long-term goal of artificial general intelligence. Existing continual learning frameworks are usually applicable to Deep…

人工智能 · 计算机科学 2023-08-10 Bing Han , Feifei Zhao , Yi Zeng , Wenxuan Pan , Guobin Shen

The spiking neural network, known as the third generation neural network, is an important network paradigm. Due to its mode of information propagation that follows biological rationality, the spiking neural network has strong energy…

神经与进化计算 · 计算机科学 2025-05-21 Zihan Dai , Huanfei Ma

In the rapid evolution of next-generation brain-inspired artificial intelligence and increasingly sophisticated electromagnetic environment, the most bionic characteristics and anti-interference performance of spiking neural networks show…

神经与进化计算 · 计算机科学 2023-09-11 Lyuyang Sima , Joseph Bucukovski , Erwan Carlson , Nicole L. Yien

Deep Q-Network (DQN) marked a major milestone for reinforcement learning, demonstrating for the first time that human-level control policies could be learned directly from raw visual inputs via reward maximization. Even years after its…

机器学习 · 计算机科学 2021-11-03 Brett Daley , Christopher Amato

While classical neural networks take a position of a leading method in the machine learning community, spiking neuromorphic systems bring attention and large projects in neuroscience. Spiking neural networks were shown to be able to…

神经与进化计算 · 计算机科学 2016-04-07 Sergei Dytckov , Masoud Daneshtalab