English
Related papers

Related papers: Human-Level Control through Directly-Trained Deep …

200 papers

Reinforcement learning (RL) has seen great advancements in the past few years. Nevertheless, the consensus among the RL community is that currently used methods, despite all their benefits, suffer from extreme data inefficiency, especially…

Machine Learning · Computer Science 2020-04-01 Kacper Kielak

Advancements in adapting deep convolution architectures for Spiking Neural Networks (SNNs) have significantly enhanced image classification performance and reduced computational burdens. However, the inability of Multiplication-Free…

Neural and Evolutionary Computing · Computer Science 2024-04-29 Boyan Li , Luziwei Leng , Shuaijie Shen , Kaixuan Zhang , Jianguo Zhang , Jianxing Liao , Ran Cheng

Energy-efficient mapless navigation is crucial for mobile robots as they explore unknown environments with limited on-board resources. Although the recent deep reinforcement learning (DRL) approaches have been successfully applied to…

Neural and Evolutionary Computing · Computer Science 2020-08-04 Guangzhi Tang , Neelesh Kumar , Konstantinos P. Michmizos

Adaptive robot navigation in dynamic environments requires policies that can reach the target reliably while producing efficient and stable trajectories. This paper presents Q-SpiRL, a quantum spiking reinforcement learning framework for…

Spiking neural networks (SNNs) are becoming a promising alternative to conventional artificial neural networks (ANNs) due to their rich neural dynamics and the implementation of energy-efficient neuromorphic chips. However, the…

Artificial Intelligence · Computer Science 2024-08-27 Jiahao Su , Kang You , Zekai Xu , Weizhi Xu , Zhezhi He

Reinforcement Learning (RL) provides a powerful framework for decision-making in complex environments. However, implementing RL in hardware-efficient and bio-inspired ways remains a challenge. This paper presents a novel Spiking Neural…

Neural and Evolutionary Computing · Computer Science 2023-08-09 Sergio F. Chevtchenko , Yeshwanth Bethi , Teresa B. Ludermir , Saeed Afshar

Spiking Neural Networks (SNNs) have a greater potential for modeling time series data than Artificial Neural Networks (ANNs), due to their inherent neuron dynamics and low energy consumption. However, it is difficult to demonstrate their…

Neural and Evolutionary Computing · Computer Science 2024-01-22 Chenxi Sun , Hongyan Li , Moxian Song , Derun Can , Shenda Hong

Spiking Neural Networks (SNNs) offer a promising alternative to conventional Artificial Neural Networks (ANNs) for the implementation of on-device low-power online learning and inference. On-device training is, however, constrained by the…

Machine Learning · Computer Science 2019-10-24 Nicolas Skatchkovsky , Hyeryung Jang , Osvaldo Simeone

Spiking neural networks (SNNs) are posited as a computationally efficient and biologically plausible alternative to conventional neural architectures, with their core computational framework primarily using the leaky integrate-and-fire…

Neural and Evolutionary Computing · Computer Science 2025-03-18 Malyaban Bal , Abhronil Sengupta

The deep reinforcement learning method usually requires a large number of training images and executing actions to obtain sufficient results. When it is extended a real-task in the real environment with an actual robot, the method will be…

Computer Vision and Pattern Recognition · Computer Science 2018-06-05 Daiki Kimura

Spiking neural networks (SNNs) have closer dynamics to the brain than current deep neural networks. Their low power consumption and sample efficiency make these networks interesting. Recently, several deep convolutional spiking neural…

Computer Vision and Pattern Recognition · Computer Science 2022-11-01 Shahriar Rezghi Shirsavar , Mohammad-Reza A. Dehaqani

This work introduces a spike-based wearable analytics system utilizing Spiking Neural Networks (SNNs) deployed on an In-memory Computing engine based on RRAM crossbars, which are known for their compactness and energy-efficiency. Given the…

Emerging Technologies · Computer Science 2025-02-11 Abhiroop Bhattacharjee , Jinquan Shi , Wei-Chen Chen , Xinxin Wang , Priyadarshini Panda

Due to their proven efficiency, machine-learning systems are deployed in a wide range of complex real-life problems. More specifically, Spiking Neural Networks (SNNs) emerged as a promising solution to the accuracy, resource-utilization,…

Cryptography and Security · Computer Science 2021-01-26 Valerio Venceslai , Alberto Marchisio , Ihsen Alouani , Maurizio Martina , Muhammad Shafique

Spiking Neural Networks (SNN) are quickly gaining traction as a viable alternative to Deep Neural Networks (DNN). In comparison to DNNs, SNNs are more computationally powerful and provide superior energy efficiency. SNNs, while exciting at…

Artificial Intelligence · Computer Science 2022-04-12 Karthikeyan Nagarajan , Junde Li , Sina Sayyah Ensan , Mohammad Nasim Imtiaz Khan , Sachhidh Kannan , Swaroop Ghosh

Deep Q Network (DQN) firstly kicked the door of deep reinforcement learning (DRL) via combining deep learning (DL) with reinforcement learning (RL), which has noticed that the distribution of the acquired data would change during the…

Machine Learning · Computer Science 2022-01-11 Jiajun Fan , Changnan Xiao , Yue Huang

Tiny Machine Learning (TinyML) has become a growing field in on-device processing for Internet of Things (IoT) applications, capitalizing on AI algorithms that are optimized for their low complexity and energy efficiency. These algorithms…

Hardware Architecture · Computer Science 2024-11-05 Asmer Hamid Ali , Mozhgan Navardi , Tinoosh Mohsenin

The model-driven power allocation (PA) algorithms in the wireless cellular networks with interfering multiple-access channel (IMAC) have been investigated for decades. Nowadays, the data-driven model-free machine learning-based approaches…

Information Theory · Computer Science 2018-12-10 Fan Meng , Peng Chen , Lenan Wu

Single Flux Quantum (SFQ) technology represents a groundbreaking advancement in computational efficiency and ultra-high-speed neuromorphic processing. The key features of SFQ technology, particularly data representation, transmission, and…

Emerging Technologies · Computer Science 2024-03-06 Mustafa Altay Karamuftuoglu , Beyza Zeynep Ucpinar , Sasan Razmkhah , Mehdi Kamal , Massoud Pedram

In this paper, a novel training paradigm inspired by quantum computation is proposed for deep reinforcement learning (DRL) with experience replay. In contrast to traditional experience replay mechanism in DRL, the proposed deep…

Machine Learning · Computer Science 2021-01-07 Qing Wei , Hailan Ma , Chunlin Chen , Daoyi Dong

The spiking neural network, known as the third generation neural network, is an important network paradigm. Due to its mode of information propagation that follows biological rationality, the spiking neural network has strong energy…

Neural and Evolutionary Computing · Computer Science 2025-05-21 Zihan Dai , Huanfei Ma