English
Related papers

Related papers: Tuning Synaptic Connections instead of Weights by …

200 papers

Spiking Neural Networks (SNNs) offer biologically inspired, energy-efficient alternatives to traditional Deep Neural Networks (DNNs) for real-time control systems. However, their training presents several challenges, particularly for…

Artificial Intelligence · Computer Science 2025-07-15 Ali Safa , Farida Mohsen , Ali Al-Zawqari

Deep Reinforcement Learning (RL) demonstrates excellent performance on tasks that can be solved by trained policy. It plays a dominant role among cutting-edge machine learning approaches using multi-layer Neural networks (NNs). At the same…

Machine Learning · Computer Science 2019-08-20 Devdhar Patel , Hananel Hazan , Daniel J. Saunders , Hava Siegelmann , Robert Kozma

To perform well, Deep Reinforcement Learning (DRL) methods require significant memory resources and computational time. Also, sometimes these systems need additional environment information to achieve a good reward. However, it is more…

Artificial Intelligence · Computer Science 2023-01-31 Md. Rafat Rahman Tushar , Shahnewaz Siddique

Intelligent routing plays a key role in modern communication infrastructure, including data centers, computing networks, and future 6G networks. Although reinforcement learning (RL) has shown great potential for intelligent routing, its…

Deep Reinforcement Learning (DRL) has become a powerful tool for developing control policies in queueing networks, but the common use of Multi-layer Perceptron (MLP) neural networks in these applications has significant drawbacks. MLP…

Machine Learning · Computer Science 2025-01-22 Jerrod Wigmore , Brooke Shrader , Eytan Modiano

Spiking neural network (SNN), compared with depth neural network (DNN), has faster processing speed, lower energy consumption and more biological interpretability, which is expected to approach Strong AI. Reinforcement learning is similar…

Neural and Evolutionary Computing · Computer Science 2021-08-24 Ling Zhang , Jian Cao , Yuan Zhang , Bohan Zhou , Shuo Feng

By exploiting discrete signal processing and simulating brain neuron communication, Spiking Neural Networks (SNNs) offer a low-energy alternative to Artificial Neural Networks (ANNs). However, existing SNN models, still face high…

Neural and Evolutionary Computing · Computer Science 2024-11-12 Wenxuan Pan , Feifei Zhao , Bing Han , Haibo Tong , Yi Zeng

In software-defined networking (SDN), the implementation of distributed SDN controllers, with each controller responsible for managing a specific sub-network or domain, plays a critical role in achieving a balance between centralized…

Networking and Internet Architecture · Computer Science 2024-03-15 Ioannis Panitsas , Akrit Mudvari , Leandros Tassiulas

The spiking neural network (SNN) mimics the information processing operation in the human brain, represents and transmits information in spike trains containing wealthy spatial and temporal information, and shows superior performance on…

Neural and Evolutionary Computing · Computer Science 2021-10-25 Guobin Shen , Dongcheng Zhao , Yi Zeng

Snake robots, comprised of sequentially connected joint actuators, have recently gained increasing attention in the industrial field, like life detection in narrow space. Such robots can navigate through the complex environment via the…

Machine Learning · Computer Science 2021-04-22 Yilang Liu , Amir Barati Farimani

This study proposes a hybrid curriculum reinforcement learning (CRL) framework based on a fully spiking neural network (SNN) for 9-degree-of-freedom robotic arms performing target reaching and grasping tasks. To reduce network complexity…

Robotics · Computer Science 2025-08-19 Liwen Zhang , Heng Deng , Guanghui Sun

This paper proposes a deep reinforcement learning (DRL)-based event-triggered controller design for networked artificial pancreas (AP) systems. Although existing DRL-based AP controllers typically assume periodic control updates, networked…

Systems and Control · Electrical Eng. & Systems 2026-05-18 Junya Ikemoto , Satoshi Maruyama , Kazumune Hashimoto

This paper presents novel methods for tuning inverter controller gains using deep reinforcement learning (DRL). A Simulink-developed inverter model is converted into a dynamic link library (DLL) and integrated with a Python-based RL…

Systems and Control · Electrical Eng. & Systems 2024-11-05 Shuvangkar Chandra Das , Tuyen Vu , Deepak Ramasubramanian , Evangelos Farantatos , Jianhua Zhang , Thomas Ortmeyer

Spiking Neural Networks (SNNs) are promising brain-inspired models known for low power consumption and superior potential for temporal processing, but identifying suitable learning mechanisms remains a challenge. Despite the presence of…

Neural and Evolutionary Computing · Computer Science 2025-08-20 Yuzhe Liu , Xin Deng , Qiang Yu

Neuroscientific theory suggests that dopaminergic neurons broadcast global reward prediction errors to large areas of the brain influencing the synaptic plasticity of the neurons in those regions. We build on this theory to propose a…

Machine Learning · Computer Science 2019-11-12 Sneha Aenugu , Abhishek Sharma , Sasikiran Yelamarthi , Hananel Hazan , Philip S. Thomas , Robert Kozma

Spiking neural networks (SNNs) are well known as the brain-inspired models with high computing efficiency, due to a key component that they utilize spikes as information units, close to the biological neural systems. Although spiking based…

Neural and Evolutionary Computing · Computer Science 2023-04-18 Qi Xu , Yaxin Li , Jiangrong Shen , Jian K Liu , Huajin Tang , Gang Pan

Solar sensor-based monitoring systems have become a crucial agricultural innovation, advancing farm management and animal welfare through integrating sensor technology, Internet-of-Things, and edge and cloud computing. However, the…

Machine Learning · Computer Science 2025-05-07 Dian Chen , Zelin Wan , Dong Sam Ha , Jin-Hee Cho

Artificial Spiking Neural Networks (ASNNs) promise greater information processing efficiency because of discrete event-based (i.e., spike) computation. Several Machine Learning (ML) applications use biologically inspired plasticity…

Machine Learning · Computer Science 2022-03-15 Mahima Milinda Alwis Weerasinghe , David Parry , Grace Wang , Jacqueline Whalley

Due to the highly dynamic changes in wireless network topologies, efficiently obtaining network status information and flexibly forwarding data to improve communication quality of service are important challenges. This article introduces an…

Networking and Internet Architecture · Computer Science 2023-05-19 Jinqiang Li , Miao Ye , Linqiang Huang , Xiaofang Deng , Hongbing Qiu , Yong Wang

Spiking neural networks (SNNs) are widely applied in various fields due to their energy-efficient and fast-inference capabilities. Applying SNNs to reinforcement learning (RL) can significantly reduce the computational resource requirements…

Neural and Evolutionary Computing · Computer Science 2024-04-25 Lang Qin , Ziming Wang , Runhao Jiang , Rui Yan , Huajin Tang