English
Related papers

Related papers: Tuning Synaptic Connections instead of Weights by …

200 papers

Spiking neural networks are a type of artificial neural networks in which communication between neurons is only made of events, also called spikes. This property allows neural networks to make asynchronous and sparse computations and…

Neural and Evolutionary Computing · Computer Science 2024-05-07 Florent De Geeter , Damien Ernst , Guillaume Drion

The rising demand for electricity and its essential nature in today's world calls for intelligent home energy management (HEM) systems that can reduce energy usage. This involves scheduling of loads from peak hours of the day when energy…

Signal Processing · Electrical Eng. & Systems 2020-12-30 Alwyn Mathew , Abhijit Roy , Jimson Mathew

Researchers have demonstrated that Deep Reinforcement Learning (DRL) is a powerful tool for finding policies that perform well on complex robotic systems. However, these policies are often unpredictable and can induce highly variable…

Robotics · Computer Science 2022-03-08 Sean Gillen , Asutay Ozmen , Katie Byl

Spiking Neural Networks (SNN) are energy-efficient computing architectures that exchange spikes for processing information, unlike classical Artificial Neural Networks (ANN). Due to this, SNNs are better suited for real-life deployments.…

Neural and Evolutionary Computing · Computer Science 2020-05-04 Ravi Kumar Kushawaha , Saurabh Kumar , Biplab Banerjee , Rajbabu Velmurugan

Reducing energy consumption is a critical point for neural network models running on edge devices. In this regard, reducing the number of multiply-accumulate (MAC) operations of Deep Neural Networks (DNNs) running on edge hardware…

Neural and Evolutionary Computing · Computer Science 2022-04-05 Simon Narduzzi , Siavash A. Bigdeli , Shih-Chii Liu , L. Andrea Dunbar

Communication by rare, binary spikes is a key factor for the energy efficiency of biological brains. However, it is harder to train biologically-inspired spiking neural networks (SNNs) than artificial neural networks (ANNs). This is…

Neural and Evolutionary Computing · Computer Science 2023-11-21 Ana Stanojevic , Stanisław Woźniak , Guillaume Bellec , Giovanni Cherubini , Angeliki Pantazi , Wulfram Gerstner

The massive integration of renewable-based distributed energy resources (DERs) inherently increases the energy system's complexity, especially when it comes to defining its operational schedule. Deep reinforcement learning (DRL) algorithms…

Systems and Control · Electrical Eng. & Systems 2023-05-10 Hou Shengren , Pedro P. Vergara , Edgar Mauricio Salazar Duque , Peter Palensky

Deep spiking neural networks (SNNs) support asynchronous event-driven computation, massive parallelism and demonstrate great potential to improve the energy efficiency of its synchronous analog counterpart. However, insufficient attention…

Neural and Evolutionary Computing · Computer Science 2019-02-18 Jibin Wu , Yansong Chua , Malu Zhang , Qu Yang , Guoqi Li , Haizhou Li

In this paper, we derive a new model of synaptic plasticity, based on recent algorithms for reinforcement learning (in which an agent attempts to learn appropriate actions to maximize its long-term average reward). We show that these direct…

Machine Learning · Computer Science 2019-11-19 Peter L. Bartlett , Jonathan Baxter

Spiking neural networks (SNN) are considered as a perspective basis for performing all kinds of learning tasks - unsupervised, supervised and reinforcement learning. Learning in SNN is implemented through synaptic plasticity - the rules…

Neural and Evolutionary Computing · Computer Science 2021-11-15 Mikhail Kiselev

Spiking neural networks (SNNs) process time-series data via internal event-driven neural dynamics. The energy consumption of an SNN depends on the number of spikes exchanged between neurons over the course of the input presentation.…

Neural and Evolutionary Computing · Computer Science 2024-07-02 Jiechen Chen , Sangwoo Park , Osvaldo Simeone

Autonomous mobile agents require low-power/energy-efficient machine learning (ML) algorithms to complete their ML-based tasks while adapting to diverse environments, as mobile agents are usually powered by batteries. These requirements can…

Neural and Evolutionary Computing · Computer Science 2024-04-08 Rachmad Vidya Wicaksana Putra , Muhammad Shafique

Deep Reinforcement Learning (DRL) is a powerful framework for solving complex sequential decision-making problems, particularly in robotic control. However, its practical deployment is often hindered by the substantial amount of experience…

We propose reinforcement learning on simple networks consisting of random connections of spiking neurons (both recurrent and feed-forward) that can learn complex tasks with very little trainable parameters. Such sparse and randomly…

Machine Learning · Computer Science 2019-06-06 Wachirawit Ponghiran , Gopalakrishnan Srinivasan , Kaushik Roy

Brain-inspired spiking neural networks (SNNs) have recently drawn more and more attention due to their event-driven and energy-efficient characteristics. The integration of storage and computation paradigm on neuromorphic hardwares makes…

Neural and Evolutionary Computing · Computer Science 2022-10-14 Yufei Guo , Liwen Zhang , Yuanpei Chen , Xinyi Tong , Xiaode Liu , YingLei Wang , Xuhui Huang , Zhe Ma

Spiking neural networks (SNNs), regarded as the third generation of artificial neural networks, are expected to bridge the gap between artificial intelligence and computational neuroscience. However, most mainstream SNN research directly…

Neural and Evolutionary Computing · Computer Science 2025-12-15 Yongsheng Huang , Peibo Duan , Yujie Wu , Kai Sun , Zhipeng Liu , Changsheng Zhang , Bin Zhang , Mingkun Xu

Spike-Timing-Dependent Plasticity (STDP) provides a biologically grounded learning rule for spiking neural networks (SNNs), but its reliance on precise spike timing and pairwise updates limits fast learning of weights. We introduce a…

Neural and Evolutionary Computing · Computer Science 2026-01-14 Gouri Lakshmi S , Athira Chandrasekharan , Harshit Kumar , Muhammed Sahad E , Bikas C Das , Saptarshi Bej

Deep Reinforcement Learning (DRL) is widely used in task-oriented dialogue systems to optimize dialogue policy, but it struggles to balance exploration and exploitation due to the high dimensionality of state and action spaces. This…

Computation and Language · Computer Science 2025-06-06 Yangyang Zhao , Ben Niu , Libo Qin , Shihan Wang

Spiking Neural Network (SNN) is known as the most famous brain-inspired model, but the non-differentiable spiking mechanism makes it hard to train large-scale SNNs. To facilitate the training of large-scale SNNs, many training methods are…

Neural and Evolutionary Computing · Computer Science 2023-11-10 Yudong Li , Yunlin Lei , Xu Yang

In contrast to the human ability to continuously acquire knowledge, agents struggle with the stability-plasticity dilemma in deep reinforcement learning (DRL), which refers to the trade-off between retaining existing skills (stability) and…

Artificial Intelligence · Computer Science 2025-04-14 Jiahua Lan , Sen Zhang , Haixia Pan , Ruijun Liu , Li Shen , Dacheng Tao