English
Related papers

Related papers: Reward-modulated learning using spiking neural net…

200 papers

In this paper we present a novel approach to automatically infer parameters of spiking neural networks. Neurons are modelled as timed automata waiting for inputs on a number of different channels (synapses), for a given amount of time (the…

Neurons and Cognition · Quantitative Biology 2018-08-07 Elisabetta De Maria , Cinzia Di Giusto , Laetitia Laversa

Spiking Neural Networks (SNNs) are promising brain-inspired models known for low power consumption and superior potential for temporal processing, but identifying suitable learning mechanisms remains a challenge. Despite the presence of…

Neural and Evolutionary Computing · Computer Science 2025-08-20 Yuzhe Liu , Xin Deng , Qiang Yu

Air hockey demands split-second decisions at high puck velocities, a challenge we address with a compact network of spiking neurons running on a mixed-signal analog/digital neuromorphic processor. By co-designing hardware and learning…

In this paper, we derive a new model of synaptic plasticity, based on recent algorithms for reinforcement learning (in which an agent attempts to learn appropriate actions to maximize its long-term average reward). We show that these direct…

Machine Learning · Computer Science 2019-11-19 Peter L. Bartlett , Jonathan Baxter

Adaptive methods are popular within the control literature due to the flexibility and forgiveness they offer in the area of modelling. Neural network adaptive control is favorable specifically for the powerful nature of the machine learning…

Systems and Control · Electrical Eng. & Systems 2021-07-23 Nathan Lutes , K. Krishnamurthy , Venkata Sriram Siddhardh Nadendla , S. N. Balakrishnan

The work presented here is a novel biological approach for the compliant control of a robotic arm in real time (RT). We integrate a spiking cerebellar network at the core of a feedback control loop performing torque-driven control. The…

Robotics · Computer Science 2020-04-01 Ignacio Abadia , Francisco Naveros , Jesus A. Garrido , Eduardo Ros , Niceto R. Luque

In both machine learning and in computational neuroscience, plasticity in functional neural networks is frequently expressed as gradient descent on a cost. Often, this imposes symmetry constraints that are difficult to reconcile with local…

Neurons and Cognition · Quantitative Biology 2026-04-09 Timo Gierlich , Andreas Baumbach , Akos F. Kungl , Kevin Max , Mihai A. Petrovici

This article underlines the learning and discrimination capabilities of a model of associative memory based on artificial networks of spiking neurons. Inspired from neuropsychology and neurobiology, the model implements top-down…

Neural and Evolutionary Computing · Computer Science 2016-08-16 Anthony Mouraud , Hélène Paugam-Moisy

Reinforcement learning agents based on Transformer architectures have achieved impressive performance on sequential decision-making tasks, but their reliance on dense matrix operations makes them ill-suited for energy-constrained,…

Machine Learning · Computer Science 2025-09-01 Vishal Pandey , Debasmita Biswas

Neurons communicate with downstream systems via sparse and incredibly brief electrical pulses, or spikes. Using these events, they control various targets such as neuromuscular units, neurosecretory systems, and other neurons in connected…

Neurons and Cognition · Quantitative Biology 2026-03-17 Paolo Agliati , André Urbano , Pablo Lanillos , Nasir Ahmad , Marcel van Gerven , Sander Keemink

Through the method of Learning Feedback Linearization, we seek to learn a linearizing controller to simplify the process of controlling a car to race autonomously. A soft actor-critic approach is used to learn a decoupling matrix and drift…

Optimization and Control · Mathematics 2021-10-22 Michael Estrada , Sida Li , Xiangyu Cai

We present our approach for the development, validation and deployment of a data-driven decision-making function for the automated control of a vehicle. The decisionmaking function, based on an artificial neural network is trained to steer…

The cerebellum plays a distinctive role within our motor control system to achieve fine and coordinated motions. While cerebellar lesions do not lead to a complete loss of motor functions, both action and perception are severally impacted.…

Robotics · Computer Science 2020-11-04 Omar Zahra , David Navarro-Alarcon , Silvia Tolu

Spiking neural network is a type of artificial neural network in which neurons communicate between each other with spikes. Spikes are identical Boolean events characterized by the time of their arrival. A spiking neuron has internal…

Neural and Evolutionary Computing · Computer Science 2016-02-16 Oleg Y. Sinyavskiy

Spiking neural networks play an important role in brain-like neuromorphic computations and in studying working mechanisms of neural circuits. One drawback of training a large scale spiking neural network is that updating all weights is…

Neurons and Cognition · Quantitative Biology 2024-08-15 Zhanghan Lin , Haiping Huang

Spiking neural networks are nature's versatile solution to fault-tolerant and energy efficient signal processing. To translate these benefits into hardware, a growing number of neuromorphic spiking neural network processors attempt to…

Neural and Evolutionary Computing · Computer Science 2019-05-06 Emre O. Neftci , Hesham Mostafa , Friedemann Zenke

Developments in reinforcement learning (RL) have allowed algorithms to achieve impressive performance in highly complex, but largely static problems. In contrast, biological learning seems to value efficiency of adaptation to a…

Artificial Intelligence · Computer Science 2022-05-20 Eric Chalmers , Artur Luczak

The paper presents a study of an adaptive approach to lateral skew control for an experimental railway stand. The preliminary experiments with the real experimental railway stand and simulations with its 3-D mechanical model, indicates…

Systems and Control · Computer Science 2014-03-03 Peter Mark Benes , Ivo Bukovsky , Matous Cejnek , Jan Kalivoda

The spiking neural network (SNN) mimics the information processing operation in the human brain, represents and transmits information in spike trains containing wealthy spatial and temporal information, and shows superior performance on…

Neural and Evolutionary Computing · Computer Science 2021-10-25 Guobin Shen , Dongcheng Zhao , Yi Zeng

The impressive lifelong learning in animal brains is primarily enabled by plastic changes in synaptic connectivity. Importantly, these changes are not passive, but are actively controlled by neuromodulation, which is itself under the…

Neural and Evolutionary Computing · Computer Science 2021-07-06 Thomas Miconi , Aditya Rawal , Jeff Clune , Kenneth O. Stanley