English
Related papers

Related papers: Reward-modulated learning using spiking neural net…

200 papers

Neuromodulation plays a fundamental role in the acquisition of new behaviours. Our experimental findings show that, whereas acetylcholine biases hippocampal synaptic plasticity towards depression, the subsequent application of dopamine can…

Neurons and Cognition · Quantitative Biology 2017-10-06 Sara Zannone , Zuzanna Brzosko , Ole Paulsen , Claudia Clopath

The problem of training spiking neural networks (SNNs) is a necessary precondition to understanding computations within the brain, a field still in its infancy. Previous work has shown that supervised learning in multi-layer SNNs enables…

Neural and Evolutionary Computing · Computer Science 2018-03-12 Amirhossein Tavanaei , Anthony S. Maida

Synaptic delays play a crucial role in biological neuronal networks, where their modulation has been observed in mammalian learning processes. In the realm of neuromorphic computing, although spiking neural networks (SNNs) aim to emulate…

Neural and Evolutionary Computing · Computer Science 2025-06-19 Marissa Dominijanni , Alexander Ororbia , Kenneth W. Regan

Recent developments in multi-agent imitation learning have shown promising results for modeling the behavior of human drivers. However, it is challenging to capture emergent traffic behaviors that are observed in real-world datasets. Such…

Humans and animals can learn complex predictive models that allow them to accurately and reliably reason about real-world phenomena, and they can adapt such models extremely quickly in the face of unexpected changes. Deep neural network…

Machine Learning · Computer Science 2019-01-30 Anusha Nagabandi , Chelsea Finn , Sergey Levine

Imitation learning is a promising approach to end-to-end training of autonomous vehicle controllers. Typically the driving process with such approaches is entirely automatic and black-box, although in practice it is desirable to control the…

Robotics · Computer Science 2020-11-23 Renhao Wang , Adam Scibior , Frank Wood

We propose a biologically inspired model of spiking neurons based on the dynamics of a damped, driven pendulum. Unlike traditional models such as the Leaky Integrate-and-Fire (LIF) neurons, the pendulum neuron incorporates second-order,…

Neural and Evolutionary Computing · Computer Science 2025-07-31 Joy Bose

Despite recent progress in training spiking neural networks (SNNs) for classification, their application to continuous motor control remains limited. Here, we demonstrate that fully spiking architectures can be trained end-to-end to control…

Robotics · Computer Science 2026-02-04 Justus Huebotter , Pablo Lanillos , Marcel van Gerven , Serge Thill

Animals excel at adapting their intentions, attention, and actions to the environment, making them remarkably efficient at interacting with a rich, unpredictable and ever-changing external world, a property that intelligent machines…

Machine Learning · Computer Science 2019-12-09 Nicolas Vecoven , Damien Ernst , Antoine Wehenkel , Guillaume Drion

The backpropagation algorithm has promoted the rapid development of deep learning, but it relies on a large amount of labeled data and still has a large gap with how humans learn. The human brain can quickly learn various conceptual…

Neural and Evolutionary Computing · Computer Science 2023-04-25 Yiting Dong , Dongcheng Zhao , Yang Li , Yi Zeng

Compliant robots can be more versatile than traditional robots, but their control is more complex. The dynamics of compliant bodies can however be turned into an advantage using the physical reservoir computing frame-work. By feeding sensor…

Neural and Evolutionary Computing · Computer Science 2020-04-15 Alexander Vandesompele , Gabriel Urbain , Francis wyffels , Joni Dambre

Spiking neural networks (SNNs) are distributed trainable systems whose computing elements, or neurons, are characterized by internal analog dynamics and by digital and sparse synaptic communications. The sparsity of the synaptic spiking…

Machine Learning · Computer Science 2020-01-08 Hyeryung Jang , Osvaldo Simeone , Brian Gardner , André Grüning

Spiking neural networks (SNNs) transmit information through discrete spikes, which performs well in processing spatial-temporal information. Due to the non-differentiable characteristic, there still exist difficulties in designing…

Neural and Evolutionary Computing · Computer Science 2021-05-28 Dongcheng Zhao , Yi Zeng , Yang Li

This paper discusses the systematic design of an adaptive feedback linearizing neurocontroller for a high-order model of the synchronous machine/infinite bus power system. The power system is first modelled as an input-output nonlinear…

Optimization and Control · Mathematics 2007-05-23 Kingsley Fregene , Diane Kennedy

The increasing demands for high accuracy in mechatronic systems necessitate the incorporation of parameter variations in feedforward control. The aim of this paper is to develop a data-driven approach for direct learning of…

Systems and Control · Electrical Eng. & Systems 2025-05-14 Max van Haren , Lennart Blanken , Tom Oomen

Computational modeling is becoming a widely used methodology in modern neuroscience. However, as the complexity of the phenomena under study increases, the analysis of the results emerging from the simulations concomitantly becomes more…

Neurons and Cognition · Quantitative Biology 2020-03-16 Sergio E. Galindo , Pablo Toharia , Oscar D. Robles , Eduardo Ros , Luis Pastor , Jesús A. Garrido

Autonomous Driving (AD) systems are considered as the future of human mobility and transportation. Solving computer vision tasks such as image classification and object detection/segmentation, with high accuracy and low power/energy…

Neural and Evolutionary Computing · Computer Science 2025-01-22 Iqra Bano , Rachmad Vidya Wicaksana Putra , Alberto Marchisio , Muhammad Shafique

Spiking neural networks (SNN) are artificial computational models that have been inspired by the brain's ability to naturally encode and process information in the time domain. The added temporal dimension is believed to render them more…

Emerging Technologies · Computer Science 2019-05-29 S. R. Nandakumar , Irem Boybat , Manuel Le Gallo , Evangelos Eleftheriou , Abu Sebastian , Bipin Rajendran

For energy-efficient computation in specialized neuromorphic hardware, we present spiking neural coding, an instantiation of a family of artificial neural models grounded in the theory of predictive coding. This model, the first of its…

Neural and Evolutionary Computing · Computer Science 2022-08-09 Alexander Ororbia

Humans and animals developed a sophisticated motor control apparatus and there is much evidence that it has a modular structure. The modularity offers a range of benefits, e.g. ability to learn dissociable motion styles without interference…

Robotics · Computer Science 2016-05-20 Kirill Makukhin