English
Related papers

Related papers: Reward-modulated learning using spiking neural net…

200 papers

Understanding how biological neural networks are shaped via local plasticity mechanisms can lead to energy-efficient and self-adaptive information processing systems, which promises to mitigate some of the current roadblocks in edge…

Neural and Evolutionary Computing · Computer Science 2025-04-10 Willian Soares Girão , Nicoletta Risi , Elisabetta Chicca

The human brain constantly learns and rapidly adapts to new situations by integrating acquired knowledge and experiences into memory. Developing this capability in machine learning models is considered an important goal of AI research since…

Artificial Intelligence · Computer Science 2023-06-08 Arsham Gholamzadeh Khoee , Alireza Javaheri , Saeed Reza Kheradpisheh , Mohammad Ganjtabesh

Spiking neural networks (SNNs) promise energy-efficient computation by mimicking biological neural dynamics, yet existing plasticity rules focus on isolated spike pairs and fail to leverage the synchronous activity patterns that drive…

Neural and Evolutionary Computing · Computer Science 2025-08-26 Yuchen Tian , Assel Kembay , Samuel Tensingh , Nhan Duy Truong , Jason K. Eshraghian , Omid Kavehei

How do humans and animals perform trial-and-error learning when the space of possibilities is infinite? In a previous study, we used an interval timing production task and discovered an updating strategy in which the agent adjusted the…

Neurons and Cognition · Quantitative Biology 2022-05-10 Jing Wang , Yousuf El-Jayyousi , Ilker Ozden

This study explores the design and control of the behaviour of agents and robots using simple circuits of spiking neurons and Spike Timing Dependent Plasticity (STDP) as a mechanism of associative and unsupervised learning. Based on a…

Robotics · Computer Science 2015-09-25 Cristian Jimenez-Romero , David Sousa-Rodrigues , Jeffrey H. Johnson

Reinforcement learning (RL) has shown to be a valuable tool in training neural networks for autonomous motion planning. The application of RL to a specific problem is dependent on a reward signal to quantify how good or bad a certain action…

Robotics · Computer Science 2024-10-28 Benjamin Evans , Herman A. Engelbrecht , Hendrik W. Jordaan

Spiking neural networks (SNNs) are brain-inspired models that enable energy-efficient implementation on neuromorphic hardware. However, the supervised training of SNNs remains a hard problem due to the discontinuity of the spiking neuron…

Neural and Evolutionary Computing · Computer Science 2021-12-20 Mingqing Xiao , Qingyan Meng , Zongpeng Zhang , Yisen Wang , Zhouchen Lin

In the reinforcement learning (RL) tasks, the ability to predict receiving reward in the near or more distant future means the ability to evaluate the current state as more or less close to the target state (labelled by the reward signal).…

Neural and Evolutionary Computing · Computer Science 2023-11-10 Mikhail Kiselev

Spiking neural networks have shown great promise for the design of low-power sensory-processing and edge-computing hardware platforms. However, implementing on-chip learning algorithms on such architectures is still an open challenge,…

Neural and Evolutionary Computing · Computer Science 2021-04-13 Matteo Cartiglia , Germain Haessig , Giacomo Indiveri

Neuronal spikes directly drive muscles and endow animals with agile movements, but applying the spike-based control signals to actuators in artificial sensor-motor systems inevitably causes a collapse of learning. We developed a system that…

Neurons and Cognition · Quantitative Biology 2026-03-03 Takeshi Kobayashi , Shogo Yonekura , Yasuo Kuniyoshi

This paper explores the capability of deep neural networks to capture key characteristics of vehicle dynamics, and their ability to perform coupled longitudinal and lateral control of a vehicle. To this extent, two different artificial…

Machine Learning · Computer Science 2018-10-23 Guillaume Devineau , Philip Polack , Florent Altché , Fabien Moutarde

This paper proposes an adaptable path tracking control system based on Reinforcement Learning (RL) for autonomous cars. A four-parameter controller shapes the behavior of the vehicle to navigate on lane changes and roundabouts. The tuning…

Systems and Control · Electrical Eng. & Systems 2023-01-10 Ana Carrasco , João Sequeira

General-purpose planning algorithms for automated driving combine mission, behavior, and local motion planning. Such planning algorithms map features of the environment and driving kinematics into complex reward functions. To achieve this,…

Robotics · Computer Science 2020-09-17 Sascha Rosbach , Vinit James , Simon Großjohann , Silviu Homoceanu , Xing Li , Stefan Roth

Brain-inspired learning models attempt to mimic the cortical architecture and computations performed in the neurons and synapses constituting the human brain to achieve its efficiency in cognitive tasks. In this work, we present…

Neural and Evolutionary Computing · Computer Science 2017-03-21 Priyadarshini Panda , Gopalakrishnan Srinivasan , Kaushik Roy

Causal relationship recognition is a fundamental operation in neural networks aimed at learning behavior, action planning, and inferring external world dynamics. This operation is particularly crucial for reinforcement learning (RL). In the…

Neural and Evolutionary Computing · Computer Science 2023-09-18 Mikhail Kiselev , Denis Larionov , Andrey Urusov

Spiking recurrent neural networks (RNNs) are a promising tool for solving a wide variety of complex cognitive and motor tasks, due to their rich temporal dynamics and sparse processing. However training spiking RNNs on dedicated…

Neural and Evolutionary Computing · Computer Science 2021-09-28 Yigit Demirag , Charlotte Frenkel , Melika Payvand , Giacomo Indiveri

The ability to predict future events or patterns based on previous experience is crucial for many applications such as traffic control, weather forecasting, or supply chain management. While modern supervised Machine Learning approaches…

Neurons and Cognition · Quantitative Biology 2024-10-16 Florian Feiler , Emre Neftci , Younes Bouhadjar

To compensate for sensory processing delays, the visual system must make predictions to ensure timely and appropriate behaviors. Recent work has found predictive information about the stimulus in neural populations early in vision…

Neurons and Cognition · Quantitative Biology 2018-10-05 Audrey J. Sederberg , Jason N. MacLean , Stephanie E. Palmer

Since the first recordings made of evoked action potentials it has become apparent that the responses of individual neurons to ongoing physiologically relevant input, are highly variable. This variability is manifested in non-stationary…

Neurons and Cognition · Quantitative Biology 2010-08-10 Avner Wallach , Danny Eytan , Asaf Gal , Christoph Zrenner , Ron Meir , Shimon Marom

Autonomous driving is a challenging task that has gained broad attention from both academia and industry. Current solutions using convolutional neural networks require large amounts of computational resources, leading to high power…

Computer Vision and Pattern Recognition · Computer Science 2025-02-12 Xuelei Chen , Sotirios Spanogianopoulos