English
Related papers

Related papers: A differential Hebbian framework for biologically-…

200 papers

Memory is a key component of biological neural systems that enables the retention of information over a huge range of temporal scales, ranging from hundreds of milliseconds up to years. While Hebbian plasticity is believed to play a pivotal…

Neural and Evolutionary Computing · Computer Science 2022-05-24 Thomas Limbacher , Ozan Özdenizci , Robert Legenstein

A model of sensory information processing is presented. The model assumes that learning of internal (hidden) generative models, which can predict the future and evaluate the precision of that prediction, is of central importance for…

Neural and Evolutionary Computing · Computer Science 2007-05-23 Andras Lorincz

Reinforcement learning has emerged as a promising methodology for training robot controllers. However, most results have been limited to simulation due to the need for a large number of samples and the lack of automated-yet-safe data…

Robotics · Computer Science 2018-03-29 Kendall Lowrey , Svetoslav Kolev , Jeremy Dao , Aravind Rajeswaran , Emanuel Todorov

The plasticity property of biological neural networks allows them to perform learning and optimize their behavior by changing their configuration. Inspired by biology, plasticity can be modeled in artificial neural networks by using Hebbian…

Neural and Evolutionary Computing · Computer Science 2020-12-21 Anil Yaman , Giovanni Iacca , Decebal Constantin Mocanu , George Fletcher , Mykola Pechenizkiy

We present a mathematical analysis of the effects of Hebbian learning in random recurrent neural networks, with a generic Hebbian learning rule including passive forgetting and different time scales for neuronal activity and learning…

Chaotic Dynamics · Physics 2008-04-07 Benoit Siri , Hugues Berry , Bruno Cessac , Bruno Delord , Mathias Quoy

Neural networks are commonly trained to make predictions through learning algorithms. Contrastive Hebbian learning, which is a powerful rule inspired by gradient backpropagation, is based on Hebb's rule and the contrastive divergence…

Machine Learning · Computer Science 2018-06-21 Georgios Detorakis , Travis Bartley , Emre Neftci

The development of sensory receptive fields has been modeled in the past by a variety of models including normative models such as sparse coding or independent component analysis and bottom-up models such as spike-timing dependent…

Neurons and Cognition · Quantitative Biology 2017-02-08 Carlos S. N. Brito , Wulfram Gerstner

Recent work has shown that biologically plausible Hebbian learning can be integrated with backpropagation learning (backprop), when training deep convolutional neural networks. In particular, it has been shown that Hebbian learning can be…

Computer Vision and Pattern Recognition · Computer Science 2020-12-23 Gabriele Lagani , Giuseppe Amato , Fabrizio Falchi , Claudio Gennaro

Artificial neural networks have successfully tackled a large variety of problems by training extremely deep networks via back-propagation. A direct application of back-propagation to spiking neural networks contains biologically implausible…

Neural and Evolutionary Computing · Computer Science 2021-11-29 Kyle Daruwalla , Mikko Lipasti

Nonlinear optimal control problems are often solved with numerical methods that require knowledge of system's dynamics which may be difficult to infer, and that carry a large computational cost associated with iterative calculations. We…

Machine Learning · Computer Science 2019-03-08 Ekaterina Abramova , Luke Dickens , Daniel Kuhn , Aldo Faisal

Backpropagation is a cornerstone algorithm in training neural networks for supervised learning, which uses a gradient descent method to update network weights by minimizing the discrepancy between actual and desired outputs. Despite its…

The back-propagation (BP) algorithm has been considered the de-facto method for training deep neural networks. It back-propagates errors from the output layer to the hidden layers in an exact manner using the transpose of the feedforward…

Neural and Evolutionary Computing · Computer Science 2018-05-01 Hongyin Luo , Jie Fu , James Glass

The architecture of a neural network controlling an unknown environment is presented. It is based on a randomly connected recurrent neural network from which both perception and action are simultaneously read and fed back. There are two…

Adaptation and Self-Organizing Systems · Physics 2015-01-20 Mathieu Galtier

Neural network models offer a theoretical testbed for the study of learning at the cellular level. The only experimentally verified learning rule, Hebb's rule, is extremely limited in its ability to train networks to perform complex tasks.…

adap-org · Physics 2008-02-03 Russell W. Anderson

While conventional reinforcement learning focuses on designing agents that can perform one task, meta-learning aims, instead, to solve the problem of designing agents that can generalize to different tasks (e.g., environments, obstacles,…

Machine Learning · Computer Science 2021-09-06 Xiaowu Sun , Wael Fatnassi , Ulices Santa Cruz , Yasser Shoukry

Recent research shows that supervised learning can be an effective tool for designing near-optimal feedback controllers for high-dimensional nonlinear dynamic systems. But the behavior of neural network controllers is still not well…

Optimization and Control · Mathematics 2022-10-10 Tenavi Nakamura-Zimmerer , Qi Gong , Wei Kang

The paper proposes the use of structured neural networks for reinforcement learning based nonlinear adaptive control. The focus is on partially observable systems, with separate neural networks for the state and feedforward observer and the…

Systems and Control · Electrical Eng. & Systems 2023-04-21 Ruoqi Zhang , Per Mattson , Torbjörn Wigren

Neuromorphic engineering is a rapidly developing field that aims to take inspiration from the biological organization of neural systems to develop novel technology for computing, sensing, and actuating. The unique properties of such systems…

Systems and Control · Electrical Eng. & Systems 2022-01-26 Luka Ribar , Rodolphe Sepulchre

Although different learning systems are coordinated to afford complex behavior, little is known about how this occurs. This article describes a theoretical framework that specifies how complex behaviors that might be thought to require…

Artificial Intelligence · Computer Science 2015-03-27 Yanping Liu , Erik D. Reichle

In this paper, we propose a novel control architecture, inspired from neuroscience, for adaptive control of continuous-time systems. The proposed architecture, in the setting of standard Neural Network (NN) based adaptive control, augments…

Systems and Control · Computer Science 2021-10-11 Deepan Muthirayan , Pramod P. Khargonekar