English
Related papers

Related papers: Optimal reinforcement learning near the edge of sy…

200 papers

Synaptic connections between neurons in the brain are dynamic because of continuously ongoing spine dynamics, axonal sprouting, and other processes. In fact, it was recently shown that the spontaneous synapse-autonomous component of spine…

Neurons and Cognition · Quantitative Biology 2018-01-08 David Kappel , Robert Legenstein , Stefan Habenschuss , Michael Hsieh , Wolfgang Maass

In the last decade, several models with network adaptive mechanisms (link deletion-creation, dynamic synapses, dynamic gains) have been proposed as examples of self-organized criticality (SOC) to explain neuronal avalanches. However, all…

Adaptation and Self-Organizing Systems · Physics 2018-10-15 O. Kinouchi , L. Brochini , A. A. Costa , J. G. F. Campos , M. Copelli

The problem of training spiking neural networks (SNNs) is a necessary precondition to understanding computations within the brain, a field still in its infancy. Previous work has shown that supervised learning in multi-layer SNNs enables…

Neural and Evolutionary Computing · Computer Science 2018-03-12 Amirhossein Tavanaei , Anthony S. Maida

Synaptic delays play a crucial role in biological neuronal networks, where their modulation has been observed in mammalian learning processes. In the realm of neuromorphic computing, although spiking neural networks (SNNs) aim to emulate…

Neural and Evolutionary Computing · Computer Science 2025-06-19 Marissa Dominijanni , Alexander Ororbia , Kenneth W. Regan

The presence of both critical behavior and oscillating patterns in brain dynamics is a very interesting issue. In this paper, we consider a model for a neuron population, where each neuron is modeled by an over-damped rotator. We find that…

Disordered Systems and Neural Networks · Physics 2020-11-12 Amin Safaeesirat , Saman Moghimi-Araghi

This article underlines the learning and discrimination capabilities of a model of associative memory based on artificial networks of spiking neurons. Inspired from neuropsychology and neurobiology, the model implements top-down…

Neural and Evolutionary Computing · Computer Science 2016-08-16 Anthony Mouraud , Hélène Paugam-Moisy

Despite the striking successes of deep neural networks trained with gradient-based optimization, these methods differ fundamentally from their biological counterparts. This gap raises key questions about how nature achieves robust,…

Machine Learning · Computer Science 2025-10-15 Mattia Scardecchia

Coherence resonance (CR), stochastic synchronization (SS), and spike-timing-dependent plasticity (STDP) are ubiquitous dynamical processes in biological neural networks. Whether there exists an optimal network and STDP configuration at…

Neurons and Cognition · Quantitative Biology 2023-01-03 Marius E. Yamakou , Estelle M. Inack

Controlling continuous-time dynamical systems is generally a two step process: first, identify or model the system dynamics with differential equations, then, minimize the control objectives to achieve optimal control function and optimal…

Artificial Intelligence · Computer Science 2024-04-23 Cheng Chi

Most normative models in computational neuroscience describe the task of learning as the optimisation of a cost function with respect to a set of parameters. However, learning as optimisation fails to account for a time varying environment…

Neurons and Cognition · Quantitative Biology 2020-08-10 Jannes Jegminat , Jean-Pascal Pfister

We study the dynamics of an ensemble of globally coupled chaotic logistic maps under the action of a learning algorithm aimed at driving the system from incoherent collective evolution to a state of spontaneous full synchronization.…

Adaptation and Self-Organizing Systems · Physics 2009-10-31 Luis G. Moyano , Guillermo Abramson , Damian H. Zanette

Spiking neuron networks have been used successfully to solve simple reinforcement learning tasks with continuous action set applying learning rules based on spike-timing-dependent plasticity (STDP). However, most of these models cannot be…

Machine Learning · Computer Science 2020-09-01 Stephen Chung , Robert Kozma

This work presents a technique for learning systems, where the learning process is guided by knowledge of the physics of the system. In particular, we solve the problem of the two-point boundary optimal control problem of linear…

Systems and Control · Electrical Eng. & Systems 2021-05-03 Vasanth Reddy , Hoda Eldardiry , Almuatazbellah Boker

Information processing in the brain crucially depends on encoding properties of single neurons, with particular relevance of the spike-generation mechanism. The latter hinges upon the bifurcation type at the transition point between resting…

Neurons and Cognition · Quantitative Biology 2017-05-10 Janina Hesse , Jan-Hendrik Schleimer , Susanne Schreiber

Air hockey demands split-second decisions at high puck velocities, a challenge we address with a compact network of spiking neurons running on a mixed-signal analog/digital neuromorphic processor. By co-designing hardware and learning…

Spike timing dependent plasticity (STDP) is believed to play an important role in shaping the structure of neural circuits. Here we show that STDP generates effective interactions between synapses of different neurons, which were neglected…

Neurons and Cognition · Quantitative Biology 2016-08-25 Neta Ravid Tannenbaum , Yoram Burak

Recent studies have shown that adaptive networks driven by simple local rules can organize into "critical" global steady states, providing another framework for self-organized criticality (SOC). We focus on the important convergence to…

Adaptation and Self-Organizing Systems · Physics 2013-05-30 Christian Kuehn

Stochastic gradient descent requires that training samples be drawn from a uniformly random distribution of the data. For a deployed system that must learn online from an uncontrolled and unknown environment, the ordering of input samples…

Neural and Evolutionary Computing · Computer Science 2020-01-29 Jason M. Allred , Kaushik Roy

Complex systems are typically characterized as an intermediate situation between a complete regular structure and a random system. Brain signals can be studied as a striking example of such systems: cortical states can range from highly…

Living organisms must actively maintain themselves in order to continue existing. Autopoiesis is a key concept in the study of living organisms, where the boundaries of the organism is not static by dynamically regulated by the system…

Neural and Evolutionary Computing · Computer Science 2020-01-29 Atsushi Masumori , Lana Sinapayen , Norihiro Maruyama , Takeshi Mita , Douglas Bakkum , Urs Frey , Hirokazu Takahashi , Takashi Ikegami