English
Related papers

Related papers: Learning-rate dependent clustering and self-develo…

200 papers

The learning dynamics of on-line independent component analysis is analysed in the limit of large data dimension. We study a simple Hebbian learning algorithm that can be used to separate out a small number of non-Gaussian components from a…

Disordered Systems and Neural Networks · Physics 2007-05-23 Gleb Basalyga , Magnus Rattray

Adaptation plays a pivotal role in the evolution of natural and artificial complex systems, and in the determination of their functionality. Here, we investigate the impact of adaptive inter-layer processes on intra-layer synchronization in…

Adaptation and Self-Organizing Systems · Physics 2020-10-20 Ajay Deep Kachhvah , Xiangfeng Dai , Stefano Boccaletti , Sarika Jalan

Learning is thought to occur by localized, experience-induced changes in the strength of synaptic connections between neurons. Recent work has shown that activity-dependent changes at one connection can affect changes at others (crosstalk).…

Neurons and Cognition · Quantitative Biology 2008-02-22 Kingsley J. A. Cox , Paul R. Adams

Hebbian meta-learning has recently shown promise to solve hard reinforcement learning problems, allowing agents to adapt to some degree to changes in the environment. However, because each synapse in these approaches can learn a very…

Neural and Evolutionary Computing · Computer Science 2021-06-24 Rasmus Berg Palm , Elias Najarro , Sebastian Risi

The synchronization transition of correlated ensembles of coupled Kuramoto oscillators on sparse random networks is investigated. Extensive numerical simulations show that correlations between the native frequencies of adjacent oscillators…

Statistical Mechanics · Physics 2010-06-16 Markus Brede

Many complex systems can be represented as networks of dynamical elements whose states evolve in response to interactions with neighboring elements, noise and external stimuli. The collective behavior of such systems can exhibit remarkable…

Statistical Mechanics · Physics 2015-09-23 Anand Pathak , Sitabhra Sinha

We consider a mean-field model of coupled phase oscillators with quenched disorder in the natural frequencies and coupling strengths. A fraction $p$ of oscillators are positively coupled, attracting all others, while the remaining fraction…

Statistical Mechanics · Physics 2016-11-03 Hyunsuk Hong , Kevin P. O'Keeffe , Steven H. Strogatz

Hebbian plasticity is a powerful principle that allows biological brains to learn from their lifetime experience. By contrast, artificial neural networks trained with backpropagation generally have fixed connection weights that do not…

Neural and Evolutionary Computing · Computer Science 2016-10-20 Thomas Miconi

Rapidly learning from ongoing experiences and remembering past events with a flexible memory system are two core capacities of biological intelligence. While the underlying neural mechanisms are not fully understood, various evidence…

Neural and Evolutionary Computing · Computer Science 2023-02-08 Yu Duan , Zhongfan Jia , Qian Li , Yi Zhong , Kaisheng Ma

We consider a long-range model of coupled phase-only oscillators subject to a local potential and evolving in presence of thermal noise. The model is a non-trivial generalization of the celebrated Kuramoto model of collective…

Adaptation and Self-Organizing Systems · Physics 2017-01-04 Alessandro Campa , Shamik Gupta

In this work we study the synchronization of Kuramoto oscillators driven by external forces in complex modular networks. The motivation is the neuronal dynamics that takes place during information processing in the neural cortex. The neuron…

Adaptation and Self-Organizing Systems · Physics 2020-04-02 Carolina Arruda Moreira

Learning in the brain is poorly understood and learning rules that respect biological constraints, yet yield deep hierarchical representations, are still unknown. Here, we propose a learning rule that takes inspiration from neuroscience and…

Neural and Evolutionary Computing · Computer Science 2021-10-27 Bernd Illing , Jean Ventura , Guillaume Bellec , Wulfram Gerstner

We study the Kuramoto model on complex networks, in which natural frequencies of phase oscillators and the vertex degrees are correlated. Using the annealed network approximation and numerical simulations we explore a special case in which…

Disordered Systems and Neural Networks · Physics 2013-03-14 B. C. Coutinho , A. V. Goltsev , S. N. Dorogovtsev , J. F. F. Mendes

A class of adaptation functions is found for which a synchronous oscillation mode exists in the network of phase oscillators with triadic couplings. It is shown that the destruction of the synchronous mode occurs differently for networks…

Chaotic Dynamics · Physics 2023-11-13 Anastasiia Emelianova , Vladimir Nekorkin

Recently, the first-order synchronization transition has been studied in systems of coupled phase oscillators. In this paper, we propose a framework to investigate the synchronization in the frequency-weighted Kuramoto model with all-to-all…

Adaptation and Self-Organizing Systems · Physics 2015-11-18 Can Xu , Yuting Sun , Jian Gao , Tian Qiu , Zhigang Zheng , Shuguang Guan

Learning requires the traversal of inherently distinct cognitive states to produce behavioral adaptation. Yet, tools to explicitly measure these states with non-invasive imaging -- and to assess their dynamics during learning -- remain…

While traditional feed-forward filter models can reproduce the rate responses of retinal ganglion neurons to simple stimuli, they cannot explain why synchrony between spikes is much higher than expected by Poisson firing [6], and can be…

Neurons and Cognition · Quantitative Biology 2020-05-07 Christopher Warner , Friedrich T. Sommer

Hopfield neural networks are a possible basis for modelling associative memory in living organisms. After summarising previous studies in the field, we take a new look at learning rules, exhibiting them as descent-type algorithms for…

Neural and Evolutionary Computing · Computer Science 2020-10-06 Pavel Tolmachev , Jonathan H. Manton

We consider a variation of the Kuramoto model with dynamic coupling, where the coupling strengths are allowed to evolve in response to the phase difference between the oscillators, a model first considered by Ha, Noh and Park. In particular…

Dynamical Systems · Mathematics 2017-06-07 Jared C. Bronski , Yizhang He , Xinye Li , Yue Liu , Danielle Rae Sponseller , Seth Wolbert

Neural circuits exhibit complex activity patterns, both spontaneously and evoked by external stimuli. Information encoding and learning in neural circuits depend on how well time-varying stimuli can control spontaneous network activity. We…

Neurons and Cognition · Quantitative Biology 2023-01-11 Rainer Engelken , Alessandro Ingrosso , Ramin Khajeh , Sven Goedeke , L. F. Abbott