English

Reinforcement learning for suppression of collective activity in oscillatory ensembles

Neurons and Cognition 2020-04-22 v2

Abstract

We present a use of modern data-based machine learning approaches to suppress self-sustained collective oscillations typically signaled by ensembles of degenerative neurons in the brain. The proposed hybrid model relies on two major components: an environment of oscillators and a policy-based reinforcement learning block. We report a model-agnostic synchrony control based on proximal policy optimization and two artificial neural networks in an Actor-Critic configuration. A class of physically meaningful reward functions enabling the suppression of collective oscillatory mode is proposed. The synchrony suppression is demonstrated for two models of neuronal populations -- for the ensembles of globally coupled limit-cycle Bonhoeffer-van der Pol oscillators and for the bursting Hindmarsh--Rose neurons.

Keywords

Cite

@article{arxiv.1909.12154,
  title  = {Reinforcement learning for suppression of collective activity in oscillatory ensembles},
  author = {Dmitriy Krylov and Dmitry V. Dylov and Michael Rosenblum},
  journal= {arXiv preprint arXiv:1909.12154},
  year   = {2020}
}

Comments

8 pages, 8 figures