Related papers: Fast Sparsely Synchronized Brain Rhythms in A Scal…
This paper studies a stochastic neural field model that is extended from our previous paper [14]. The neural field model consists of many heterogeneous local populations of neurons. Rigorous results on the stochastic stability are proved,…
We study the relationship between the frequency of a function and the speed at which a neural network learns it. We build on recent results that show that the dynamics of overparameterized neural networks trained with gradient descent can…
Self-sustained neural activity in the absence of ongoing external input is a fundamental feature of nervous system dynamics, yet the conditions under which it can emerge in biophysically grounded network models remain incompletely…
From the point of view of the human brain, continual learning can perform various tasks without mutual interference. An effective way to reduce mutual interference can be found in sparsity and selectivity of neurons. According to Aljundi et…
Asymptotic synchronization is one of the essential differences between artificial neural networks and biologically inspired neural networks due to mismatches from dynamical update of weight parameters and heterogeneous activations. In this…
The propensity for synchronization is studied in a complex network of asymmetrically coupled units, where the asymmetry in a given link is determined by the relative age of the involved nodes. In growing scale-free networks synchronization…
Mesoscopic models of finite-size neuronal populations are crucial to understand the dynamics of neural networks in the brain, especially their fluctuations and response to stimuli. However, current theories to derive such models are based…
By extending a dynamical mean-field approximation (DMA) previously proposed by the author [H. Hasegawa, Phys. Rev. E {\bf 67}, 41903 (2003)], we have developed a semianalytical theory which takes into account a wide range of couplings in a…
Recently deep neural networks have received considerable attention due to their ability to extract and represent high-level abstractions in data sets. Deep neural networks such as fully-connected and convolutional neural networks have shown…
We investigate different dynamical regimes of neuronal network in the CA3 area of the hippocampus. The proposed neuronal circuit includes two fast- and two slowly-spiking cells which are interconnected by means of dynamical synapses. On the…
Adaptive link sizes is a major breakthrough step in evolving networks and is now considered as an essential process both in biological and artificial neural networks. In adaptive networks the link weights change in time and, in brain…
We study analytically the dynamics of a network of sparsely connected inhibitory integrate-and-fire neurons in a regime where individual neurons emit spikes irregularly and at a low rate. In the limit when the number of neurons N tends to…
In this paper, we clarify the mechanisms underlying a general phenomenon present in pulse-coupled heterogeneous inhibitory networks: inhibition can induce not only suppression of the neural activity, as expected, but it can also promote…
Sparse neural networks have been widely applied to reduce the computational demands of training and deploying over-parameterized deep neural networks. For inference acceleration, methods that discover a sparse network from a pre-trained…
We consider the Watts-Strogatz small-world network consisting of subthreshold neurons which exhibit noise-induced spikings. This neuronal network has adaptive dynamic synaptic strengths governed by the spike-timing-dependent plasticity…
Spontaneous synchronization is a general phenomenon in which a large population of coupled oscillators of diverse natural frequencies self-organize to operate in unison. The phenomenon occurs in physical and biological systems over a wide…
We study a network model of two conductance-based pacemaker neurons of differing natural frequency, coupled with either mutual excitation or inhibition, and receiving shared random inhibitory synaptic input. The networks may phase-lock…
In the brain, fine-scale correlations combine to produce macroscopic patterns of activity. However, as experiments record from larger and larger populations, we approach a fundamental bottleneck: the number of correlations one would like to…
Repeating spatiotemporal spike patterns exist and carry information. Here we investigated how a single spiking neuron can optimally respond to one given pattern (localist coding), or to either one of several patterns (distributed coding,…
Networks of fast-spiking interneurons are crucial for the generation of neural oscillations in the brain. Here we study the synchronous behavior of interneuronal networks that are coupled by delayed inhibitory and fast electrical synapses.…