English
Related papers

Related papers: Mean Field Analysis of Stochastic Neural Network M…

200 papers

In recurrent networks of leaky integrate-and-fire (LIF) neurons, mean-field theory has proven successful in describing various statistical properties of neuronal activity at equilibrium, such as firing rate distributions. Mean-field theory…

Neurons and Cognition · Quantitative Biology 2023-11-10 Marina Vegué , Antoine Allard , Patrick Desrosiers

Spontaneous cortical population activity exhibits a multitude of oscillatory patterns, which often display synchrony during slow-wave sleep or under certain anesthetics and stay asynchronous during quiet wakefulness. The mechanisms behind…

Neurons and Cognition · Quantitative Biology 2018-06-20 Rodrigo F. O. Pena , Michael A. Zaks , Antonio C. Roque

Using a perturbative expansion for weak synaptic weights and weak sources of randomness, we calculate the correlation structure of neural networks with generic connectivity matrices. In detail, the perturbative parameters are the mean and…

Neurons and Cognition · Quantitative Biology 2013-07-11 D. Fasoli , O. Faugeras

The Hopfield associative memory model stores random patterns in synaptic couplings according to Hebb's rule and retrieves them through gradient descent on an energy function. This conventional setting, where neurons are assumed to have…

Disordered Systems and Neural Networks · Physics 2026-01-23 Yoshiyuki Kabashima , Kazushi Mimura

A recent dynamic mean-field theory for sequence processing in fully connected neural networks of Hopfield-type (During, Coolen and Sherrington, 1998) is extended and analized here for a symmetrically diluted network with finite connectivity…

Disordered Systems and Neural Networks · Physics 2009-11-10 W. K. Theumann

The distinct timescales of synaptic plasticity and neural activity dynamics play an important role in the brain's learning and memory systems. Activity-dependent plasticity reshapes neural circuit architecture, determining spontaneous and…

Neurons and Cognition · Quantitative Biology 2023-06-30 Heather L Cihak , Zachary P Kilpatrick

Dynamical balance of excitation and inhibition is usually invoked to explain the irregular low firing activity observed in the cortex. We propose a robust nonlinear balancing mechanism for a random network of spiking neurons, which works…

Disordered Systems and Neural Networks · Physics 2025-05-29 Antonio Politi , Alessandro Torcini

Real neurons connect to each other non-randomly. How the connectivity of networks of conductance-based neuron models like the classical Hodgkin-Huxley model, or the Morris-Lecar model, impacts synchronizability remains unknown. One powerful…

Neurons and Cognition · Quantitative Biology 2023-09-22 Wilten Nicola

Stabilization of non-stationary linear systems over noisy communication channels is considered. Stochastically stable sources, and unstable but noise-free or bounded-noise systems have been extensively studied in information theory and…

Information Theory · Computer Science 2012-05-07 Serdar Yüksel

It is well-known that the fundamental diagram in a realistic traffic system is featured by capacity drop. From a mesoscopic approach, we demonstrate that such a phenomenon is linked to the unique properties of stochastic noise, which, when…

Applications · Statistics 2025-03-21 Mariana Pereira de Melo , Leon Alexander Valencia , Wei-Liang Qian

Bottom-up models of functionally relevant patterns of neural activity provide an explicit link between neuronal dynamics and computation. A prime example of functional activity pattern is hippocampal replay, which is critical for memory…

Neurons and Cognition · Quantitative Biology 2024-09-30 Bastian Pietras , Valentin Schmutz , Tilo Schwalger

Spatiotemporal patterns such as traveling waves are frequently observed in recordings of neural activity. The mechanisms underlying the generation of such patterns are largely unknown. Previous studies have investigated the existence and…

Neurons and Cognition · Quantitative Biology 2022-09-16 Johanna Senk , Karolína Korvasová , Jannis Schuecker , Espen Hagen , Tom Tetzlaff , Markus Diesmann , Moritz Helias

Biological neural networks are notoriously hard to model due to their stochastic behavior and high dimensionality. We tackle this problem by constructing a dynamical model of both the expectations and covariances of the fractions of active…

Neurons and Cognition · Quantitative Biology 2025-02-25 Vincent Painchaud , Patrick Desrosiers , Nicolas Doyon

We examine the stability and qualitative dynamics of stochastic neuronal networks specified as multivariate nonlinear Hawkes processes and related point-process generalized linear models that incorporate both auto- and cross-history…

Disordered Systems and Neural Networks · Physics 2019-12-13 Dmitrii Todorov , Wilson Truccolo

Neurons in the nervous system are submitted to distinct sources of noise, such as ionic-channel and synaptic noise, which introduces variability in their responses to repeated presentations of identical stimuli. This motivates the use of…

Dynamical systems driven by strong external signals are ubiquituous in nature and engineering. Here we study "echo state networks", networks of a large number of randomly connected nodes, which represent a simple model of a neural network,…

Chaotic Dynamics · Physics 2013-11-07 Marc Massar , Serge Massar

We study the asymptotic behavior for asymmetric neuronal dynamics in a network of linear Hopfield neurons. The interaction between the neurons is modeled by random couplings which are centered i.i.d. random variables with finite moments of…

Probability · Mathematics 2020-06-08 Olivier Faugeras , Émilie Soret , Etienne Tanré

The stochastic heavy ball method (SHB), also known as stochastic gradient descent (SGD) with Polyak's momentum, is widely used in training neural networks. However, despite the remarkable success of such algorithm in practice, its…

Machine Learning · Computer Science 2023-02-07 Diyuan Wu , Vyacheslav Kungurtsev , Marco Mondelli

Kinetics of a balanced network of neurons with a sparse grid of synaptic links is well representable by the stochastic dynamics of a generic neuron subject to an effective shot noise. The rate of delta-pulses of the noise is determined…

Neurons and Cognition · Quantitative Biology 2025-10-31 Maria V. Ageeva , Denis S. Goldobin

Here we numerically study a model of excitable media, namely, a network with occasionally quiet nodes and connection weights that vary with activity on a short-time scale. Even in the absence of stimuli, this exhibits unstable dynamics,…

Disordered Systems and Neural Networks · Physics 2015-05-19 S. de Franciscis , J. J. Torres , J. Marro