English
Related papers

Related papers: Population Level Activity in Large Random Neural N…

200 papers

We investigate the competition between barrier slowing down and proliferation induced superdiffusion in a model of population dynamics in a random force field. Numerical results in $d=1$ suggest that a new intermediate diffusion behaviour…

Condensed Matter · Physics 2007-05-23 Irene Giardina , Jean-Philippe Bouchaud , Marc Mezard

We introduce a nonlinear operator to model diffusion on a complex undirected network under crowded conditions. We show that the asymptotic distribution of diffusing agents is a nonlinear function of the nodes' degree and saturates to a…

Statistical Mechanics · Physics 2018-04-18 Malbor Asllani , Timoteo Carletti , Francesca Di Patti , Duccio Fanelli , Francesco Piazza

In a series of two papers, we investigate the large deviations and asymptotic behavior of stochastic models of brain neural networks with random interaction coefficients. In this first paper, we take into account the spatial structure of…

Probability · Mathematics 2017-01-05 Tanguy Cabana , Jonathan Touboul

Many mathematical models of interacting agents assume that individual interactions scale down in proportion to the network size, ensuring that the combined input received from the network does not diverge. In theoretical neuroscience,…

Analysis of PDEs · Mathematics 2025-11-10 Cristobal Quininao , Jonathan Touboul

We study the dynamics of supervised on-line learning of realizable tasks in feed-forward neural networks. We focus on the regime where the number of examples used for training is proportional to the number of input channels N. Using…

Disordered Systems and Neural Networks · Physics 2009-11-07 J. A. F. Heimel , A. C. C. Coolen

We propose that chaotic Glass networks (a class of piecewise-linear Ordinary Differential Equations) are good candidates for the design of true random number generators. A Glass network design has the advantage of involving only standard…

Dynamical Systems · Mathematics 2025-02-14 Benjamin W. Wild , Roderick Edwards

Large-scale recurrent networks have drawn increasing attention recently because of their capabilities in modeling a large variety of real-world phenomena and physical mechanisms. This paper studies how to identify all authentic connections…

Machine Learning · Statistics 2015-06-23 Yiyuan She , Yuejia He , Dapeng Wu

We analyze the landscape of general smooth Gaussian functions on the sphere in dimension $N$, when $N$ is large. We give an explicit formula for the asymptotic complexity of the mean number of critical points of finite and diverging index…

Probability · Mathematics 2013-12-17 Antonio Auffinger , Gerard Ben Arous

A basic model of a dynamical distribution network is considered, modeled as a directed graph with storage variables corresponding to every vertex and flow inputs corresponding to every edge, subject to unknown but constant inflows and…

Optimization and Control · Mathematics 2014-03-24 Jieqiang Wei , Arjan van der Schaft

We consider the equilibrium dynamics of Ising spin models with multi-spin interactions on sparse random graphs (Bethe lattices). Such models undergo a mean field glass transition upon increasing the graph connectivity or lowering the…

Statistical Mechanics · Physics 2009-11-10 Andrea Montanari , Guilhem Semerjian

In this paper, we introduce a conceptual framework that model human social networks as an undirected dot-product graph of independent individuals. Their relationships are only determined by a cost-benefit analysis, i.e. by maximizing an…

Probability · Mathematics 2024-11-26 Aldric Labarthe , Yann Kerzreho

Recent control trends are increasingly relying on communication networks and wireless channels to close the loop for Internet-of-Things applications. Traditionally these approaches are model-based, i.e., assuming a network or channel model…

Systems and Control · Electrical Eng. & Systems 2019-11-11 Konstantinos Gatsis , George J. Pappas

Deep neural networks are workhorse models in machine learning with multiple layers of non-linear functions composed in series. Their loss function is highly non-convex, yet empirically even gradient descent minimisation is sufficient to…

Disordered Systems and Neural Networks · Physics 2020-03-18 Simon Becker , Yao Zhang , Alpha A. Lee

We discuss the population dynamics with selection and random diffusion, keeping the total population constant, in a fitness landscape associated with Constraint Satisfaction, a paradigm for difficult optimization problems. We obtain a phase…

Populations and Evolution · Quantitative Biology 2016-11-23 Tommaso Brotto , Guy Bunin , Jorge Kurchan

A computer model is described which is used to assess the dynamical complexity of a class of networks of spiking neurons with small-world properties. Networks are constructed by forming an initially segregated set of highly intra-connected…

Biological Physics · Physics 2009-11-13 Murray Shanahan

We study the dynamics of supervised learning in layered neural networks, in the regime where the size $p$ of the training set is proportional to the number $N$ of inputs. Here the local fields are no longer described by Gaussian probability…

Disordered Systems and Neural Networks · Physics 2009-10-31 A. C. C. Coolen , D. Saad

This paper addresses analytical aspects of deterministic, continuous-time dynamical systems defined on networks. The goal is to model and analyze certain phenomena which must be framed beyond the context of networked dynamical systems,…

Dynamical Systems · Mathematics 2015-01-09 Ricardo Riaza

The equilibrium properties of allocation algorithms for networks with a large number of nodes with finite capacity are investigated. Every node is receiving a flow of requests and when a request arrives at a saturated node, i.e. a node…

Probability · Mathematics 2026-01-14 Davit Martirosyan , Philippe Robert

We analyze multi-layer neural networks in the asymptotic regime of simultaneously (A) large network sizes and (B) large numbers of stochastic gradient descent training iterations. We rigorously establish the limiting behavior of the…

Probability · Mathematics 2021-04-06 Justin Sirignano , Konstantinos Spiliopoulos

Random neural networks are dynamical descriptions of randomly interconnected neural units. These show a phase transition to chaos as a disorder parameter is increased. The microscopic mechanisms underlying this phase transition are unknown,…

Mathematical Physics · Physics 2013-03-18 Gilles Wainrib , Jonathan Touboul