English
Related papers

Related papers: Large deviations for randomly connected neural net…

200 papers

We prove large and moderate deviations for the output of Gaussian fully connected neural networks. The main achievements concern deep neural networks (i.e., when the model has more than one hidden layer) and hold for bounded and continuous…

Probability · Mathematics 2026-04-01 Claudio Macci , Barbara Pacchiarotti , Giovanni Luca Torrisi

The theory of large deviations is concerned with the exponential decay of probabilities of large fluctuations in random systems. These probabilities are important in many fields of study, including statistics, finance, and engineering, as…

Statistical Mechanics · Physics 2009-08-20 Hugo Touchette

Finite-width fully connected neural networks with Gaussian-initialized weights deviate from their infinite-width Gaussian limit, exhibiting non-vanishing higher-order cumulants. We approximate these deviations, for a neural network…

Machine Learning · Statistics 2026-05-26 Lucia Celli

We study pattern formation in class of a large-dimensional neural networks posed on random graphs and subject to spatio-temporal stochastic forcing. Under generic conditions on coupling and nodal dynamics, we prove that the network admits a…

Probability · Mathematics 2025-08-26 Daniele Avitabile , James MacLaurin

Both small world models of random networks with occasional long range connections and gossip processes with occasional long range transmission of information have similar characteristic behaviour. The long range elements appreciably reduce…

Probability · Mathematics 2013-01-22 A. D. Barbour , G. Reinert

In many networks such as transportation or communication networks, distance is certainly a relevant parameter. In addition, real-world examples suggest that when long-range links are existing, they usually connect to hubs-the well connected…

Disordered Systems and Neural Networks · Physics 2009-11-07 Marc Barthelemy

This paper presents a rigorous mathematical analysis, alongside simulation studies, of a spatially extended stochastic electrophysiology model, the Hodgkin-Huxley model of the squid giant axon being a classical example. Although most…

Probability · Mathematics 2025-02-05 Wai-Tong Louis Fan , Joshua A. McGinnis , Yoichiro Mori

A law of large numbers for the empirical distribution of parameters of a one-layer artificial neural networks with sparse connectivity is derived for a simultaneously increasing number of both, neurons and training iterations of the…

Disordered Systems and Neural Networks · Physics 2021-12-13 Christian Hirsch , Matthias Neumann , Volker Schmidt

In increasingly many settings, data sets consist of multiple samples from a population of networks, with vertices aligned across these networks. For example, brain connectivity networks in neuroscience consist of measures of interaction…

Statistics Theory · Mathematics 2021-05-11 Keith Levin , Asad Lodhia , Elizaveta Levina

The paper deals with the asymptotic behavior of the bridge of a Gaussian process conditioned to stay in $n$ fixed points at $n$ fixed past instants. In particular, functional large deviation results are stated for small time. Several…

Probability · Mathematics 2016-04-06 L. Caramellino , B. Pacchiarotti

We study the asymptotic behavior of multiscale stochastic spatial gene networks. Multiscaling takes into account the difference of abundance between molecules , and captures the dynamic of rare species at a mesoscopic level. We introduce an…

Analysis of PDEs · Mathematics 2017-11-17 Arnaud Debussche , Mac Jugal Nguepedja Nankep

General results from statistical learning theory suggest to understand not only brain computations, but also brain plasticity as probabilistic inference. But a model for that has been missing. We propose that inherently stochastic features…

Neural and Evolutionary Computing · Computer Science 2016-02-17 David Kappel , Stefan Habenschuss , Robert Legenstein , Wolfgang Maass

We study the mean-field limit of a generic class of dynamic co-evolving latent space networks motivated by the social and opinion dynamics literature. Such models include $n$ agents, whose opinions are given by latent stochastic processes,…

Probability · Mathematics 2026-04-24 Ankan Ganguly , Konstantinos Spiliopoulos , Daniel Sussman

We study the mean-field limit and stationary distributions of a pulse-coupled network modeling the dynamics of a large neuronal assemblies. Our model takes into account explicitly the intrinsic randomness of firing times, contrasting with…

Probability · Mathematics 2015-03-17 Philippe Robert , Jonathan D. Touboul

We consider a two-dimensional Hamiltonian system perturbed by a small diffusion term, whose coefficient is state-dependent and non-degenerate. As a result, the process consists of the fast motion along the level curves and slow motion…

Probability · Mathematics 2022-05-24 Shuo Yan

We consider the problem of the limit of bio-inspired spatially extended neuronal networks including an infinite number of neuronal types (space locations), with space-dependent propagation delays modeling neural fields. The propagation of…

Probability · Mathematics 2016-05-30 Jonathan Touboul

We consider distributed control of double-integrator networks, where agents are subject to stochastic disturbances. We study performance of such networks in terms of coherence, defined through an H2 norm metric that represents the variance…

Optimization and Control · Mathematics 2017-05-19 Emma Tegling , Henrik Sandberg

Neural networks are known to develop latent representations that are $aligned$, namely structurally similar across networks trained with different architectures, training protocols, or training datasets. We study this phenomenon in a…

Machine Learning · Statistics 2026-05-27 Ali Hussaini Umar , Alessandro Laio

In this paper we address the question of statistical model selection for a class of stochastic models of biological neural nets. Models in this class are systems of interacting chains with memory of variable length. Each chain describes the…

Statistics Theory · Mathematics 2018-12-19 A. Duarte , A. Galves , E. Löcherbach , G. Ost

In the study of dynamical processes on networks, there has been intense focus on network structure -- i.e., the arrangement of edges and their associated weights -- but the effects of the temporal patterns of edges remains poorly…

Physics and Society · Physics 2015-06-16 Till Hoffmann , Mason A. Porter , Renaud Lambiotte