English
Related papers

Related papers: The Pair-Replica-Mean-Field Limit for Intensity-ba…

200 papers

Random walks are gaining much attention from the networks research community. They are the basis of many proposals aimed to solve a variety of network-related problems such as resource location, network construction, nodes sampling, etc.…

Disordered Systems and Neural Networks · Physics 2009-08-06 Luis Rodero-Merino , Antonio Fernandez Anta , Luis Lopez , Vicent Chovi

It is well-known that the expressivity of a neural network depends on its architecture, with deeper networks expressing more complex functions. In the case of networks that compute piecewise linear functions, such as those with ReLU…

Machine Learning · Statistics 2019-06-12 Boris Hanin , David Rolnick

In this paper, we elaborate over the well-known interpretability issue in echo state networks. The idea is to investigate the dynamics of reservoir neurons with time-series analysis techniques taken from research on complex systems.…

Data Analysis, Statistics and Probability · Physics 2016-11-21 Filippo Maria Bianchi , Lorenzo Livi , Cesare Alippi

It has been recognized that many complex dynamical systems in the real world require a description in terms of multiplex networks, where a set of common, mutually connected nodes belong to distinct network layers and play a different role…

Physics and Society · Physics 2019-12-23 Chuang Ma , Han-Shuang Chen , Xiang Li , Ying-Cheng Lai , Hai-Feng Zhang

Both the path integral measure in field theory and ensembles of neural networks describe distributions over functions. When the central limit theorem can be applied in the infinite-width (infinite-$N$) limit, the ensemble of networks…

High Energy Physics - Theory · Physics 2023-12-15 Mehmet Demirtas , James Halverson , Anindita Maiti , Matthew D. Schwartz , Keegan Stoner

The parallel computational complexity or depth of growing network models is investigated. The networks considered are generated by preferential attachment rules where the probability of attaching a new node to an existing node is given by a…

Statistical Mechanics · Physics 2009-11-10 Benjamin Machta , Jonthan Machta

In this work, we propose a nonlinear stochastic model of a network of stochastic spiking neurons. We heuristically derive the mean-field limit of this system. We then design a Monte Carlo method for the simulation of the microscopic system,…

Numerical Analysis · Mathematics 2019-06-26 Benjamin Aymard , Fabien Campillo , Romain Veltz

Compartmental epidemic models with dynamics that evolve over a graph network have gained considerable importance in recent years but analysis of these models is in general difficult due to their complexity. In this paper, we develop two…

Populations and Evolution · Quantitative Biology 2023-05-31 Sei Zhen Khong , Lanlan Su

A new brain model is introduced, based on the Impulse Pattern Formulation (IPF) already established for modeling and understanding musical instrument and rhythm perception and production. It assumes the brain works with impulses, neural…

Neurons and Cognition · Quantitative Biology 2023-01-24 Rolf Bader

The intensity matching approach for tractable performance evaluation and optimization of cellular networks is introduced. It assumes that the base stations are modeled as points of a Poisson point process and leverages stochastic geometry…

Information Theory · Computer Science 2016-04-12 Marco Di Renzo , Wei Lu , Peng Guan

We deal with the problem of bridging the gap between two scales in neuronal modeling. At the first (microscopic) scale, neurons are considered individually and their behavior described by stochastic differential equations that govern the…

Biological Physics · Physics 2010-11-09 Olivier Faugeras , Jonathan Touboul , Bruno Cessac

A central challenge in the computational modeling of neural dynamics is the trade-off between accuracy and simplicity. At the level of individual neurons, nonlinear dynamics are both experimentally established and essential for neuronal…

We study the complexity of functions computable by deep feedforward neural networks with piecewise linear activations in terms of the symmetries and the number of linear regions that they have. Deep networks are able to sequentially map…

Machine Learning · Statistics 2014-06-10 Guido Montúfar , Razvan Pascanu , Kyunghyun Cho , Yoshua Bengio

We consider the problem of neural association for a network of non-binary neurons. Here, the task is to first memorize a set of patterns using a network of neurons whose states assume values from a finite number of integer levels. Later,…

Neural and Evolutionary Computing · Computer Science 2013-02-18 Amir Hesam Salavati , K. Raj Kumar , Amin Shokrollahi

Deploying deep learning models, comprising of non-linear combination of millions, even billions, of parameters is challenging given the memory, power and compute constraints of the real world. This situation has led to research into model…

Machine Learning · Computer Science 2020-05-29 Muhammad A. Shah , Raphael Olivier , Bhiksha Raj

Learning a task induces connectivity changes in neural circuits, thereby changing their dynamics. To elucidate task related neural dynamics we study trained Recurrent Neural Networks. We develop a Mean Field Theory for Reservoir Computing…

Neurons and Cognition · Quantitative Biology 2017-06-28 Alexander Rivkind , Omri Barak

The network representation is becoming increasingly popular for the description of cardiovascular interactions based on the analysis of multiple simultaneously collected variables. However, the traditional methods to assess network links…

Nonlinear interactions in the dendritic tree play a key role in neural computation. Nevertheless, modeling frameworks aimed at the construction of large-scale, functional spiking neural networks, such as the Neural Engineering Framework,…

Neurons and Cognition · Quantitative Biology 2021-01-01 Andreas Stöckel , Chris Eliasmith

From the perspective of network analysis, the ubiquitous networks are comprised of regular and irregular components, which makes uncovering the complexity of network structures to be a fundamental challenge. Exploring the regular…

Social and Information Networks · Computer Science 2018-08-30 Tao Wu , Shaojie Qiao , Xingping Xian , Xi-Zhao Wang , Wei Wang , Yanbing Liu

We study the asymptotic behavior for asymmetric neuronal dynamics in a network of linear Hopfield neurons. The interaction between the neurons is modeled by random couplings which are centered i.i.d. random variables with finite moments of…

Probability · Mathematics 2020-06-08 Olivier Faugeras , Émilie Soret , Etienne Tanré