English
Related papers

Related papers: Characterizing variability in nonlinear recurrent …

200 papers

We propose stochastic, non-parametric activation functions that are fully learnable and individual to each neuron. Complexity and the risk of overfitting are controlled by placing a Gaussian process prior over these functions. The result is…

Machine Learning · Statistics 2017-12-01 Sebastian Urban , Marcus Basalla , Patrick van der Smagt

Neural population activity often exhibits rich variability and temporal structure. This variability is thought to arise from single-neuron stochasticity, neural dynamics on short time-scales, as well as from modulations of neural firing…

Machine Learning · Statistics 2014-10-14 Mijung Park , Jakob H. Macke

Dynamical balance of excitation and inhibition is usually invoked to explain the irregular low firing activity observed in the cortex. We propose a robust nonlinear balancing mechanism for a random network of spiking neurons, which works…

Disordered Systems and Neural Networks · Physics 2025-05-29 Antonio Politi , Alessandro Torcini

Dynamic networks models describe a growing number of important scientific processes, from cell biology and epidemiology to sociology and finance. There are many aspects of dynamical networks that require statistical considerations. In this…

Methodology · Statistics 2012-05-15 E. C. Wit , A. Abbruzzo

A number of recent papers have provided evidence that practical design questions about neural networks may be tackled theoretically by studying the behavior of random networks. However, until now the tools available for analyzing random…

Machine Learning · Statistics 2017-10-19 Samuel S. Schoenholz , Jeffrey Pennington , Jascha Sohl-Dickstein

Despite the incredible complexity of our brains' neural networks, theoretical descriptions of neural dynamics have led to profound insights into possible network states and dynamics. It remains challenging to develop theories that apply to…

Neurons and Cognition · Quantitative Biology 2022-07-06 Jonas Ranft , Benjamin Lindner

Models of complex networks often incorporate node-intrinsic properties abstracted as hidden variables. The probability of connections in the network is then a function of these variables. Real-world networks evolve over time, and many…

Physics and Society · Physics 2021-05-19 Harrison Hartle , Fragkiskos Papadopoulos , Dmitri Krioukov

The dynamics of stochastic reaction networks within cells are inevitably modulated by factors considered extrinsic to the network such as for instance the fluctuations in ribsome copy numbers for a gene regulatory network. While several…

Quantitative Methods · Quantitative Biology 2015-06-19 Christoph Zechner , Heinz Koeppl

Time is at a premium for recurrent network dynamics, and particularly so when they are stochastic and correlated: the quality of inference from such dynamics fundamentally depends on how fast the neural circuit generates new samples from…

Neurons and Cognition · Quantitative Biology 2014-04-24 Guillaume Hennequin , Laurence Aitchison , Máté Lengyel

We address the problem of identifying functional interactions among stochastic neurons with variable-length memory from their spiking activity. The neuronal network is modeled by a stochastic system of interacting point processes with…

Applications · Statistics 2025-07-01 Ricardo F. Ferreira , Matheus E. Pacola , Vitor G. Schiavone , Rodrigo F. O. Pena

The presence of correlated noise, arising from a mixture of independent fluctuations and a common noisy input shared across the neural population, is a ubiquitous feature of neural circuits, yet its impact on collective network dynamics…

Neurons and Cognition · Quantitative Biology 2026-01-16 Hui Wang , Chunming Zheng

Randomly coupled neural fields demonstrate chaotic variation of firing rates, if the coupling is strong enough, as has been shown by Sompolinsky et. al [Phys. Rev. Lett., v. 61, 259 (1988)]. We present a method for reconstruction of the…

Chaotic Dynamics · Physics 2016-07-20 A. Pikovsky

Stochastic networks are a plausible representation of the relational information among entities in dynamic systems such as living cells or social communities. While there is a rich literature in estimating a static or temporally invariant…

Machine Learning · Statistics 2010-10-21 Mladen Kolar , Le Song , Amr Ahmed , Eric P. Xing

This paper revisits the classical concept of network modularity and its spectral relaxations used throughout graph data analysis. We formulate and study several modularity statistic variants for which we establish asymptotic distributional…

Methodology · Statistics 2024-02-26 Anirban Mitra , Konasale Prasad , Joshua Cape

Advances in simultaneous recordings of large numbers of neurons have driven significant interest in the structure of neural population activity such as dimension. A key question is how these dynamic features arise mechanistically and their…

Neurons and Cognition · Quantitative Biology 2025-08-08 Xuanyu Shen , Yu Hu

The time elapsed model describes the firing activity of an homogeneous assembly of neurons thanks to the distribution of times elapsed since the last discharge. It gives a mathematical description of the probability density of neurons…

Analysis of PDEs · Mathematics 2011-09-16 Khashayar Pakdaman , Benoît Perthame , Delphine Salort

A given neural network in the brain is involved in many different tasks. This implies that, when considering a specific task, the network's connectivity contains a component which is related to the task and another component which can be…

Neurons and Cognition · Quantitative Biology 2021-03-17 Friedrich Schuessler , Alexis Dubreuil , Francesca Mastrogiuseppe , Srdjan Ostojic , Omri Barak

We deal with the problem of bridging the gap between two scales in neuronal modeling. At the first (microscopic) scale, neurons are considered individually and their behavior described by stochastic differential equations that govern the…

Biological Physics · Physics 2010-11-09 Olivier Faugeras , Jonathan Touboul , Bruno Cessac

How can we efficiently propagate uncertainty in a latent state representation with recurrent neural networks? This paper introduces stochastic recurrent neural networks which glue a deterministic recurrent neural network and a state space…

Machine Learning · Statistics 2016-11-15 Marco Fraccaro , Søren Kaae Sønderby , Ulrich Paquet , Ole Winther

We use a biophysical model of a local neuronal circuit to study the implications of synaptic plasticity for the detection of weak sensory stimuli. Networks with fast plastic coupling show behavior consistent with stochastic resonance.…

Neurons and Cognition · Quantitative Biology 2009-11-13 Vladislav Volman , Herbert Levine