English
Related papers

Related papers: Correlation structure of stochastic neural network…

200 papers

We present a framework to define a large class of neural networks for which, by construction, training by gradient flow provably reaches arbitrarily low loss when the number of parameters grows. Distinct from the fixed-space global…

Optimization and Control · Mathematics 2025-01-13 David A. R. Robin , Kevin Scaman , Marc Lelarge

A steadily increasing body of evidence suggests that the brain performs probabilistic inference to interpret and respond to sensory input and that trial-to-trial variability in neural activity plays an important role. The neural sampling…

Neurons and Cognition · Quantitative Biology 2017-07-07 Ilja Bytschok , Dominik Dold , Johannes Schemmel , Karlheinz Meier , Mihai A. Petrovici

The presence of correlated noise, arising from a mixture of independent fluctuations and a common noisy input shared across the neural population, is a ubiquitous feature of neural circuits, yet its impact on collective network dynamics…

Neurons and Cognition · Quantitative Biology 2026-01-16 Hui Wang , Chunming Zheng

To understand the behavior of a neural circuit it is a presupposition that we have a model of the dynamical system describing this circuit. This model is determined by several parameters, including not only the synaptic weights, but also…

Neural and Evolutionary Computing · Computer Science 2016-08-23 J. Fischer , P. Manoonpong , S. Lackner

Stochastic models share many characteristics with generic parametric models. In some ways they can be regarded as a special case. But for stochastic models there is a notion of weak distribution or generalised random variable, and the same…

Numerical Analysis · Mathematics 2018-09-05 Hermann G. Matthies

Motivated by modern observational studies, we introduce a class of functional models that expands nested and crossed designs. These models account for the natural inheritance of correlation structure from sampling design in studies where…

Applications · Statistics 2013-04-26 Haochang Shou , Vadim Zipunnikov , Ciprian M. Crainiceanu , Sonja Greven

Neural networks encode information through their collective spiking activity in response to external stimuli. This population response is noisy and strongly correlated, with complex interplay between correlations induced by the stimulus,…

Neurons and Cognition · Quantitative Biology 2022-11-28 Gabriel Mahuas , Olivier Marre , Thierry Mora , Ulisse Ferrari

A unified approach to studying convergence and stochastic stability of continuous time consensus protocols (CPs) is presented in this work. Our method applies to networks with directed information flow; both cooperative and noncooperative…

Optimization and Control · Mathematics 2012-06-05 Georgi S. Medvedev

In established network architectures, shortcut connections are often used to take the outputs of earlier layers as additional inputs to later layers. Despite the extraordinary effectiveness of shortcuts, there remain open questions on the…

Machine Learning · Computer Science 2021-11-15 Fenglei Fan , Dayang Wang , Hengtao Guo , Qikui Zhu , Pingkun Yan , Ge Wang , Hengyong Yu

Functional connectivity is a fundamental property of neural networks that quantifies the segregation and integration of information between cortical areas. Due to mathematical complexity, a theory that could explain how the parameters of…

Neurons and Cognition · Quantitative Biology 2016-05-27 Diego Fasoli , Anna Cattani , Stefano Panzeri

We study the relationship between dynamical properties and interaction patterns in complex oscillator networks in the presence of noise. A striking finding is that noise leads to a general, one-to-one correspondence between the dynamical…

Data Analysis, Statistics and Probability · Physics 2010-02-05 Jie Ren , Wen-Xu Wang , Baowen Li , Ying-Cheng Lai

While many approaches to make neural networks more fathomable have been proposed, they are restricted to interrogating the network with input data. Measures for characterizing and monitoring structural properties, however, have not been…

Machine Learning · Computer Science 2019-09-30 Bastian Rieck , Matteo Togninalli , Christian Bock , Michael Moor , Max Horn , Thomas Gumbsch , Karsten Borgwardt

The geometry of Arithmetic Random Waves has been extensively investigated in the last fifteen years, starting from the seminal papers [RW08, ORW08]. In this paper we study the correlation structure among different functionals such as nodal…

Probability · Mathematics 2023-12-21 Valentina Cammarota , Riccardo-W. Maffucci , Domenico Marinucci , Maurizia Rossi

The present work provides a profound analytical and numerical analysis of the material properties of SFRC on the mesoscale as well as the resulting correlation structure taking into account the probabilistic characteristics of the fiber…

Computational Engineering, Finance, and Science · Computer Science 2020-09-01 Natalie Rauter , Rolf Lammering

Network neuroscience is the emerging discipline concerned with investigating the complex patterns of interconnections found in neural systems, and to identify principles with which to understand them. Within this discipline, one…

Neurons and Cognition · Quantitative Biology 2017-08-29 Richard F. Betzel , Danielle S. Bassett

Many natural systems are organized as networks, in which the nodes (be they cells, individuals or populations) interact in a time-dependent fashion. The dynamic behavior of these networks depends on how these nodes are connected, which can…

Neurons and Cognition · Quantitative Biology 2015-06-22 Anca Radulescu , Sergio Verduzco-Flores

Recurrence networks are powerful tools used effectively in the nonlinear analysis of time series data. The analysis in this context is done mostly with unweighted and undirected complex networks constructed with specific criteria from the…

Chaotic Dynamics · Physics 2017-09-18 Rinku Jacob , K. P. Harikrishnan , R. Misra , G. Ambika

We address a question on the effect of common stochastic inputs on the correlation of the spikes trains of two neurons when they are possibly nonidentical and are coupled through direct connections. We show that the change in the…

Neurons and Cognition · Quantitative Biology 2013-04-24 E. Bolhasani , Y. Azizi , A. Valizadeh

Sequential activation of neurons is a common feature of network activity during a variety of behaviors, including working memory and decision making. Previous network models for sequences and memory emphasized specialized architectures in…

Neurons and Cognition · Quantitative Biology 2016-03-16 Kanaka Rajan , Christopher D Harvey , David W Tank

The predictive power of neural networks often costs model interpretability. Several techniques have been developed for explaining model outputs in terms of input features; however, it is difficult to translate such interpretations into…

Machine Learning · Computer Science 2017-08-17 Benjamin J. Lengerich , Sandeep Konam , Eric P. Xing , Stephanie Rosenthal , Manuela Veloso