English
Related papers

Related papers: Maximum Entropy Principle Analysis in Network Syst…

200 papers

Maximum entropy principle (MEP) offers an effective and unbiased approach to inferring unknown probability distributions when faced with incomplete information, while neural networks provide the flexibility to learn complex distributions…

Machine Learning · Statistics 2024-12-04 Wuyue Yang , Liangrong Peng , Guojie Li , Liu Hong

Maximum entropy principle (MEP) analysis with few non-zero effective interactions successfully characterizes the distribution of dynamical states of pulse-coupled networks in many experiments, e.g., in neuroscience. To better understand the…

Biological Physics · Physics 2019-01-17 Zhi-Qin John Xu , Douglas Zhou , David Cai

The principle of maximum entropy provides a useful method for inferring statistical mechanics models from observations in correlated systems, and is widely used in a variety of fields where accurate data are available. While the assumptions…

Neurons and Cognition · Quantitative Biology 2017-06-02 Ulisse Ferrari , Tomoyuki Obuchi , Thierry Mora

The characterization of network and biophysical properties from neural spiking activity is an important goal in neuroscience. A framework that provides unbiased inference on causal synaptic interaction and single neural properties has been…

Neurons and Cognition · Quantitative Biology 2024-05-27 Kevin S. Chen , Ying-Jen Yang

Understanding the dynamics of neural networks is a major challenge in experimental neuroscience. For that purpose, a modelling of the recorded activity that reproduces the main statistics of the data is required. In a first part, we present…

Neurons and Cognition · Quantitative Biology 2014-04-15 Hassan Nasser , Olivier Marre , Bruno Cessac

We propose a numerical method to learn Maximum Entropy (MaxEnt) distributions with spatio-temporal constraints from experimental spike trains. This is an extension of two papers [10] and [4] who proposed the estimation of parameters where…

Neurons and Cognition · Quantitative Biology 2015-06-19 Hassan Nasser , Bruno Cessac

Understanding how stimuli and synaptic connectivity in uence the statistics of spike patterns in neural networks is a central question in computational neuroscience. Maximum Entropy approach has been successfully used to characterize the…

Biological Physics · Physics 2016-11-26 Rodrigo Cofre , Bruno Cessac

Maximum entropy models are the least structured probability distributions that exactly reproduce a chosen set of statistics measured in an interacting network. Here we use this principle to construct probabilistic models which describe the…

Neurons and Cognition · Quantitative Biology 2014-01-28 Gašper Tkačik , Olivier Marre , Dario Amodei , Elad Schneidman , William Bialek , Michael J Berry

The maximum entropy principle (MEP) is a method for obtaining the most likely distribution functions of observables from statistical systems, by maximizing entropy under constraints. The MEP has found hundreds of applications in ergodic and…

Classical Physics · Physics 2016-10-03 Rudolf Hanel , Stefan Thurner , Murray Gell-Mann

Maximum entropy methods provide a principled path connecting measurements of neural activity directly to statistical physics models, and this approach has been successful for populations of $N\sim 100$ neurons. As $N$ increases in new…

Biological Physics · Physics 2023-10-18 Christopher W. Lynn , Qiwei Yu , Rich Pang , William Bialek , Stephanie E. Palmer

Maximum entropy models provide the least constrained probability distributions that reproduce statistical properties of experimental datasets. In this work we characterize the learning dynamics that maximizes the log-likelihood in the case…

Disordered Systems and Neural Networks · Physics 2016-09-21 Ulisse Ferrari

We use statistical estimates of the entropy rate of spike train data in order to make inferences about the underlying structure of the spike train itself. We first examine a number of different parametric and nonparametric estimators (some…

Neurons and Cognition · Quantitative Biology 2008-03-27 Yun Gao , Ioannis Kontoyiannis , Elie Bienenstock

Sampling considerations limit the experimental conditions under which information theoretic analyses of neurophysiological data yield reliable results. We develop a procedure for computing the full temporal entropy and information of…

Biological Physics · Physics 2009-11-06 Simon R. Schultz , Stefano Panzeri

Moment-closure methods are popular tools to simplify the mathematical analysis of stochastic models defined on networks, in which high dimensional joint distributions are approximated (often by some heuristic argument) as functions of lower…

Data Analysis, Statistics and Probability · Physics 2011-05-25 Tim Rogers

Maximum entropy models are increasingly being used to describe the collective activity of neural populations with measured mean neural activities and pairwise correlations, but the full space of probability distributions consistent with…

Biological Physics · Physics 2017-08-22 Badr F. Albanna , Christopher Hillar , Jascha Sohl-Dickstein , Michael R. DeWeese

Modern deep neural networks achieved remarkable progress in medical image segmentation tasks. However, it has recently been observed that they tend to produce overconfident estimates, even in situations of high uncertainty, leading to…

Computer Vision and Pattern Recognition · Computer Science 2023-06-05 Agostina Larrazabal , Cesar Martinez , Jose Dolz , Enzo Ferrante

The field of complex networks studies a wide variety of interacting systems by representing them as networks. To understand their properties and mutual relations, the randomisation of network connections is a commonly used tool. However,…

Statistical Mechanics · Physics 2024-10-18 Noam Abadi , Franco Ruzzenenti

Maximum Entropy models can be inferred from large data-sets to uncover how collective dynamics emerge from local interactions. Here, such models are employed to investigate neurons recorded by multielectrode arrays in the human and monkey…

Neurons and Cognition · Quantitative Biology 2018-07-11 Trang-Anh Nghiem , Bartosz Telenczuk , Olivier Marre , Alain Destexhe , Ulisse Ferrari

Spiking activity from populations of neurons display causal interactions and memory effects. Therefore, they are expected to show some degree of irreversibility in time. Motivated by the spike train statistics, in this paper we build a…

Biological Physics · Physics 2015-12-07 Rodrigo Cofre , Cesar Maldonado

The aim of this paper is to investigate various information-theoretic measures, including entropy, mutual information, and some systematic measures that based on mutual information, for a class of structured spiking neuronal network. In…

Neurons and Cognition · Quantitative Biology 2019-12-04 Wenjie Li , Yao Li
‹ Prev 1 2 3 10 Next ›