English
Related papers

Related papers: Inferring Information Flow in Spike-train Data Set…

200 papers

Neurophysiologists are nowadays able to record from a large number of extracellular electrodes and to extract, from the raw data, the sequences of action potentials or spikes generated by many neurons. Unfortunately these ''many neurons''…

Applications · Statistics 2026-04-22 Pierre Charitat , Ségolen Geffray , Christophe Pouzat

The characterisation of information processing is an important task in complex systems science. Information dynamics is a quantitative methodology for modelling the intrinsic information processing conducted by a process represented as a…

Information Theory · Computer Science 2018-08-01 Richard E. Spinney , Joseph T. Lizier

Sleep stage classification is a widely discussed topic, due to its importance in the diagnosis of sleep disorders, e.g. insomnia. Analysis of the brain activity during sleep is necessary to gain further insight into the processing that…

Signal Processing · Electrical Eng. & Systems 2024-10-08 Alexander Edthofer , Iris Feldhammer , Thomas Fenzl , Andreas Körner , Matthias Kreuzer

Whether the system under study is a shoal of fish, a collection of neurons, or a set of interacting atmospheric and oceanic processes, transfer entropy measures the flow of information between time series and can detect possible causal…

Machine Learning · Computer Science 2024-11-08 Kieran A. Murphy , Zhuowen Yin , Dani S. Bassett

The major problem in information theoretic analysis of neural responses and other biological data is the reliable estimation of entropy--like quantities from small samples. We apply a recently introduced Bayesian entropy estimator to…

Data Analysis, Statistics and Probability · Physics 2009-09-29 Ilya Nemenman , William Bialek , Rob de Ruyter van Steveninck

A central task in analyzing complex dynamics is to determine the loci of information storage and the communication topology of information flows within a system. Over the last decade and a half, diagnostics for the latter have come to be…

Statistical Mechanics · Physics 2016-06-20 Ryan G. James , Nix Barnett , James P. Crutchfield

Understanding the interaction patterns among simultaneous recordings of spike trains from multiple neuronal units is a key topic in neuroscience. However, an optimal approach of assessing these interactions has not been established, as…

Neurons and Cognition · Quantitative Biology 2020-12-17 Gorana Mijatovic , Yuri Antonacci , Tatjana Loncar-Turukalo , Ludovico Minati , Luca Faes

The characterization of network and biophysical properties from neural spiking activity is an important goal in neuroscience. A framework that provides unbiased inference on causal synaptic interaction and single neural properties has been…

Neurons and Cognition · Quantitative Biology 2024-05-27 Kevin S. Chen , Ying-Jen Yang

Entropy is a classical measure to quantify the amount of information or complexity of a system. Various entropy-based measures such as functional and spectral entropies have been proposed in brain network analysis. However, they are less…

Neurons and Cognition · Quantitative Biology 2018-03-08 Hyekyoung Lee , Eunkyung Kim , Hyejin Kang , Youngmin Huh , Youngjo Lee , Seonhee Lim , Dong Soo Lee

We explore the connection between deep learning and information theory through the paradigm of diffusion models. A diffusion model converts noise into structured data by reinstating, imperfectly, information that is erased when data was…

Machine Learning · Computer Science 2025-11-04 Akhil Premkumar

Functional and effective networks inferred from time series are at the core of network neuroscience. Interpreting their properties requires inferred network models to reflect key underlying structural features; however, even a few spurious…

Neurons and Cognition · Quantitative Biology 2022-09-22 Leonardo Novelli , Joseph T. Lizier

The transfer entropy is a well-established measure of information flow, which quantifies directed influence between two stochastic time series and has been shown to be useful in a variety fields of science. Here we introduce the transfer…

Statistical Mechanics · Physics 2018-07-23 Sosuke Ito

This work explores entropy analysis as a tool for probing information distribution within Transformer-based architectures. By quantifying token-level uncertainty and examining entropy patterns across different stages of processing, we aim…

Computation and Language · Computer Science 2025-07-31 Amedeo Buonanno , Alessandro Rivetti , Francesco A. N. Palmieri , Giovanni Di Gennaro , Gianmarco Romano

The accurate estimation of human activity in cities is one of the first steps towards understanding the structure of the urban environment. Human activities are highly granular and dynamic in spatial and temporal dimensions. Estimating…

Information Theory · Computer Science 2025-01-14 Roberto Murcio , Balamurugan Soundararaj

Identifying the spatio-temporal network structure of brain activity from multi-neuronal data streams is one of the biggest challenges in neuroscience. Repeating patterns of precisely timed activity across a group of neurons is potentially…

Neurons and Cognition · Quantitative Biology 2009-03-03 Casey Diekman , Kohinoor Dasgupta , Vijay Nair , P. S. Sastry , K. P. Unnikrishnan

Data stream mining problem has caused widely concerns in the area of machine learning and data mining. In some recent studies, ensemble classification has been widely used in concept drift detection, however, most of them regard…

Data Structures and Algorithms · Computer Science 2017-08-14 Junhong Wang , Shuliang Xu , Bingqian Duan , Caifeng Liu , Jiye Liang

Transfer entropy is a widely used measure for quantifying directed information flows in complex systems. While the challenges of estimating transfer entropy for continuous data are well known, it has two major shortcomings for data of…

Data Analysis, Statistics and Probability · Physics 2025-11-27 Alec Kirkley

Transfer entropy (TE) is an information theoretic measure that reveals the directional flow of information between processes, providing valuable insights for a wide range of real-world applications. This work proposes Transfer Entropy…

Information Theory · Computer Science 2025-07-22 Omer Luxembourg , Dor Tsur , Haim Permuter

We theoretically investigate the flow of information in an interacting two-skyrmion system confined in a box at finite temperature. By numerical simulations based on the Thiele-Langevin equation, we demonstrate that the skyrmion motion…

Mesoscale and Nanoscale Physics · Physics 2026-03-10 Tenta Tani , Soma Miki , Hiroki Mori , Minori Goto , Yoshishige Suzuki , Eiiti Tamura

Dynamic functional connectivity is an effective measure for the brain's responses to continuous stimuli. We propose an inferential method to detect the dynamic changes of brain networks based on time-varying graphical models. Whereas most…

Applications · Statistics 2020-06-23 Dingjue Ji , Junwei Lu , Yiliang Zhang , Hongyu Zhao , Siyuan Gao