English
Related papers

Related papers: Breakdown of local information processing may unde…

200 papers

A central result that arose in applying information theory to the stochastic thermodynamics of nonlinear dynamical systems is the Information-Processing Second Law (IPSL): the physical entropy of the universe can decrease if compensated by…

Statistical Mechanics · Physics 2017-06-07 Alexander B. Boyd , Dibyendu Mandal , Paul M. Riechers , James P. Crutchfield

We show that a rate of conditional Shannon entropy reduction, characterizing the learning of an internal process about an external process, is bounded by the thermodynamic entropy production. This approach allows for the definition of an…

Biological Physics · Physics 2014-11-07 Andre C. Barato , David Hartich , Udo Seifert

We have investigated how memory effects on the teleportation of quantum Fisher information(QFI) for a single qubit system using a class of X-states as resources influenced by decoherence channels with memory, including amplitude damping,…

Quantum Physics · Physics 2020-01-08 Y. N. Guo , K. zeng , P. X. Chen

One of the basic tenets in information theory, the data processing inequality states that output divergence does not exceed the input divergence for any channel. For channels without input constraints, various estimates on the amount of…

Information Theory · Computer Science 2015-08-14 Yury Polyanskiy , Yihong Wu

The ability to discriminate similar visual stimuli is an important index of memory function. This ability is widely thought to be supported by expanding the dimensionality of relevant neural codes, such that neural representations for…

Neurons and Cognition · Quantitative Biology 2025-10-14 Dale Zhou , Sharon Mina Noh , Nora C Harhen , Nidhi V Banavar , C. Brock Kirwan , Michael A Yassa , Aaron M Bornstein

Epilepsy is a network disease. The epileptic network usually involves spatially distributed brain regions. In this context, noninvasive M/EEG source connectivity is an emerging technique to identify functional brain networks at cortical…

Neurons and Cognition · Quantitative Biology 2016-08-18 Mahmoud Hassan , Isabelle Merlet , Ahmad Mheich , Aya Kabbara , Arnaud Biraben , Anca Nica , Fabrice Wendling

Electroencephalography (EEG) source imaging aims to infer brain activity from electrical potentials measured on the scalp. This is a difficult problem because many different source patterns can explain the same measurements. The result…

Numerical Analysis · Mathematics 2026-04-29 Santtu Söderholm , Joonas Lahtinen , Sampsa Pursiainen

Patients with idiopathic generalised epilepsy (IGE) typically have normal conventional magnetic resonance imaging (MRI), hence MRI based diagnosis is challenging. Anatomical abnormalities underlying brain dysfunctions in IGE are unclear and…

Neurons and Cognition · Quantitative Biology 2020-09-30 Nishant Sinha , Yujiang Wang , Justin Dauwels , Marcus Kaiser , Thomas Thesen , Rob Forsyth , Peter Neal Taylor

Transfer entropy in information theory was recently demonstrated [Phys. Rev. E 102, 012404 (2020)] to enable us to elucidate the interaction domain among interacting elements solely from an ensemble of trajectories. There, only pairs of…

Adaptation and Self-Organizing Systems · Physics 2021-01-19 Udoy S. Basak , Sulimon Sattari , Hossain M. Motaleb , Kazuki Horikawa , Tamiki Komatsuzaki

We consider the electrical signals recorded from a subdural array of electrodes placed on the pial surface of the brain for chronic evaluation of epileptic patients before surgical resection. A simple and computationally fast method to…

Medical Physics · Physics 2007-11-18 Eshel Ben-Jacob , Stefano Boccaletti , Anna Pomyalov , Itamar Procaccia , Vernon L. Towle

Quantum information scrambling is a process happening during thermalization in quantum systems and describes the delocalization of quantum information. It is closely tied to entanglement, a key resource for quantum technologies and an order…

Quantum Physics · Physics 2024-08-07 Lea Haas , Christian Carisch , Oded Zilberberg

Inherent fuzzy entropy is an objective measurement of electroencephalography (EEG) complexity, reflecting the robustness of brain systems. In this study, we present a novel application of multi-scale relative inherent fuzzy entropy using…

Human-Computer Interaction · Computer Science 2019-05-28 Zehong Cao , Chin-Teng Lin , Kuan-Lin Lai , Li-Wei Ko , Jung-Tai King , Jong-Ling Fuh , Shuu-Jiun Wang

We present a computational evaluation of three hypotheses about sources of deficit in sentence comprehension in aphasia: slowed processing, intermittent deficiency, and resource reduction. The ACT-R based Lewis and Vasishth (2005) model is…

Computation and Language · Computer Science 2017-06-01 Paul Mätzig , Shravan Vasishth , Felix Engelmann , David Caplan

Given the hard problem of consciousness (Chalmers, 1995) there are no brain electrophysiological correlates of the subjective experience (the felt quality of redness or the redness of red, the experience of dark and light, the quality of…

Neurons and Cognition · Quantitative Biology 2021-03-08 Vitor Manuel Dinis Pereira

In order to understand whether nonlocality implies information transfer, a quantum optical experimental test, well within the scope of current technology, is proposed. It is essentially a delayed choice experiment as applied to entangled…

Quantum Physics · Physics 2007-05-23 R. Srikanth

The self-attention module is a key component of Transformer-based models, wherein each token pays attention to every other token. Recent studies have shown that these heads exhibit syntactic, semantic, or local behaviour. Some studies have…

Computation and Language · Computer Science 2020-08-14 Madhura Pande , Aakriti Budhraja , Preksha Nema , Pratyush Kumar , Mitesh M. Khapra

The transfer entropy is a well-established measure of information flow, which quantifies directed influence between two stochastic time series and has been shown to be useful in a variety fields of science. Here we introduce the transfer…

Statistical Mechanics · Physics 2018-07-23 Sosuke Ito

Causal inference is perhaps one of the most fundamental concepts in science, beginning originally from the works of some of the ancient philosophers, through today, but also weaved strongly in current work from statisticians, machine…

Information Theory · Computer Science 2020-03-31 Sudam Surasinghe , Erik M. Bollt

We investigate the out-of-equilibrium dynamics of quantum information in one-dimensional systems undergoing a quantum quench using a local perspective based on the information lattice. This framework provides a scale- and space-resolved…

The mutual information between a set of stimuli and the elicited neural responses is compared to the corresponding decoded information. The decoding procedure is presented as an artificial distortion of the joint probabilities between…

Biological Physics · Physics 2007-05-23 Ines Samengo