English
Related papers

Related papers: Generalized Measures of Information Transfer

200 papers

Data from social media are providing unprecedented opportunities to investigate the processes that rule the dynamics of collective social phenomena. Here, we consider an information theoretical approach to define and measure the temporal…

Phase transitions abound in nature and society, and, from species extinction to stock market collapse, their prediction is of widespread importance. In earlier work we showed that Global Transfer Entropy, a general measure of information…

Statistical Mechanics · Physics 2021-04-12 Joshua Brown , Terry Bossomaier , Lionel Barnett

Information theory is a practical and theoretical framework developed for the study of communication over noisy channels. Its probabilistic basis and capacity to relate statistical structure to function make it ideally suited for studying…

Neurons and Cognition · Quantitative Biology 2015-01-09 Robin A. A. Ince , Simon R. Schultz , Stefano Panzeri

We relate the information exchange between two stochastic systems to the nonequilibrium entropy production in the whole system. By deriving a general formula that decomposes the total entropy production into the thermodynamic and…

Statistical Mechanics · Physics 2015-06-16 Takahiro Sagawa , Masahito Ueda

Given an unknown quantum state distributed over two systems, we determine how much quantum communication is needed to transfer the full state to one system. This communication measures the "partial information" one system needs conditioned…

Quantum Physics · Physics 2007-05-23 Michal Horodecki , Jonathan Oppenheim , Andreas Winter

Problem of classification of all the set of entangled states is considered. Invariance of entangled states relative to transformations from a group of symmetry of qubit space leads to classification of all states of the system through…

Quantum Physics · Physics 2007-05-23 Constantin V. Usenko

Some bounds on the entropic informational quantities related to a quantum continual measurement are obtained and the time dependencies of these quantities are studied.

Quantum Physics · Physics 2009-10-09 Alberto Barchielli , Giancarlo Lupieri

We develop information-theoretic measures of spatial structure and pattern in more than one dimension. As is well known, the entropy density of a two-dimensional configuration can be efficiently and accurately estimated via a converging…

Statistical Mechanics · Physics 2009-11-07 David P. Feldman , James P. Crutchfield

It is widely known that `collapse of the wave function' on a quantum system A may be brought about by an interaction with another quantum system B. We will prove that this is not just a possible, but a necessary consequence of information…

Quantum Physics · Physics 2007-05-23 Bas Janssens

A novel measure, quantumness of correlations is introduced here for bipartite states, by incorporating the required measurement scheme crucial in defining any such quantity. Quantumness coincides with the previously proposed measures in…

Quantum Physics · Physics 2008-04-20 A. R. Usha Devi , A. K. Rajagopal

We introduce variants of relative entropy of entanglement based on the optimal distinguishability from unentangled states by means of restricted measurements. In this way, we are able to prove that the standard regularized entropy of…

Quantum Physics · Physics 2010-01-29 M. Piani

Higher-order information theory has become a rapidly growing toolkit in computational neuroscience, motivated by the idea that multivariate dependencies can reveal aspects of neural computation and communication that are invisible to…

Neurons and Cognition · Quantitative Biology 2025-12-03 D. Rebbin , K. J. A. Down , T. F. Varley , R. Ince , A. Canales-Johnson

Transfer learning has become an essential paradigm in artificial intelligence, enabling the transfer of knowledge from a source task to improve performance on a target task. This approach, particularly through techniques such as pretraining…

Shannon Entropy is the preeminent tool for measuring the level of uncertainty (and conversely, information content) in a random variable. In the field of communications, entropy can be used to express the information content of given…

Information Theory · Computer Science 2024-11-06 Bill Kay , Audun Myers , Thad Boydston , Emily Ellwein , Cameron Mackenzie , Iliana Alvarez , Erik Lentz

Information flow between components of a system takes many forms and is key to understanding the organization and functioning of large-scale, complex systems. We demonstrate three modalities of information flow from time series X to time…

Statistical Mechanics · Physics 2018-08-22 Ryan G. James , Blanca Daniella Mansante Ayala , Bahti Zakirov , James P. Crutchfield

Information entropy is applied to the state of knowledge of reaction amplitudes in pseudoscalar meson photoproduction, and a scheme is developed that quantifies the information content of a measured set of polarization observables. It is…

High Energy Physics - Phenomenology · Physics 2010-09-02 D. G. Ireland

We propose utilizing entropy as a diagnostic tool to distinguish between constant and dynamical dark energy models. Entropy, a measure of the system's disorder or information content, captures the complexity and evolution of the universe.…

General Relativity and Quantum Cosmology · Physics 2025-07-16 Tanisha Joshi

General characterization of physical measurements is discussed within the framework of a classical information theory. Uncertainty relation for simultaneous measurements of two physical observables is defined in this framework for…

Quantum Physics · Physics 2012-12-18 Yoshimasa Kurihara

Due to the absence of an external, classical time variable, the probabilistic predictions of covariant quantum theory are ambiguous when multiple measurements are considered. Here, we introduce an information theoretic framework to the…

Quantum Physics · Physics 2011-11-09 S. Jay Olson , Jonathan P. Dowling

In many quantum information processing applications, it is important to be able to transfer a quantum state from one location to another - even within a local device. Typical approaches to implement the quantum state transfer rely on…

Quantum Physics · Physics 2018-10-09 Yuichiro Matsuzaki , Victor M. Bastidas , Yuki Takeuchi , William J. Munro , Shiro Saito