English
Related papers

Related papers: On the Information Loss in Memoryless Systems: The…

200 papers

Measures of information transfer have become a popular approach to analyze interactions in complex systems such as the Earth or the human brain from measured time series. Recent work has focused on causal definitions of information transfer…

Methodology · Statistics 2016-03-21 Jakob Runge

We present a framework for quantifying information flow within general quantum processes. For this purpose, we introduce the signaling power of quantum channels and discuss its relevant operational properties. This function supports…

Quantum Physics · Physics 2025-08-08 Leonardo S. V. Santos , Zhen-Peng Xu , Jyrki Piilo , Otfried Gühne

We introduce a novel notion of invariance feedback entropy to quantify the state information that is required by any controller that enforces a given subset of the state space to be invariant. We establish a number of elementary properties,…

Systems and Control · Computer Science 2019-08-07 Mahendra Singh Tomar , Matthias Rungger , Majid Zamani

When additional information sources are available, an important question for an agent solving a certain problem is how to optimally use the information the sources are capable of providing. A framework that relates information accuracy on…

Data Analysis, Statistics and Probability · Physics 2013-01-11 Eugene Perevalov , David Grace

By defining information entropy in terms of probabilities densities $|\Psi|^2$ ($\Psi$ is a wave function in the coordinate representation) it is explicitly shown how a loss of quantum information occurs in a transition from a quantum to a…

Quantum Physics · Physics 2007-05-23 Alex Granik

One of the crucial steps in scientific studies is to specify dependent relationships among factors in a system of interest. Given little knowledge of a system, can we characterize the underlying dependent relationships through observation…

Information Theory · Computer Science 2012-12-24 Shohei Hidaka

It is not obvious what fraction of all the potential information residing in the molecules and structures of living systems is significant or meaningful to the system. Sets of random sequences or identically repeated sequences, for example,…

Information Theory · Computer Science 2008-01-28 David J. Galas , Matti Nykter , Gregory W. Carter , Nathan D. Price , Ilya Shmulevich

Information theory, rooted in computer science, and many-body physics, have traditionally been studied as (almost) independent fields. Only recently has this paradigm started to shift, with many-body physics being studied and characterized…

Disordered Systems and Neural Networks · Physics 2024-02-20 Noa Feldman , Niv Davidson , Moshe Goldstein

Information theory is a practical and theoretical framework developed for the study of communication over noisy channels. Its probabilistic basis and capacity to relate statistical structure to function make it ideally suited for studying…

Neurons and Cognition · Quantitative Biology 2015-01-09 Robin A. A. Ince , Simon R. Schultz , Stefano Panzeri

Integrated information theory is a mathematical, quantifiable theory of conscious experience. The linchpin of this theory, the $\phi$ measure, quantifies a system's irreducibility to disjoint parts. Purely as a measure of irreducibility, we…

Information Theory · Computer Science 2014-10-10 Virgil Griffith

In this paper, we view a policy or plan as a transition system over a space of information states that reflect a robot's or other observer's perspective based on limited sensing, memory, computation, and actuation. Regardless of whether…

Robotics · Computer Science 2022-12-02 Basak Sakcak , Vadim Weinstein , Steven M. LaValle

Exploiting the theory of state space models, we derive the exact expressions of the information transfer, as well as redundant and synergistic transfer, for coupled Gaussian processes observed at multiple temporal scales. All of the terms,…

Methodology · Statistics 2017-08-21 Luca Faes , Daniele Marinazzo , Sebastiano Stramaglia

Integrated Information Theory is one of the leading models of consciousness. It aims to describe both the quality and quantity of the conscious experience of a physical system, such as the brain, in a particular state. In this contribution,…

Neurons and Cognition · Quantitative Biology 2020-02-19 Johannes Kleiner , Sean Tull

Quantum information refers to the distinctive information-processing properties of quantum systems, which arise when information is stored in or retrieved from nonorthogonal quantum states. More information is required to prepare an…

Quantum Physics · Physics 2007-05-23 Carlton M. Caves , Christopher A. Fuchs

Integrated information theory (IIT) has established itself as one of the leading theories for the study of consciousness. IIT essentially proposes that quantitative consciousness is identical to maximally integrated conceptual information,…

Neurons and Cognition · Quantitative Biology 2017-03-06 Stephan Krohn , Dirk Ostwald

The concept of information has emerged as a language in its own right, bridging several disciplines that analyze natural phenomena and man-made systems. Integrated information has been introduced as a metric to quantify the amount of…

Neurons and Cognition · Quantitative Biology 2019-06-10 Alberto Hernández-Espinosa , Héctor Zenil , Narsis A. Kiani , Jesper Tegnér

Does information play a significant role in the foundations of physics? Information is the abstraction that allows us to refer to the states of systems when we choose to ignore the systems themselves. This is only possible in very…

Quantum Physics · Physics 2014-03-05 Lluis Masanes , Markus P. Mueller , Remigiusz Augusiak , David Perez-Garcia

We introduce notions of information/entropy and information loss associated to exponentiable motivic measures. We show that they satisfy appropriate analogs to the Khinchin-type properties that characterize information loss in the context…

Mathematical Physics · Physics 2017-12-27 Matilde Marcolli

In this technical note, we investigate information quantities of state-dependent communication channels with corrupted information fed back from the receiver. We derive an information identity which can be interpreted as a law of…

Information Theory · Computer Science 2014-02-06 Nicolas Limal

This paper focuses on the stabilization and regulation of linear systems affected by quantization in state-transition data and actuated input. The observed data are composed of tuples of current state, input, and the next state's interval…

Optimization and Control · Mathematics 2023-09-26 Jared Miller , Jian Zheng , Mario Sznaier , Chris Hixenbaugh