English
Related papers

Related papers: On the Information Engine of Circuit Design

200 papers

In this paper, we show through examples, how the existing definitions of information transfer, namely directed information and transfer entropy fail to capture true causal interaction between states in control dynamical system. We propose a…

Optimization and Control · Mathematics 2018-07-24 Subhrajit Sinha , Umesh Vaidya

Originally conceived as a theory of consciousness, integrated information theory (IIT) provides a theoretical framework intended to characterize the compositional causal information that a system, in its current state, specifies about…

Quantum Physics · Physics 2023-03-22 Larissa Albantakis , Robert Prentner , Ian Durham

We conduct numerical simulations for an autonomous information engine comprising a set of coupled double quantum dots using a simple model. The steady-state entropy production rate in each component, heat and electron transfer rates are…

Statistical Mechanics · Physics 2020-09-29 Katsuaki Tanabe

Compositional synthesis relies on the discovery of assumptions, i.e., restrictions on the behavior of the remainder of the system that allow a component to realize its specification. In order to avoid losing valid solutions, these…

Logic in Computer Science · Computer Science 2022-07-05 Bernd Finkbeiner , Niklas Metzger , Yoram Moses

Fundamental limits on the controllability of quantum mechanical systems are discussed in the light of quantum information theory. It is shown that the amount of entropy-reduction that can be extracted from a quantum system by feedback…

Quantum Physics · Physics 2016-09-08 Shiro Kawabata

We propose an information-theoretic framework for analyzing control systems based on the close relationship of controllers to communication channels. A communication channel takes an input state and transforms it into an output state. A…

Data Analysis, Statistics and Probability · Physics 2007-05-23 Hugo Touchette , Seth Lloyd

Generative diffusion models have emerged as a powerful class of models in machine learning, yet a unified theoretical understanding of their operation is still developing. This paper provides an integrated perspective on generative…

Machine Learning · Statistics 2026-03-27 Dejan Stancevic , Luca Ambrogioni

We analyze how measured quantum dynamical systems store and process information, introducing sofic quantum dynamical systems. Using recently introduced information-theoretic measures for quantum processes, we quantify their information…

Quantum Physics · Physics 2007-05-23 Karoline Wiesner , James P. Crutchfield

Accurate information processing is crucial both in technology and in nature. To achieve it, any information processing system needs an initial supply of resources away from thermal equilibrium. Here we establish a fundamental limit on the…

Quantum Physics · Physics 2022-12-14 Giulio Chiribella , Fei Meng , Renato Renner , Man-Hong Yung

Distributed computation in artificial life and complex systems is often described in terms of component operations on information: information storage, transfer and modification. Information modification remains poorly described however,…

Information Theory · Computer Science 2013-10-10 Joseph T. Lizier , Benjamin Flecker , Paul L. Williams

In this work the information loss in deterministic, memoryless systems is investigated by evaluating the conditional entropy of the input random variable given the output random variable. It is shown that for a large class of systems the…

Information Theory · Computer Science 2013-04-18 Bernhard C. Geiger , Gernot Kubin

The apparent dichotomy between information-processing and dynamical approaches to complexity science forces researchers to choose between two diverging sets of tools and explanations, creating conflict and often hindering scientific…

Neurons and Cognition · Quantitative Biology 2022-01-26 Pedro A. M. Mediano , Fernando E. Rosas , Juan Carlos Farah , Murray Shanahan , Daniel Bor , Adam B. Barrett

In this work we investigate the information loss in (nonlinear) dynamical input-output systems and provide some general results. In particular, we present an upper bound on the information loss rate, defined as the (non-negative) difference…

Information Theory · Computer Science 2012-02-03 Bernhard C. Geiger , Gernot Kubin

The concept of autonomy is fundamental for understanding biological organization and the evolutionary transitions of living systems. Understanding how a system constitutes itself as an individual, cohesive, self-organized entity is a…

Neurons and Cognition · Quantitative Biology 2019-02-07 Miguel Aguilera , Ezequiel Di Paolo

The growing study of time series, especially those related to nonlinear systems, has challenged the methodologies to characterize and classify dynamical structures of a signal. Here we conceive a new diagnostic tool for time series based on…

Other Statistics · Statistics 2017-07-05 G. Corso , T. L. Prado , G. Z. dos S. Lima , S. R. Lopes

Information geometry is used to quantify the amount of information integration within multiple terminals of a causal dynamical system. Integrated information quantifies how much information is lost when a system is split into parts and…

Information Theory · Computer Science 2017-09-08 Shun-ichi Amari , Naotsugu Tsuchiya , Masafumi Oizumi

Identifying the origin of nonequilibrium characteristics in a generic interacting system having multiple degrees of freedom is a challenging task. In this context, information theoretic measures such as mutual information and related…

Statistical Mechanics · Physics 2025-07-24 Biswajit Das , Sreekanth K Manikandan , Ayan Banerjee

The concept of information has emerged as a language in its own right, bridging several disciplines that analyze natural phenomena and man-made systems. Integrated information has been introduced as a metric to quantify the amount of…

Neurons and Cognition · Quantitative Biology 2019-06-10 Alberto Hernández-Espinosa , Héctor Zenil , Narsis A. Kiani , Jesper Tegnér

We introduce an information measure, termed clarity, motivated by information entropy, and show that it has intuitive properties relevant to dynamic coverage control and informative path planning. Clarity defines the quality of the…

Robotics · Computer Science 2023-04-06 Devansh R Agrawal , Dimitra Panagou

Relevance of key quantum information measures for analysis of quantum systems is discussed. It is argued that possible ways of measuring quantum information are based on compatibility/incompatibility of the quantum states of a quantum…

Quantum Physics · Physics 2015-06-26 B. A. Grishanin , V. N. Zadkov