Related papers: Configurational Information as Potentially Negativ…
The Triple Helix of university-industry-government relations is elaborated into a systemic model that accounts for interactions among three dimensions. By distinguishing between the respective micro-operations, this model enables us to…
University-industry-government relations provide a networked infrastructure for knowledge-based innovation systems. This infrastructure organizes the dynamic fluxes locally and the knowledge base remains emergent given these conditions.…
Triple-Helix arrangements of bi- and trilateral relations can be considered as adaptive eco-systems. During the last decade, we have further developed a Triple-Helix indicator of synergy as reduction of uncertainty in niches that can be…
We develop information-theoretic measures of spatial structure and pattern in more than one dimension. As is well known, the entropy density of a two-dimensional configuration can be efficiently and accurately estimated via a converging…
Conditional mutual information is important in the selection and interpretation of graphical models. Its empirical version is well known as a generalised likelihood ratio test and that it may be represented as a difference in entropy. We…
Quantifying synergy among stochastic variables is an important open problem in information theory. Information synergy occurs when multiple sources together predict an outcome variable better than the sum of single-source predictions. It is…
Making decisions freely presupposes that there is some indeterminacy in the environment and in the decision making engine. The former is reflected on the behavioral changes due to communicating: few changes indicate rigid environments;…
In statistical physics entropy is usually introduced as a global quantity which expresses the amount of information that would be needed to specify the microscopic configuration of a system. However, for lattice models with infinitely many…
Entropy and information can be considered dual: entropy is a measure of the subspace defined by the information constraining the given ambient space. Negative entropies, arising in na\"ive extensions of the definition of entropy from…
We systematically extend the statement that the configurational entropy provides an alternative approach to studying gravitational stability of compact objects, carried out in the previous work of M. Gleiser and N. Jiang, Phys. Rev. D {\bf…
We present a theoretical study of classical Wigner crystals in two- and three-dimensional isotropic parabolic traps aiming at understanding and quantifying the configurational uncertainty due to the presence of multiple stable…
When two selection environments operate upon each other, mutual shaping in a co-evolution along a particular trajectory is one possible outcome. When three selection environments are involved, more complex dynamics can be expected as a…
Entropy governs molecular self-assembly, phase transitions, and material stability, yet remains challenging to quantify and directly control in molecular systems. Here, we demonstrate that the computable information density (CID), a data…
The concept of entropy connects the number of possible configurations with the number of variables in large stochastic systems. Independent or weakly interacting variables render the number of configurations scale exponentially with the…
We define a measure of redundant information based on projections in the space of probability distributions. Redundant information between random variables is information that is shared between those variables. But in contrast to mutual…
There has recently been an explosion of interest in how "higher-order" structures emerge in complex systems. This "emergent" organization has been found in a variety of natural and artificial systems, although at present the field lacks a…
Configurational entropy (CE) and configurational complexity (CC) are recently popularized information theoretic measures used to study the stability of solitons. This paper examines their behavior for 2D and 3D lattice Ising Models, where…
We propose a new way of investigating phase transitions in the context of information theory. We use an information-entropic measure of spatial complexity known as configurational entropy (CE) to quantify both the storage and exchange of…
The problems of causality, modeling, and control for chaotic, high-dimensional dynamical systems are formulated in the language of information theory. The central quantity of interest is the Shannon entropy, which measures the amount of…
Observations on the past provide some hints about what will happen in the future, and this can be quantified using information theory. The ``predictive information'' defined in this way has connections to measures of complexity that have…