Related papers: Compressibility, laws of nature, initial condition…
The spectacular results achieved in machine learning, including the recent advances in generative AI, rely on large data collections. On the opposite, intelligent processes in nature arises without the need for such collections, but simply…
The gap between data production and user ability to access, compute and produce meaningful results calls for tools that address the challenges associated with big data volume, velocity and variety. One of the key hurdles is the inability to…
Today, with the growing demands of information storage and data transfer, data compression is becoming increasingly important. Data Compression is a technique which is used to decrease the size of data. This is very useful when some huge…
A suitable unified statistical formulation of quantum and classical mechanics in a *-algebraic setting leads us to conclude that information itself is noncommutative in quantum mechanics. Specifically we refer here to an observer's…
Limitation of computational resources is considered as a universal principle that for simulation is as fundamental as physical laws are. It claims that all experimentally verifiable implications of physical laws can be simulated by the…
Languages across the world exhibit Zipf's law of abbreviation, namely more frequent words tend to be shorter. The generalized version of the law - an inverse relationship between the frequency of a unit and its magnitude - holds also for…
The climate system is a forced, dissipative, nonlinear, complex and heterogeneous system that is out of thermodynamic equilibrium. The system exhibits natural variability on many scales of motion, in time as well as space, and it is subject…
The paper discusses the fundamental characteristics distinguishing the natural and social systems from each other. It considers in detail the basic approaches, prospects, and possibilities of constructing mathematical description for social…
We consider biological individuality in terms of information theoretic and graphical principles. Our purpose is to extract through an algorithmic decomposition system-environment boundaries supporting individuality. We infer or detect…
Information is everywhere in nature which is very uncertain and unpredictable. But information, in itself, is a very ambiguous term. In this cursory write-up, we attempt to understand the formal meaning of information by quantifying…
We discuss models and data of crowd disasters, crime, terrorism, war and disease spreading to show that conventional recipes, such as deterrence strategies, are often not effective and sufficient to contain them. Many common approaches do…
Recent research on the network modeling of complex systems has led to a convenient representation of numerous natural, social, and engineered systems that are now recognized as networks of interacting parts. Such systems can exhibit a…
Complex macroscopic behaviour can arise in many-body systems with only very simple elements as a consequence of the combination of competition and inhomogeneity. This paper attempts to illustrate how statistical physics has driven this…
When thermodynamics is understood as the science (or art) of constructing effective models of natural phenomena by choosing a minimal level of description capable of capturing the essential features of the physical reality of interest, the…
The question how complex systems become more organized and efficient with time is open. Examples are, the formation of elementary particles from pure energy, the formation of atoms from particles, the formation of stars and galaxies, the…
Observations on the past provide some hints about what will happen in the future, and this can be quantified using information theory. The ``predictive information'' defined in this way has connections to measures of complexity that have…
A principle of information conservation is shown in abstract terms to rule out probabilistic physical laws, necessitating the existence of state trajectories. It furthermore provides a geometric-thermodynamic mechanism for the appearance of…
A natural process is defined as an act, by which a system organizes itself with time. Any natural process drives a system to a state of greater organization. Organization is a progressive change, while evolution is expressed in the effects…
A central question in the era of 'big data' is what to do with the enormous amount of information. One possibility is to characterize it through statistics, e.g., averages, or classify it using machine learning, in order to understand the…
Biology is data-rich, and it is equally rich in concepts and hypotheses. Part of trying to understand biological processes and systems is therefore to confront our ideas and hypotheses with data using statistical methods to determine the…