Related papers: Toward a Physical Theory of Intelligence
Learning systems acquire structured internal representations from data, yet classical information-theoretic results state that deterministic transformations do not increase information. This raises a fundamental question: how can learning…
Symmetries play a central role in physics, organizing dynamics, constraining interactions, and determining the effective number of physical degrees of freedom. In parallel, modern artificial intelligence methods have demonstrated a…
We introduce an increasing-complexity, open-ended, and human-agnostic metric to evaluate foundational and frontier AI models in the context of Artificial General Intelligence (AGI) and Artificial Super Intelligence (ASI) claims. Unlike…
Embedding tables are used by machine learning systems to work with categorical features. In modern Recommendation Systems, these tables can be very large, necessitating the development of new methods for fitting them in memory, even during…
The recursive property of entropy is well known in information theory; however, the concept is underutilized in thermodynamics, despite being the field where the concept of entropy originated. The zentropy approach is built on this idea,…
We show that information in quantum memory can be erased and recovered perfectly if it is necessary. That the final states of environment are completely determined by the initial states of the system allows that an easure operation can be…
This study proposes a novel spatial discretization procedure for the compressible Euler equations which guarantees entropy conservation at a discrete level when an arbitrary equation of state is assumed. The proposed method, based on a…
The aim here is to provide a set of equations for cosmology in terms of information and thermodynamical parameters. The method we implement in order to describe the universe is a development of Padmanabhan\rq{}s approach which is based on…
Boltzmann's principle S=k ln W allows to extend equilibrium thermo-statistics to ``Small'' systems without invoking the thermodynamic limit. The clue is to base statistical probability on ensemble averaging and not on time averaging. It is…
Understanding how much energy is needed and dissipated as heat for a given computational system and for a given program is a physically interesting and practically important problem. However, the thermodynamic costs of computational systems…
What is the structure of general quantum processes on composite systems that respect a global or local symmetry principle? How does the irreversible use of quantum resources behave under such symmetry principles? Here we employ an…
Bringing a high-dimensional dataset into science-ready shape is a formidable challenge that often necessitates data compression. Compression has accordingly become a key consideration for contemporary cosmology, affecting public data…
Recognition of objects from partial information presents a significant challenge for theories of vision because it requires spatial integration and extrapolation from prior knowledge. We combined neurophysiological recordings in human…
Compressed sensing (CS) is about recovering a structured signal from its under-determined linear measurements. Starting from sparsity, recovery methods have steadily moved towards more complex structures. Emerging machine learning tools…
The fact that accurately predicted information can serve as an energy source paves the way for new approaches to autonomous learning. The energy derived from a sequence of successful predictions can be recycled as an immediate incentive and…
In present day technology, storing and processing of information occur on physically distinct regions of space. Not only does this result in space limitations; it also translates into unwanted delays in retrieving and processing of relevant…
Entanglement within a given device provides a potential resource for quantum information processing. Entanglement between system and environment leads to decoherence (thus suppressing non-classical features within the system) but also opens…
We consider the theory of feedback control of a Bose-Einstein condensate (BEC) confined in a harmonic trap under a continuous measurement constructed via non-destructive imaging. A filtering theory approach is used to derive a stochastic…
Wolfram's Principle of Computational Equivalence (PCE) implies that universal complexity abounds in nature. This paper comprises three sections. In the first section we consider the question why there are so many universal phenomena around.…
How the detailed structure of quantum complexity emerges from quantum dynamics remains a fundamental challenge highlighted by advances in quantum simulators and information processing. The celebrated Small-Incremental-Entangling (SIE)…