English
Related papers

Related papers: Ultimate Intelligence Part II: Physical Measure an…

200 papers

We introduce a class of information measures based on group entropies, allowing us to describe the information-theoretical properties of complex systems. These entropic measures are nonadditive, and are mathematically deduced from a series…

Statistical Mechanics · Physics 2019-10-21 Piergiulio Tempesta , Henrik Jeldtoft Jensen

Integrated Information Theory (IIT) is a prominent theory of consciousness that has at its centre measures that quantify the extent to which a system generates more information than the sum of its parts. While several candidate measures of…

Neurons and Cognition · Quantitative Biology 2019-01-30 Pedro A. M. Mediano , Anil K. Seth , Adam B. Barrett

Complex systems are found in most branches of science. It is still argued how to best quantify their complexity and to what end. One prominent measure of complexity (the statistical complexity) has an operational meaning in terms of the…

Data Analysis, Statistics and Probability · Physics 2011-10-24 Karoline Wiesner , Mile Gu , Elisabeth Rieper , Vlatko Vedral

Quantum information theory, particularly its entropic formulations, has made remarkable strides in characterizing quantum systems and tasks. However, a critical dimension remains underexplored: computational efficiency. While classical…

Quantum Physics · Physics 2026-05-05 Noam Avidan , Thomas A. Hahn , Joseph M. Renes , Rotem Arnon

We pedagogically present the information theory as originally established, explaining its essential ideas and paying attention to the expression employed to measure the amount of information. Also we discussed relationships between…

Quantum Physics · Physics 2019-12-10 Wallas S. Nascimento , Marcos M. de Almeida , Frederico V. Prudente

We compute the entropy of systems of quantum particles satisfying the fractional exclusion statistics in the space-time of 2+1 dimensional black hole by using the brick-wall method. We show that the entropy of each effective quantum field…

General Relativity and Quantum Cosmology · Physics 2007-05-23 Hyeong-Chan Kim , Yoonbai Kim , Phillial Oh

The capacity to integrate information is a prominent feature of biological and cognitive systems. Integrated Information Theory (IIT) provides a mathematical approach to quantify the level of integration in a system, yet its computational…

Neurons and Cognition · Quantitative Biology 2020-08-31 Miguel Aguilera , Ezequiel Di Paolo

We derive an optimal bound on the sum of entropic uncertainties of two or more observables when they are sequentially measured on the same ensemble of systems. This optimal bound is shown to be greater than or equal to the bounds derived in…

Quantum Physics · Physics 2009-11-07 M. D. Srinivas

Modern AI systems achieve remarkable capabilities at the cost of substantial energy consumption. To connect intelligence to physical efficiency, we propose two complementary bits-per-joule metrics under explicit accounting conventions: (1)…

Machine Learning · Computer Science 2026-02-06 Koichi Takahashi , Yusuke Hayashi

Information plays an important role in our understanding of the physical world. We hence propose an entropic measure of information for any physical theory that admits systems, states and measurements. In the quantum and classical world,…

Quantum Physics · Physics 2010-05-04 Anthony J. Short , Stephanie Wehner

Deep learning models in computer vision have achieved significant success but pose increasing concerns about energy consumption and sustainability. Despite these concerns, there is a lack of comprehensive understanding of their energy…

Computer Vision and Pattern Recognition · Computer Science 2024-12-16 Zeyu Yang , Karel Adamek , Wesley Armour

We are at the beginning of a new age in which artificial entities will perform significant amounts of high-level cognitive processing rivaling and even surpassing human thinking. The future belongs to those who can best collaborate with…

Human-Computer Interaction · Computer Science 2022-11-15 Ron Fulbright

We derive bounds on the volume of an inclusion in a body in two or three dimensions when the conductivities of the inclusion and the surrounding body are complex and assumed to be known. The bounds are derived in terms of average values of…

Analysis of PDEs · Mathematics 2015-06-09 Andrew E. Thaler , Graeme W. Milton

We study the Complexity=Volume conjecture for Warped AdS$_3$ black holes. We compute the spatial volume of the Einstein-Rosen bridge and we find that its growth rate is proportional to the Hawking temperature times the Bekenstein-Hawking…

High Energy Physics - Theory · Physics 2018-08-01 Roberto Auzzi , Stefano Baiguera , Giuseppe Nardelli

Statistical mechanics explains thermodynamics in terms of (quantum) mechanics by equating the entropy of a microstate of a closed system with the logarithm of the number of microstates in the macrostate to which it belongs, but the question…

High Energy Physics - Theory · Physics 2007-05-23 Bernard S. Kay

Understanding the fate of semi-classical black hole solutions at very late times is one of the most important open questions in quantum gravity. In this paper, we provide a path integral definition of the volume of the black hole interior…

High Energy Physics - Theory · Physics 2021-07-15 Luca V. Iliesiu , Márk Mezei , Gábor Sárosi

Logical entropy gives a measure, in the sense of measure theory, of the distinctions of a given partition of a set, an idea that can be naturally generalized to classical probability distributions. Here, we analyze how fundamental concepts…

Quantum Physics · Physics 2022-03-14 Boaz Tamir , Ismael L. Paiva , Zohar Schwartzman-Nowik , Eliahu Cohen

This paper presents an analysis of the fundamental limits on energy efficiency in both digital and analog in-memory computing architectures, and compares their performance to single instruction, single data (scalar) machines specifically in…

Hardware Architecture · Computer Science 2023-02-14 Patrick Bowen , Guy Regev , Nir Regev , Bruno Pedroni , Edward Hanson , Yiran Chen

We call a state "vacuum-bounded" if every measurement performed outside a specified interior region gives the same result as in the vacuum. We compute the maximum entropy of a vacuum-bounded state with a given energy for a one-dimensional…

High Energy Physics - Theory · Physics 2009-10-30 Ken D. Olum

Although we have convincing evidence that a black hole bears an entropy proportional to its surface (horizon) area, the ``statistical mechanical'' explanation of this entropy remains unknown. Two basic questions in this connection are: what…

General Relativity and Quantum Cosmology · Physics 2008-02-03 Rafael D. Sorkin