English
Related papers

Related papers: Entropy and Diversity: The Axiomatic Approach

200 papers

Entropy is one of the key thermodynamic variables reflecting changes in the state of matter. Unlike other thermodynamic variables, it is well-defined also for nonequilibrium steady states through its relation to information. Applying this…

Statistical Mechanics · Physics 2026-04-15 Haim Diamant , Gil Ariel

I present a framework based on the concepts of diversity and coherence for the analysis of knowledge integration and diffusion. Visualisations that help understand insights gained are also introduced. The key novelty offered by this…

Physics and Society · Physics 2014-12-23 Ismael Rafols

Diversity is a fundamental feature of ecosystems, even when the concept of ecosystem is extended to sociology or economics. Diversity can be intended as the count of different items, animals, or, more generally, interactions. There are two…

Physics and Society · Physics 2016-09-14 Andrea Tacchella , Riccardo Di Clemente , Andrea Gabrielli , Luciano Pietronero

Given the constant rise in quantity and quality of data obtained from neural systems on many scales ranging from molecular to systems', information-theoretic analyses became increasingly necessary during the past few decades in the…

Information Theory · Computer Science 2013-10-08 Felix Effenberger

Written language is complex. A written text can be considered an attempt to convey a meaningful message which ends up being constrained by language rules, context dependence and highly redundant in its use of resources. Despite all these…

Computation and Language · Computer Science 2019-05-20 E. Estevez-Rams , A. Mesa Rodriguez , D. Estevez-Moya

The Shannon entropy is a fundamental measure for quantifying diversity and model complexity in fields such as information theory, ecology, and genetics. However, many existing studies assume that the number of species is known, an…

Methodology · Statistics 2026-02-23 Takato Hashino , Koji Tsukuda

Probability theory is fundamental for modeling uncertainty, with traditional probabilities being real and non-negative. Complex probability extends this concept by allowing complex-valued probabilities, opening new avenues for analysis in…

Information Theory · Computer Science 2025-03-07 Chan Li , Hejun Xu , Zhu Cao

Different notions of entropy play a fundamental role in the classical theory of dynamical systems. Unlike many other concepts used to analyze autonomous dynamics, both measure-theoretic and topological entropy can be extended quite…

Dynamical Systems · Mathematics 2017-08-03 Christoph Kawan

This short book is an elementary course on entropy, leading up to a calculation of the entropy of hydrogen gas at standard temperature and pressure. Topics covered include information, Shannon entropy and Gibbs entropy, the principle of…

Statistical Mechanics · Physics 2025-11-18 John C. Baez

Recently, the Shannon entropy, which was introduced originally as a measure of information amount, has been widely used as a useful index of various diversities such as biodiversity and geodiversity. In this work we have evaluated the…

Data Analysis, Statistics and Probability · Physics 2009-05-19 Tetsuo Yabuki , Yumi Matsumura , Yoko Nakatani

We define a one-parameter family of entropies, each assigning a real number to any probability measure on a compact metric space (or, more generally, a compact Hausdorff space with a notion of similarity between points). These entropies…

Metric Geometry · Mathematics 2020-12-17 Tom Leinster , Emily Roff

Biology is data-rich, and it is equally rich in concepts and hypotheses. Part of trying to understand biological processes and systems is therefore to confront our ideas and hypotheses with data using statistical methods to determine the…

Quantitative Methods · Quantitative Biology 2022-06-22 Sean T. Vittadello , Michael P. H. Stumpf

We present a unified axiomatic approach to contextuality and non-locality based on the fact that both are resource theories. In those theories the main objects are consistent boxes, which can be transformed by certain operations to achieve…

Quantum Physics · Physics 2015-09-16 Karol Horodecki , Andrzej Grudka , Pankaj Joshi , Waldemar Kłobus , Justyna Łodyga

A new combinatorial-probabilistic diagnostic entropy has been introduced. It describes the pair-wise sum of probabilities of system conditions that have to be distinguished during the diagnosing process. The proposed measure describes the…

Information Theory · Computer Science 2009-09-29 Henryk Borowczyk

This study explores the citation diversity in scholarly literature, analyzing different patterns of citations observed within different countries and academic disciplines. We examine citation distributions across top institutions within…

Physics and Society · Physics 2025-08-26 Suchismita Banerjee , Abhik Ghosh , Banasri Basu

Partial differential equations are ubiquitous in almost all applications of mathematics, where they provide a natural mathematical description of many phenomena involving change in physical, chemical, biological, and social processes. The…

Analysis of PDEs · Mathematics 2013-11-07 John M. Ball , Gui-Qiang G. Chen

In mathematics information is a number that measures uncertainty (entropy) based on a probabilistic distribution, often of an obscure origin. In real life language information is a datum, a statement, more precisely, a formula. But such a…

Artificial Intelligence · Computer Science 2022-05-17 Anatol Slissenko

This is a survey of the diversity of problems in additive number theory. Equity requires the consideration of less currently popular problems, and suggests their inclusion in the additive canon. Of particular interest are problems about the…

Number Theory · Mathematics 2026-04-23 Melvyn B. Nathanson

We study the build up of complexity on the example of 1 kg matter in different forms. We start on the simplest example of ideal gases, and then continue with more complex chemical, biological, life and social and technical structures. We…

Other Quantitative Biology · Quantitative Biology 2017-01-19 L. P. Csernai , S. F. Spinnangr , S. Velle

Can one demonstrate quantitative effects of diversity within a system comprised of distinct individuals on the performance of the system as a whole? Assuming that individuals can be different, we develop a model to interpolate between…

Physics and Society · Physics 2023-04-18 Julie Rowlett , Carl-Joar Karlsson , Medet Nursultanov