English
Related papers

Related papers: The use of entropy to measure structural diversity

200 papers

When constructing a classifier ensemble, diversity among the base classifiers is one of the important characteristics. Several studies have been made in the context of standard static data, in particular, when analyzing the relationship…

Machine Learning · Computer Science 2019-02-25 Mohamed Souhayel Abassi

A common approach to aggregate classification estimates in an ensemble of decision trees is to either use voting or to average the probabilities for each class. The latter takes uncertainty into account, but not the reliability of the…

Machine Learning · Computer Science 2022-08-17 Florian Busch , Moritz Kulessa , Eneldo Loza Mencía , Hendrik Blockeel

Entropy has been a common index to quantify the complexity of time series in a variety of fields. Here, we introduce increment entropy to measure the complexity of time series in which each increment is mapped into a word of two letters,…

Data Analysis, Statistics and Probability · Physics 2016-01-20 Xiaofeng Liu , Aimin Jiang , Ning Xu , Jianru Xue

Permutation Entropy, introduced by Bandt and Pompe, is a widely used complexity measure for real-valued time series that is based on the relative order of values within consecutive segments of fixed length. After standardizing each segment…

Machine Learning · Computer Science 2025-08-28 Abhijeet Avhale , Joscha Diehl , Niraj Velankar , Emanuele Verri

Extensive research shows that more species-rich assemblages are generally more productive and efficient in resource use than comparable assemblages with fewer species. But the question of how diversity simultaneously affects the wide…

Expert finding is an information retrieval task concerned with the search for the most knowledgeable people, in some topic, with basis on documents describing peoples activities. The task involves taking a user query as input and returning…

Artificial Intelligence · Computer Science 2013-06-13 Catarina Moreira , Andreas Wichert

We investigate the relative information efficiency of financial markets by measuring the entropy of the time series of high frequency data. Our tool to measure efficiency is the Shannon entropy, applied to 2-symbol and 3-symbol…

Statistical Finance · Quantitative Finance 2016-09-15 Lucio Maria Calcagnile , Fulvio Corsi , Stefano Marmi

The entropic region is formed by the collection of the Shannon entropies of all subvectors of finitely many jointly distributed discrete random variables. For four or more variables, the structure of the entropic region is mostly unknown.…

Information Theory · Computer Science 2026-03-04 E. P. Csirmaz , L. Csirmaz

Diversity measurement underpins the study of biological systems, but measures used vary across disciplines. Despite their common use and broad utility, no unified framework has emerged for measuring, comparing and partitioning diversity.…

Quantitative Methods · Quantitative Biology 2016-12-09 Richard Reeve , Tom Leinster , Christina A. Cobbold , Jill Thompson , Neil Brummitt , Sonia N. Mitchell , Louise Matthews

The lack of efficiency in urban diffusion is a debated issue, important for biologists, urban specialists, planners and statisticians, both in developed and new developing countries. Many approaches have been considered to measure urban…

Applications · Statistics 2018-05-14 Linda Altieri , Daniela Cocchi , Giulia Roli

Classic concepts of genetic (gene) diversity (heterozygosity) such as Nei (1973: PNAS) and Nei and Li (1979: PNAS) nucleotide diversity were defined within the context of populations. Although variations are often measured in population…

Populations and Evolution · Quantitative Biology 2019-03-13 Zhanshan , Ma , Lianwei Li , Ya-Ping Zhang

Complex networks are usually characterized in terms of their topological, spatial, or information-theoretic properties and combinations of the associated metrics are used to discriminate networks into different classes or categories.…

Data Analysis, Statistics and Probability · Physics 2017-10-25 Marc Wiedermann , Jonathan F. Donges , Jürgen Kurths , Reik V. Donner

It is not obvious how to extend Shannon's original information entropy to higher dimensions, and many different approaches have been tried. We replace the English text symbol sequence originally used to illustrate the theory by a discrete,…

Information Theory · Computer Science 2016-09-06 Kieran G. Larkin

The quality of image encryption is commonly measured by the Shannon entropy over the ciphertext image. However, this measurement does not consider to the randomness of local image blocks and is inappropriate for scrambling based image…

Cryptography and Security · Computer Science 2016-11-27 Yue Wu , Joseph P. Noonan , Sos Agaian

Whereas for strings, higher-order empirical entropy is the standard entropy measure, several different notions of empirical entropy for trees have been proposed in the past, notably label entropy, degree entropy, conditional versions of the…

Information Theory · Computer Science 2020-06-03 Danny Hucke , Markus Lohrey , Louisa Seelbach Benkner

In this paper have written the results of the information analysis of structures. The obtained information estimation (IE) are based on an entropy measure of C. Shannon. Obtained IE is univalent both for the non-isomorphic and for the…

Information Theory · Computer Science 2007-07-16 Alexander Shaydurov

Ranked set sampling is a sampling design which has a wide range of applications in industrial statistics, and environmental and ecological studies, etc.. It is well known that ranked set samples provide more Fisher information than simple…

Statistics Theory · Mathematics 2013-01-21 Mohammad Jafari Jozani , Jafar Ahmadi

The Shannon entropy, and related quantities such as mutual information, can be used to quantify uncertainty and relevance. However, in practice, it can be difficult to compute these quantities for arbitrary probability distributions,…

Computation · Statistics 2017-10-11 Brendon J. Brewer

Phylogenies are commonly used to represent the evolutionary relationships between species, and often these phylogenies are equipped with edge lengths that indicate degrees of evolutionary difference. Given such a phylogeny, a popular…

Populations and Evolution · Quantitative Biology 2025-02-12 Martin Frohn , Kerry Manson

Quantification of measurement uncertainty is crucial for robust scientific inference, yet accurate estimates of this uncertainty remain elusive for ecological measures of diversity. Here, we address this longstanding challenge by deriving a…

Populations and Evolution · Quantitative Biology 2024-02-27 Andreas Tiffeau-Mayer