English
Related papers

Related papers: The use of entropy to measure structural diversity

200 papers

The combination of multiple classifiers using ensemble methods is increasingly important for making progress in a variety of difficult prediction problems. We present a comparative analysis of several ensemble methods through two case…

Machine Learning · Computer Science 2013-09-20 Sean Whalen , Gaurav Pandey

The Shannon entropy is used as a basis for applying different lemmas and conjectures concerning the set of gaps between prime numbers G_p , thus estimating several measures of it. The same procedures are applied to artificially created…

General Mathematics · Mathematics 2016-06-28 Arturo Ortiz Tapia , Hans Henrik Støleum

The notion of metric entropy dimension is introduced to measure the complexity of entropy zero dynamical systems. For measure preserving systems, we define entropy dimension via the dimension of entropy generating sequences. This…

Dynamical Systems · Mathematics 2018-02-27 Dou Dou , Wen Huang , Kyewon Koh Park

Classification is a machine learning method used in many practical applications: text mining, handwritten character recognition, face recognition, pattern classification, scene labeling, computer vision, natural langage processing. A…

Machine Learning · Computer Science 2025-11-05 Doulaye Dembélé

We analyze the concept of virtuosity as a collective attribute in music and its relationship with the entropy based on an experiment that compares two sets of digital signals played by composer-performer electric guitarists. Based on an…

Sound · Computer Science 2024-04-26 Igor Lugo , Martha G. Alatriste-Contreras

In recent years, biodiversity measures have gained prominence as essential tools for ecological and environmental assessments, particularly in the context of increasingly complex and large-scale datasets. We provide a comprehensive review…

Populations and Evolution · Quantitative Biology 2024-12-06 Shinto Eguchi

The Shannon entropy, one of the cornerstones of information theory, is widely used in physics, particularly in statistical mechanics. Yet its characterization and connection to physics remain vague, leaving ample room for misconceptions and…

Statistical Mechanics · Physics 2021-07-28 Gabriele Carcassi , Christine A. Aidala , Julian Barbour

This paper describes a classifier pool generation method guided by the diversity estimated on the data complexity and classifier decisions. First, the behavior of complexity measures is assessed by considering several subsamples of the…

Machine Learning · Computer Science 2020-11-04 Marcos Monteiro , Alceu S. Britto , Jean P. Barddal , Luiz S. Oliveira , Robert Sabourin

Quality and diversity have been proposed as reasonable heuristics for assessing content generated by co-creative systems, but to date there has been little agreement around what constitutes the latter or how to measure it. Proposed…

Computer Vision and Pattern Recognition · Computer Science 2024-03-22 Francisco Ibarrola , Kazjon Grace

Measuring the complexity of tree structures can be beneficial in areas that use tree data structures for storage, communication, and processing purposes. This complexity can then be used to compress tree data structures to their…

Information Theory · Computer Science 2023-09-19 Amirmohammad Farzaneh , Mihai-Alin Badiu , Justin P. Coon

Entropy estimation plays a significant role in biology, economics, physics, communication engineering and other disciplines. It is increasingly used in software engineering, e.g. in software confidentiality, software testing, predictive…

Information Theory · Computer Science 2025-01-22 Ilaria Pia la Torre , David A. Kelly , Hector D. Menendez , David Clark

Quantifying diversity is of central importance for the study of structure, function and evolution of microbial communities. The estimation of microbial diversity has received renewed attention with the advent of large-scale metagenomic…

Populations and Evolution · Quantitative Biology 2013-08-06 Bart Haegeman , Jérôme Hamelin , John Moriarty , Peter Neal , Jonathan Dushoff , Joshua S. Weitz

Diversity is a fundamental feature of ecosystems, even when the concept of ecosystem is extended to sociology or economics. Diversity can be intended as the count of different items, animals, or, more generally, interactions. There are two…

Physics and Society · Physics 2016-09-14 Andrea Tacchella , Riccardo Di Clemente , Andrea Gabrielli , Luciano Pietronero

Permutation entropy quantifies the diversity of possible orderings of the values a random or deterministic system can take, as Shannon entropy quantifies the diversity of values. We show that the metric and permutation entropy…

Chaotic Dynamics · Physics 2016-08-16 Jose M. Amigo , Matthew B. Kennel , Ljupco Kocarev

In this paper we revisit the concept of mobility entropy. Over time, the structure of spatial interactions among urban centres tends to become more complex and evolves from centralised models to more scattered origin and destination…

Physics and Society · Physics 2021-06-30 Valentina Marin , Carlos Molinero , Elsa Arcaute

Data stream mining problem has caused widely concerns in the area of machine learning and data mining. In some recent studies, ensemble classification has been widely used in concept drift detection, however, most of them regard…

Data Structures and Algorithms · Computer Science 2017-08-14 Junhong Wang , Shuliang Xu , Bingqian Duan , Caifeng Liu , Jiye Liang

Recognition of pathogens relies on families of proteins showing great diversity. Here we construct maximum entropy models of the sequence repertoire, building on recent experiments that provide a nearly exhaustive sampling of the IgM…

Genomics · Quantitative Biology 2011-11-28 Thierry Mora , Aleksandra Walczak , William Bialek , Curtis G. Callan

We introduce a new measure of interdependence among the components of a random vector along the main diagonal of the vector copula, i.e. along the line $u_{1}=\ldots=u_{J}$, for $\left(u_{1},\ldots,u_{J}\right)\in\left[0,1\right]^{J}$. Our…

Methodology · Statistics 2014-08-29 Jhan Rodríguez , András Bárdossy

This paper examines various methods of computing uncertainty and diversity for active learning in genetic programming. We found that the model population in genetic programming can be exploited to select informative training data points by…

Neural and Evolutionary Computing · Computer Science 2023-08-02 Nathan Haut , Wolfgang Banzhaf , Bill Punch

Entropy is the measure of uncertainty in any data and is adopted for maximisation of mutual information in many remote sensing operations. The availability of wide entropy variations motivated us for an investigation over the suitability…

Computer Vision and Pattern Recognition · Computer Science 2014-05-26 S. K. Katiyar , P. V. Arun