English
Related papers

Related papers: Shannon Entropy Estimator for the Characterization…

200 papers

A simple method for finding the entropy and redundancy of a reasonable long sample of English text by direct computer processing and from first principles according to Shannon theory is presented. As an example, results on the entropy of…

Computation and Language · Computer Science 2009-11-19 Fabio G. Guerrero

Wildfires pose a significant threat to ecosystems, wildlife, and human communities, leading to habitat destruction, pollutant emissions, and biodiversity loss. Accurate wildfire risk prediction is crucial for mitigating these impacts and…

Machine Learning · Computer Science 2025-06-17 Zhengsen Xu , Jonathan Li , Sibo Cheng , Xue Rui , Yu Zhao , Hongjie He , Haiyan Guan , Aryan Sharma , Matthew Erxleben , Ryan Chang , Linlin Xu

The Shannon entropy of a random variable has much behaviour analogous to a signed measure. Previous work has explored this connection by defining a signed measure on abstract sets, which are taken to represent the information that different…

Information Theory · Computer Science 2025-05-28 Keenan J. A. Down , Pedro A. M. Mediano

This paper presents a command-line tool, called Entropia, that implements a family of conformance checking measures for process mining founded on the notion of entropy from information theory. The measures allow quantifying classical…

Shannon and Renyi entropies are quantitative measures of uncertainty in a data set. They are developed by Renyi in the context of entropy theory. These measures have been studied in the case of the multivariate t-distributions. We extend…

Statistics Theory · Mathematics 2019-01-31 Salah H. Abid , Uday J. Quaez

Knowing the dynamics of neuromorphic photonic schemes would allow their optimization for controlled data-processing capability in possibly simplified designs and minimized energy consumption levels. In nonlinear substrates such as optical…

Optics · Physics 2025-07-18 Marina Zajnulina

Numerical simulation of seismicity has been successfully developed and used for the two last decades. Presently, the general theory of modeling and the progress in computational techniques provide wide options for simulation of seismic and…

Geophysics · Physics 2015-07-17 Aleksandr M. Linkov , Liliana Rybarska-Rusinek , Victor V. Zoubkov

Satellite images have the potential to detect volcanic deformation prior to eruptions, but while a vast number of images are routinely acquired, only a small percentage contain volcanic deformation events. Manual inspection could miss these…

Computer Vision and Pattern Recognition · Computer Science 2024-05-30 Robert Gabriel Popescu , Nantheera Anantrasirichai , Juliet Biggs

A surrogate data analysis is presented, which is based on the fluctuations of the ``entropy'' $S$ defined in the natural time-domain [Phys. Rev. E {\bf 68}, 031106, 2003]. This entropy is not a static one as, for example, the Shannon…

Data Analysis, Statistics and Probability · Physics 2007-05-23 P. A. Varotsos , N. V. Sarlis , E. S. Skordas , M. S. Lazaridou

Risk-sensitive planning aims to identify policies maximizing some tail-focused metrics in Markov Decision Processes (MDPs). Such an optimization task can be very costly for the most widely used and interpretable metrics such as threshold…

Machine Learning · Statistics 2025-07-09 Alexandre Marthe , Samuel Bounan , Aurélien Garivier , Claire Vernade

Compressed Counting (CC) [22] was recently proposed for estimating the ath frequency moments of data streams, where 0 < a <= 2. CC can be used for estimating Shannon entropy, which can be approximated by certain functions of the ath…

Data Structures and Algorithms · Computer Science 2012-05-14 Ping Li

Entropy measures of probability distributions are widely used measures in ecology, biology, genetics, and in other fields, to quantify species diversity of a community. Unfortunately, entropy-based diversity indices, or diversity indices…

Populations and Evolution · Quantitative Biology 2014-08-14 Karim T. Abou-Moustafa

Estimating the location and intensity of tropical cyclones holds crucial significance for predicting catastrophic weather events. In this study, we approach this task as a detection and regression challenge, specifically over the North…

Image and Video Processing · Electrical Eng. & Systems 2024-10-14 Akash Agrawal , Mayesh Mohapatra , Abhinav Raja , Paritosh Tiwari , Vishwajeet Pattanaik , Neeru Jaiswal , Arpit Agarwal , Punit Rathore

Satellite-based communications, navigation systems and many scientific instruments rely on observations of trans-ionospheric signals. The quality of these signals can be deteriorated by ionospheric scintillation which can have detrimental…

Atmospheric and Oceanic Physics · Physics 2020-02-06 Alexandra Koulouri , Nathan D. Smith , Bruno C. Vani , Ville Rimpilainen , Ivan Astin , Biagio Forte

Rapid earthquake magnitude estimation is crucial for effective early warning systems that can save lives and reduce economic damage. In this paper, we present a comprehensive study of magnitude classification using only the vertical…

Estimating the Shannon entropy of a discrete distribution from which we have only observed a small sample is challenging. Estimating other information-theoretic metrics, such as the Kullback-Leibler divergence between two sparsely sampled…

Data Analysis, Statistics and Probability · Physics 2023-02-24 Angelo Piga , Lluc Font-Pomarol , Marta Sales-Pardo , Roger Guimerà

Shannon entropy is the most crucial foundation of Information Theory, which has been proven to be effective in many fields such as communications. Renyi entropy and Chernoff information are other two popular measures of information with…

Information Theory · Computer Science 2017-01-13 Shanyun Liu , Rui She , Jiaxun Lu , Pingyi Fan

Explosions near ground generate multiple geophysical waveforms in the radiation-dominated range of their signature fields. Multi-phenomological explosion monitoring (MultiPEM) at these ranges requires the predictive capability to forecast…

Data Analysis, Statistics and Probability · Physics 2019-06-25 Joshua D Carmichael , Robert J Nemzek

The R\'enyi entropy is a generalization of the Shannon entropy and is widely used in mathematical statistics and applied sciences for quantifying the uncertainty in a probability distribution. We consider estimation of the quadratic R\'enyi…

Statistics Theory · Mathematics 2013-03-08 David Källberg , Nikolaj Leonenko , Oleg Seleznjev

In Earthquake Early Warning (EEW), every sufficiently impulsive signal is potentially the first evidence for an unfolding large earthquake. More often than not, however, impulsive signals are mere nuisance signals. One of the most…