English
Related papers

Related papers: Generalized informational functionals and new mono…

200 papers

In a paper [8] the authors classify entropy into three categories, as a thermodynamics quantity, as a measure of information production, and as a means of statistical inference. An entropy measure introduced by Mathai falls into the second…

Statistical Mechanics · Physics 2024-10-31 Hans J. Haubold

Entropy can signify different things: For instance, heat transfer in thermodynamics or a measure of information in data analysis. Many entropies have been introduced and it can be difficult to ascertain their different importance and…

Mathematical Physics · Physics 2025-07-10 Henrik Jeldtoft Jensen , Piergiulio Tempesta

The constituents of a complex system exchange information to function properly. Their signalling dynamics often leads to the appearance of emergent phenomena, such as phase transitions and collective behaviors. While information exchange…

Physics and Society · Physics 2020-11-18 Arsham Ghavasieh , Carlo Nicolini , Manlio De Domenico

There exist only a few known examples of subordinators for which the transition probability density can be computed explicitly along side an expression for its L\'evy measure and Laplace exponent. Such examples are useful in several areas…

Probability · Mathematics 2016-11-25 James Burridge , Mateusz Kwaśnicki , Alexey Kuznetsov , Andreas Kyprianou

Probabilistic submeasures generalizing the classical (numerical) submeasures are introduced and discussed in connection with some classes of aggregation functions. A special attention is paid to triangular norm-based probabilistic…

Classical Analysis and ODEs · Mathematics 2012-07-12 Lenka Halčinová , Ondrej Hutník , Radko Mesiar

The R\'enyi and Shannon entropies are information-theoretic measures which have enabled to formulate the position-momentum uncertainty principle in a much more adequate and stringent way than the (variance-based) Heisenberg-like relation.…

Quantum Physics · Physics 2013-05-24 Pablo Sánchez-Moreno , Steeve Zozor , Jesus S. Dehesa

The paper makes the observation that all orders of information entropy are equal in signals composed of repeating units of distinct symbols where the units can be classified as a member of a symmetry group. This leads to an improved metric…

Information Theory · Computer Science 2010-07-14 Reginald D. Smith

We derive the asymptotic distribution of ordinal-pattern frequencies under weak dependence conditions and investigate the long-run covariance matrix not only analytically for moving-average, Gaussian, and the novel generalized coin-tossing…

Statistics Theory · Mathematics 2025-07-24 Angelika Silbernagel , Christian Weiß

The notion of group entropy is proposed. It enables to unify and generalize many different definitions of entropy known in the literature, as those of Boltzmann-Gibbs, Tsallis, Abe and Kaniadakis. Other new entropic functionals are…

Statistical Mechanics · Physics 2015-05-28 Piergiulio Tempesta

Nonparametric estimation of the mean and covariance functions is ubiquitous in functional data analysis and local linear smoothing techniques are most frequently used. Zhang and Wang (2016) explored different types of asymptotic properties…

Statistics Theory · Mathematics 2025-01-28 Shaojun Guo , Dong Li , Xinghao Qiao , Yizhu Wang

In the paper we propose some new class of functions which is used to construct tail index estimators. Functions from this new class is non-monotone in general, but presents a product of two monotone functions: the power function and the…

Statistics Theory · Mathematics 2015-01-06 Vygantas Paulauskas , Marijus Vaičiulis

The goal of this monograph is to study the indicator function for a set of permutations mapping one finite sequence of positive integers to another from a representation theoretic, combinatorial and probabilistic perspective. The degree of…

Combinatorics · Mathematics 2024-03-26 Zachary Hamaker , Brendon Rhoades

During the last two decades, concentration inequalities have been the subject of exciting developments in various areas, including convex geometry, functional analysis, statistical physics, high-dimensional statistics, pure and applied…

Information Theory · Computer Science 2015-02-26 Maxim Raginsky , Igal Sason

We introduce a variant of the R\'enyi entropy definition that aligns it with the well-known H\"older mean: in the new formulation, the r-th order R\'enyi Entropy is the logarithm of the inverse of the r-th order H\"older mean. This brings…

Information Theory · Computer Science 2018-11-16 Francisco José Valverde-Albacete , Carmen Peláez-Moreno

We apply random matrix theory to study the impact of measurement uncertainty on dynamic mode decomposition. Specifically, when the measurements follow a normal probability density function, we show how the moments of that density propagate…

Methodology · Statistics 2025-09-04 P. Algikar , P. Sharma , M. Netto , L. Mili

By making use of the familiar Mathieu series and its generalizations, the authors derive a number of new integral representations and present a systematic study of probability density functions and probability distributions associated with…

Classical Analysis and ODEs · Mathematics 2016-10-19 Zivorad Tomovski , Khaled Mehrez

Multimodal learning leverages the integration of diverse data modalities to enhance performance in complex tasks. Yet, it frequently encounters incomplete or redundant modality data in real-world scenarios. This paper presents a…

Machine Learning · Computer Science 2026-05-05 Richeng Zhou , Xuelin Zhang , Liyuan Liu

Distributed systems, such as biological and artificial neural networks, process information via complex interactions engaging multiple subsystems, resulting in high-order patterns with distinct properties across scales. Investigating how…

Information Theory · Computer Science 2025-04-23 Aaron J. Gutknecht , Fernando E. Rosas , David A. Ehrlich , Abdullah Makkeh , Pedro A. M. Mediano , Michael Wibral

Starting with the additivity condition for Lyapunov functions of master equation, we derive a one-parametric family of entropy functions which may be appropriate for a description of certain effects of finiteness of statistical systems, in…

Statistical Mechanics · Physics 2009-11-07 Alexander N. Gorban , Iliya V. Karlin

Entropy measures have become increasingly popular as an evaluation metric for complexity in the analysis of time series data, especially in physiology and medicine. Entropy measures the rate of information gain, or degree of regularity in a…

Methodology · Statistics 2015-12-03 Chee Chun Gan , Gerard Learmonth