English
Related papers

Related papers: A Novel Distance Matric: Generalized Relative Entr…

200 papers

Relative entropy is a powerful measure of the dissimilarity between two statistical field theories in the continuum. In this work, we study the relative entropy between Gaussian scalar field theories in a finite volume with different masses…

Statistical Mechanics · Physics 2025-01-28 Markus Schröfl , Stefan Floerchinger

Entropy is the measure of uncertainty in any data and is adopted for maximisation of mutual information in many remote sensing operations. The availability of wide entropy variations motivated us for an investigation over the suitability…

Computer Vision and Pattern Recognition · Computer Science 2014-05-25 Dr. S. K. Katiyar , Arun P. V.

This article proposes a new two-parameter generalized entropy, which can be reduced to the Tsallis and the Shannon entropy for specific values of its parameters. We develop a number of information-theoretic properties of this generalized…

Mathematical Physics · Physics 2024-05-02 Supriyo Dutta , Shigeru Furuichi , Partha Guha

We construct the generalized entropy optimized by a given arbitrary statistical distribution with a finite linear expectation value of a random quantity of interest. This offers, via the maximum entropy principle, a unified basis for a…

Statistical Mechanics · Physics 2009-11-07 Sumiyoshi Abe

Entropy has emerged as a dynamic, interdisciplinary, and widely accepted quantitative measure of uncertainty across different disciplines. A unified understanding of entropy measures, supported by a detailed review of their theoretical…

Probability · Mathematics 2025-03-21 Naveen Kumar , Ambesh Dixit , Vivek Vijay

We present the modified relative entropy of entanglement for multi-party systems by a given relative density matrix which is spanned by a linear combination of the direct products of so-called basis of relative density matrices and reduced…

Quantum Physics · Physics 2007-05-23 An Min Wang

This paper is devoted to the mathematical study of some divergences based on the mutual information well-suited to categorical random vectors. These divergences are generalizations of the "entropy distance" and "information distance". Their…

Statistics Theory · Mathematics 2016-08-16 Jean-François Coeurjolly , Rémy Drouilhet , Jean-François Robineau

This study explores information measures based on extropy, introducing dynamic relative extropy measures for residual and past lifetimes, and investigating their various properties. Furthermore, the study analyzes the relationships between…

Applications · Statistics 2025-03-11 Saranya P. , Sunoj S. M.

We introduce an axiomatic approach to entropies and relative entropies that relies only on minimal information-theoretic axioms, namely monotonicity under mixing and data-processing as well as additivity for product distributions. We find…

Information Theory · Computer Science 2021-09-22 Gilad Gour , Marco Tomamichel

We introduce distance entropy as a measure of homogeneity in the distribution of path lengths between a given node and its neighbours in a complex network. Distance entropy defines a new centrality measure whose properties are investigated…

Physics and Society · Physics 2018-05-09 Massimo Stella , Manlio De Domenico

Special approximation technique for analysis of different characteristics of states of multipartite infinite-dimensional quantum systems is proposed and applied to study of the relative entropy of entanglement and its regularisation. We…

Quantum Physics · Physics 2024-01-11 M. E. Shirokov

The Random Permutation Set (RPS) is a new type of set proposed recently, which can be regarded as the generalization of evidence theory. To measure the uncertainty of RPS, the entropy of RPS and its corresponding maximum entropy have been…

Information Theory · Computer Science 2024-03-12 Jiefeng Zhou , Zhen Li , Kang Hao Cheong , Yong Deng

We introduce a new information-theoretic formulation of quantum measurement uncertainty relations, based on the notion of relative entropy between measurement probabilities. In the case of a finite-dimensional system and for any approximate…

Mathematical Physics · Physics 2018-03-02 Alberto Barchielli , Matteo Gregoratti , Alessandro Toigo

Graph comparison plays a major role in many network applications. We often need a similarity metric for comparing networks according to their structural properties. Various network features - such as degree distribution and clustering…

Social and Information Networks · Computer Science 2013-07-16 Sadegh Aliakbary , Sadegh Motallebi , Jafar Habibi , Ali Movaghar

The concept of Type-2 soft sets had been proposed as a generalization of Molodstov's soft sets. In this paper some shortcomings of some existing distance measures for Type-1 soft sets have been shown and accordingly some new distance…

General Mathematics · Mathematics 2016-12-21 Rajashi Chatterjee , P. Majumdar , S. K. Samanta

This paper extends some geometric properties of a one-parameter family of relative entropies. These arise as redundancies when cumulants of compressed lengths are considered instead of expected compressed lengths. These parametric relative…

Information Theory · Computer Science 2011-05-31 Ashok Kumar M. , Rajesh Sundaresan

We review old and recent finite de Finetti theorems in total variation distance and in relative entropy, and we highlight their connections with bounds on the difference between sampling with and without replacement. We also establish two…

Probability · Mathematics 2024-07-19 Lampros Gavalakis , Oliver Johnson , Ioannis Kontoyiannis

In this paper we generalize a key result relating singular limits of certain relative entropies with index in the setting of conformal nets, which has played an important role recently in the mathematical theory of relative entropies in the…

Mathematical Physics · Physics 2025-12-01 Feng Xu

The quantum relative entropy is a fundamental quantity in quantum information science, characterizing the distinguishability between two quantum states. However, this quantity is not additive in general for correlated quantum states,…

Quantum Physics · Physics 2025-06-05 Kun Fang , Hamza Fawzi , Omar Fawzi

The aim of this study is to generalise recent results of the two last authors on en-tropy methods for measure solutions of the renewal equation to other classes of structured population problems. Specifically, we develop a generalised…

Analysis of PDEs · Mathematics 2018-04-11 Tomasz Dębiec , Marie Doumic , Piotr Gwiazda , Emil Wiedemann