English
Related papers

Related papers: A conditional Entropy Power Inequality for depende…

200 papers

We propose entropy functions based on fractional calculus. We show that this new entropy has the same properties than the Shannon entropy except additivity, therefore making this entropy non-extensive. We show that this entropy function…

Statistical Mechanics · Physics 2015-05-13 Marcelo R. Ubriaco

We prove the following exponential inequality: Let $n\geq 1$ and let $X_1,...,X_n$ be $n$ independent identically distributed symmetric real-valued random variables. For any $x,y>0$, we have \[\mathbb{P}\big({X_1+...+X_n}\geq x,\,…

Probability · Mathematics 2014-10-21 Raphaël Cerf , Matthias Gorny

We use the structure of conditionally independent states to analyze the stability of topological entanglement entropy. For the ground state of quantum double or Levin-Wen model, we obtain a bound on the first order perturbation of…

Strongly Correlated Electrons · Physics 2015-06-11 Isaac H. Kim

In this paper, some general properties of Shannon information measures are investigated over sets of probability distributions with restricted marginals. Certain optimization problems associated with these functionals are shown to be…

Information Theory · Computer Science 2020-08-13 Mladen Kovačević , Ivan Stanojević , Vojin Šenk

In this work, we derive information-theoretic properties for a modified Tsallis entropy, hereinafter referred to as q-entropy. We introduce the notions of joint q-entropy, conditional q-entropy, relative q-entropy, conditional mutual…

Mathematical Physics · Physics 2026-03-31 Marco A. S. Trindade

We review subbadditivity properties of Shannon entropy, in particular, from the Shearer's inequality we derive the "infimum rule" for actions of amenable groups. We briefly discuss applicability of the "infimum formula" to actions of other…

Dynamical Systems · Mathematics 2015-02-27 Tomasz Downarowicz , Bartosz Frej , Pierre-Paul Romagnoli

We introduce a novel entropy-related function, \textit{non-repeatability}, designed to capture dynamical behaviors in complex systems. Its normalized form, \textit{mutability}, has been previously applied in statistical physics as a…

Statistical Mechanics · Physics 2025-04-04 Eugenio E. Vogel , Francisco J. Peña , G. Saravia , P. Vargas

The uncertainty relation based on the Shannon entropies of the probability densities in position and momentum spaces is improved for quantum systems in arbitrary $D$-dimensional spherically symmetric potentials. To find it, we have used the…

Mathematical Physics · Physics 2013-05-22 Łukasz Rudnicki , Pablo Sánchez-Moreno , Jesús S. Dehesa

We calculate Shannon information entropy of trapped interacting bosons in both the position and momentum spaces, $S_r$ and $S_k$ respectively. The total entropy maintains the fuctional form $S=a + b \ln N$ for repulsive bosons. At the…

Quantum Gases · Physics 2013-01-25 Sudip Kumar Haldar , Barnali Chakrabarti

We present a study of the equilibration process of nonequilibrium systems by means of molecular dynamics simulation technique. The nonequilibrium conditions are achieved in systems by defining velocity components of the constituent atoms…

Statistical Mechanics · Physics 2015-10-30 A. Giri , Nilangshu K. Das , P. Barat

It is well established that the notion of min-entropy fails to satisfy the \emph{chain rule} of the form $H(X,Y) = H(X|Y)+H(Y)$, known for Shannon Entropy. Such a property would help to analyze how min-entropy is split among smaller blocks.…

Information Theory · Computer Science 2017-03-01 Maciej Skorski

We discuss some inequalities for N nonnegative numbers. We use these inequalities to obtain known inequalities for probability distributions and new entropic and information inequalities for quantum tomograms of qudit states. The…

Quantum Physics · Physics 2013-07-04 Margarita A. Man'ko , Vladimir I. Man'ko

Many partially-successful attempts have been made to find the most natural discrete-variable version of Shannon's entropy power inequality (EPI). We develop an axiomatic framework from which we deduce the natural form of a discrete-variable…

Information Theory · Computer Science 2016-11-17 Saikat Guha , Jeffrey H. Shapiro , Raul Garcia-Patron Sanchez

We consider the uncertainty between two pairs of local projective measurements performed on a multipartite system. We show that the optimal bound in any linear uncertainty relation, formulated in terms of the Shannon entropy, is additive.…

Quantum Physics · Physics 2018-03-28 Rene Schwonnek

This paper has a flaw in an argument that uses the weak-* convergence of measures. The paper was replaced by "Entropy and Its Variational Principle for Locally Compact Metrizable Systems", by the same authors.

Dynamical Systems · Mathematics 2015-11-09 André Caldas , Mauro Patrão

We show that the essential properties of entropy (monotonicity, additivity and subadditivity) are consequences of entropy being a monoidal natural transformation from the under category functor $-/\mathsf{LProb}_{\rho}$ (where…

Category Theory · Mathematics 2024-04-16 Cheuk Ting Li

The information-theoretic approach to Bell's theorem is developed with use of the conditional $q$-entropies. The $q$-entropic measures fulfill many similar properties to the standard Shannon entropy. In general, both the locality and…

Quantum Physics · Physics 2014-11-11 Alexey E. Rastegin

Non Performing Asset(NPA) has been in a serious attention by banks over the past few years. NPA cause a huge loss to the banks hence it becomes an extremely critical step in deciding which loans have the capabilities to become an NPA and…

Machine Learning · Computer Science 2020-05-01 Ambarish Moharil , Nikhil Sonavane , Chirag Kedia , Mansimran Singh Anand

We demonstrate and discuss the process of gaining information and show an example in which some specific way of gaining information about an object results in the Tsallis form of entropy rather than in the Shannon one.

Statistical Mechanics · Physics 2009-11-13 Grzegorz Wilk , Zbigniew Wlodarczyk

Shannon's information entropy measures of the uncertainty of an event's outcome. If learning about a system reflects a decrease in uncertainty, then a plausible intuition is that learning should be accompanied by a decrease in the entropy…

Robotics · Computer Science 2015-02-20 Paul E. Smaldino