English
Related papers

Related papers: Minimization Problems Based on Relative $\alpha$-E…

200 papers

For certain groups, parabolic subgroups appear as stabilizers of flags of sets or vector spaces. Quotients by these parabolic subgroups represent orbits of flags, and their cardinalities asymptotically reveal entropies (as rates of…

Information Theory · Computer Science 2025-12-03 Ryan Leal , Jingtong Sun , Juan Pablo Vigneaux

We derive a parallel sampling algorithm for computational inverse problems that present an unknown linear forcing term and a vector of nonlinear parameters to be recovered. It is assumed that the data is noisy and that the linear part of…

Numerical Analysis · Mathematics 2022-03-24 Darko Volkov

The principle of maximum entropy is a broadly applicable technique for computing a distribution with the least amount of information possible constrained to match empirical data, for instance, feature expectations. We seek to generalize…

Information Theory · Computer Science 2022-05-30 Kenneth Bogert

We studied the Sharma-Mittal relative entropy and showed that its physical meaning is the free energy difference between the off-equilibrium and equilibrium distributions. Unfortunately, Sharma-Mittal relative entropy may acquire this…

Statistical Mechanics · Physics 2007-05-23 E. Akturk , G. B. Bagci , R. Sever

The entropy power inequality, which plays a fundamental role in information theory and probability, may be seen as an analogue of the Brunn-Minkowski inequality. Motivated by this connection to Convex Geometry, we survey various recent…

Information Theory · Computer Science 2020-02-07 Mokshay Madiman , James Melbourne , Peng Xu

This article proposes a new two-parameter generalized entropy, which can be reduced to the Tsallis and the Shannon entropy for specific values of its parameters. We develop a number of information-theoretic properties of this generalized…

Mathematical Physics · Physics 2024-05-02 Supriyo Dutta , Shigeru Furuichi , Partha Guha

Tsallis relative operator entropy is defined as a parametric extension of the relative operator entropy. Some properties of the Tsallis relative operator entropy are investigated. Also some operator inequalities related to the Tsallis…

Functional Analysis · Mathematics 2010-03-29 S. Furuichi , K. Yanagi , K. Kuriyama

From the output produced by a memoryless deletion channel from a uniformly random input of known length $n$, one obtains a posterior distribution on the channel input. The difference between the Shannon entropy of this distribution and that…

Information Theory · Computer Science 2018-08-01 Arash Atashpendar , David Mestel , A. W. Roscoe , Peter Y. A. Ryan

We show that size-rank distributions with power-law decay (often only over a limited extent) observed in a vast number of instances in a widespread family of systems obey Tsallis statistics. The theoretical framework for these distributions…

Statistical Mechanics · Physics 2014-09-29 G. Cigdem Yalcin , Alberto Robledo , Murray Gell-Mann

The notion of group entropy is proposed. It enables to unify and generalize many different definitions of entropy known in the literature, as those of Boltzmann-Gibbs, Tsallis, Abe and Kaniadakis. Other new entropic functionals are…

Statistical Mechanics · Physics 2015-05-28 Piergiulio Tempesta

Relative complexity measures the complexity of a probability preserving transformation relative to a factor being a sequence of random variables whose exponential growth rate is the relative entropy of the extension. We prove distributional…

Dynamical Systems · Mathematics 2012-10-30 Jon Aaronson

We adapt the statistical mechanics of the shallow-water equations to the case where the flow is forced at small scales. We assume that the statistics of forcing is encoded in a prior potential vorticity distribution which replaces the…

Fluid Dynamics · Physics 2009-11-13 P. H. Chavanis , B. Dubrulle

We describe several algorithms for matrix completion and matrix approximation when only some of its entries are known. The approximation constraint can be any whose approximated solution is known for the full matrix. For low rank…

Numerical Analysis · Mathematics 2014-07-01 Gil Shabat , Yaniv Shmueli , Amir Averbuch

In this paper we apply the entropy principle to the relativistic version of the differential equations describing a standard fluid flow, that is, the equations for mass, momentum, and a system for the energy matrix. These are the second…

Mathematical Physics · Physics 2018-02-22 Hans Wilhelm Alt

Compositional data consists of vectors of proportions whose components sum to 1. Such vectors lie in the standard simplex, which is a manifold with boundary. One issue that has been rather controversial within the field of compositional…

Statistics Theory · Mathematics 2019-02-22 Yannis Pantazis , Michail Tsagris , Andrew T. A. Wood

In this paper, we will present a generalization for a minimization problem from I. Daubechies, M. Defrise, and C. Demol [3]. This generalization is useful for solving many practical problems in which more than one constraint are involved.…

Optimization and Control · Mathematics 2019-12-20 Saman Khoramian

We systematically explore a class of constrained optimization problems with linear objective function and constraints that are linear combinations of logarithms of the optimization variables. Such problems can be viewed as a generalization…

Classical Analysis and ODEs · Mathematics 2021-01-01 Sergey Sadov

R\'esum\'e: Le principal objet de cette communication est de faire une r\'etro perspective succincte de l'utilisation de l'entropie et du principe du maximum d'entropie dans le domaine du traitement du signal. Apr\`es un bref rappel de…

Data Analysis, Statistics and Probability · Physics 2007-05-23 Ali Mohammad-Djafari

We study the relative entropy and the trace square distance, both of which measure the distance between reduced density matrices of two excited states in two dimensional conformal field theories. We find a general formula for the relative…

High Energy Physics - Theory · Physics 2016-08-24 Gábor Sárosi , Tomonori Ugajin

We generalize the usual exponential Boltzmann factor to any reasonable and potentially observable distribution function, $B(E)$. By defining generalized logarithms $\Lambda$ as inverses of these distribution functions, we are led to a…

Statistical Mechanics · Physics 2007-05-23 Rudolf Hanel , Stefan Thurner