English
Related papers

Related papers: Maximum-entropy inference and inverse continuity o…

200 papers

We prove existence of maximal entropy measures for an open set of non-uniformly expanding local diffeomorphisms on a compact Riemannian manifold. In this context the topological entropy coincides with the logarithm of the degree, and these…

Dynamical Systems · Mathematics 2007-05-23 Krerley Oliveira , Marcelo Viana

The Random Permutation Set (RPS) is a new type of set proposed recently, which can be regarded as the generalization of evidence theory. To measure the uncertainty of RPS, the entropy of RPS and its corresponding maximum entropy have been…

Information Theory · Computer Science 2024-03-12 Jiefeng Zhou , Zhen Li , Kang Hao Cheong , Yong Deng

Very little is currently known about the dynamics of non-polynomial entire maps in several complex variables. The family of transcendental H\'enon maps offers the potential of combining ideas from transcendental dynamics in one variable,…

Dynamical Systems · Mathematics 2021-02-11 Leandro Arosio , Anna Miriam Benini , John Erik Fornæss , Han Peters

Probabilistic reasoning systems combine different probabilistic rules and probabilistic facts to arrive at the desired probability values of consequences. In this paper we describe the MESA-algorithm (Maximum Entropy by Simulated Annealing)…

Artificial Intelligence · Computer Science 2013-03-25 Gerhard Paaß

The macro-to-micro transition in a heterogeneous material is envisaged as the selection of a probability distribution by the Principle of Maximum Entropy (MAXENT). The material is made of constituents, e.g. given crystal orientations. Each…

Classical Physics · Physics 2007-05-23 Mayeul Arminjon , Didier Imbault

In random cellular systems, both observation and maximum entropy inference give a specific form to the topological pair correlation: it is bi-affine in the cells number of edges with coefficients depending on the distance between the two…

Soft Condensed Matter · Physics 2007-09-14 Faez Miri , Christophe Oguey

For a wide range of entropy measures, easy calculation of equilibria is possible using a principle of Game Theoretical Equilibrium related to Jaynes Maximum Entropy Principle. This follows previous work of the author and relates to works of…

Statistical Mechanics · Physics 2009-11-13 Flemming Topsøe

In this paper, we identify a class of absolutely continuous probability distributions, and show that the differential entropy is uniformly convergent over this space under the metric of total variation distance. One of the advantages of…

Information Theory · Computer Science 2018-01-03 Hamid Ghourchian , Amin Gohari , Arash Amini

Maximum entropy principle identifies forces conjugated to observables and the thermodynamic relations between them, independent upon their underlying mechanistic details. For data about state distributions or transition statistics, the…

Statistical Mechanics · Physics 2023-12-08 Ying-Jen Yang , Hong Qian

Recently there has been growing interest in the use of Maximum Relative Entropy (MaxREnt) as a tool for statistical inference in ecology. In contrast, here we propose MaxREnt as a tool for applying statistical mechanics to ecology. We use…

Populations and Evolution · Quantitative Biology 2007-12-13 Roderick C. Dewar , Annabel Porte

Maximization of the entropy rate is an important issue to design diffusion processes aiming at a well-mixed state. We demonstrate that it is possible to construct maximal-entropy random walks with only local information on the graph…

Statistical Mechanics · Physics 2011-03-14 Roberta Sinatra , Jesús Gómez-Gardeñes , Renaud Lambiotte , Vincenzo Nicosia , Vito Latora

We develop a new theoretical framework for describing steady-state quantum transport phenomena, based on the general maximum-entropy principle of non-equilibrium statistical mechanics. The general form of the many-body density matrix is…

Mesoscale and Nanoscale Physics · Physics 2007-05-23 P. Bokes , R. W. Godby

We will consider various definitions of topological entropy for multivalued nonautonomous dynamical systems in compact Hausdorff spaces. Some of them can deal with arbitrary multivalued maps, i.e. when no restrictions are imposed on them.…

Dynamical Systems · Mathematics 2024-06-25 Pavel Ludvík , Jan Andres

The classical problem of maximizing the Shannon entropy of a sum of independent random variables supported on a finite alphabet is considered and settled in the ternary case. Namely, the following theorem is established: if…

Information Theory · Computer Science 2026-05-13 Mladen Kovačević

The maximum entropy approach operating with quite general entropy measure and constraint is considered. It is demonstrated that for a conditional or parametrized probability distribution $f(x|\mu)$ there is a "universal" relation among the…

Statistical Mechanics · Physics 2015-05-19 E. V. Vakarin , J. P. Badiali

The maximum entropy principle (MEP) is a method for obtaining the most likely distribution functions of observables from statistical systems, by maximizing entropy under constraints. The MEP has found hundreds of applications in ergodic and…

Classical Physics · Physics 2016-10-03 Rudolf Hanel , Stefan Thurner , Murray Gell-Mann

We prove a complete realization theorem for multifractal entropy spectra of continuous potentials on a broad class of dynamical systems. More precisely, for every $H>0$ and every continuous concave function on a compact interval with…

Dynamical Systems · Mathematics 2026-05-21 Xiaobo Hou , Xueting Tian

Maximum entropy distributions with discrete support in $m$ dimensions arise in machine learning, statistics, information theory, and theoretical computer science. While structural and computational properties of max-entropy distributions…

Data Structures and Algorithms · Computer Science 2019-06-04 Damian Straszak , Nisheeth K. Vishnoi

We derive an optimal entropic uncertainty relation for an arbitrary pair of observables in a two-dimensional Hilbert space. Such a result, for the simple case we are considering, definitively improves all the entropic uncertainty relations…

Quantum Physics · Physics 2015-06-26 GianCarlo Ghirardi , Luca Marinatto , Raffaele Romano

Traditionally, the Method of (Shannon-Kullback's) Relative Entropy Maximization (REM) is considered with linear moment constraints. In this work, the method is studied under frequency moment constraints which are non-linear in…

Data Analysis, Statistics and Probability · Physics 2012-08-27 M. Grendar, , M. Grendar