English
Related papers

Related papers: Polynomial Functors and Shannon Entropy

200 papers

Complex systems that are characterized by strong correlations and fat-tailed distribution functions have been argued to be incompatible within the framework of Boltzmann-Gibbs entropy. As an alternative, so-called generalized entropies were…

Statistical Mechanics · Physics 2022-08-15 Rudolf Hanel , Stefan Thurner

The ultimate purpose of the statistical analysis of ordinal patterns is to characterize the distribution of the features they induce. In particular, knowing the joint distribution of the pair Entropy-Statistical Complexity for a large class…

We study the entropy function of two N =2 string compactifications obtained as freely acting orbifolds of N=4 theories : the STU model and the FHSV model. The Gauss-Bonnet term for these compactifications is known precisely. We apply the…

High Energy Physics - Theory · Physics 2008-11-26 Justin R. David

Using fluorescence spectroscopy we directly measure entropy production of a single two-level system realized experimentally as an optically driven defect center in diamond. We exploit a recent suggestion to define entropy on the level of a…

Statistical Mechanics · Physics 2007-05-23 C. Tietz , S. Schuler , T. Speck , U. Seifert , J. Wrachtrup

The container methods are powerful tools to bound the number of independent sets of graphs and hypergraphs, and they have been extremely influential in the area of extremal and probabilistic combinatorics. We will focus on more specialized…

Combinatorics · Mathematics 2025-12-03 Jinyoung Park

Characterization of entropy functions is of fundamental importance in information theory. By imposing constraints on their Shannon outer bound, i.e., the polymatroidal region, one obtains the faces of the region and entropy functions on…

Information Theory · Computer Science 2026-02-04 Kaizhe He , Qi Chen

This paper is an exposition, with some new applications, of our results on the growth of entropy of convolutions. We explain the main result on $\mathbb{R}$, and derive, via a linearization argument, an analogous result for the action of…

Dynamical Systems · Mathematics 2017-06-07 Michael Hochman

We recently introduced the Fast Newton Transform (FNT), an hierarchical algorithm for performing multivariate Newton interpolation in arbitrary downward closed polynomial spaces of spatial dimension $m$. Here, we analyze the FNT in the…

Numerical Analysis · Mathematics 2025-08-06 Phil-Alexander Hofmann , Damar Wicaksono , Michael Hecht

We present a technique for entropy optimization to calculate a distribution from its moments. The technique is based upon maximizing a discretized form of the Shannon entropy functional by mapping the problem onto a dual space where an…

Disordered Systems and Neural Networks · Physics 2009-11-10 K. Bandyopadhyay , A. K. Bhattacharya , Parthapratim Biswas , D. A. Drabold

In statistical physics, entropy is generally logarithm of probability. Therefore, if dynamics is decomposed by log, entropy production should be decomposed properly. In the present work, log-decomposition of dynamics is introduced. By which…

Statistical Mechanics · Physics 2014-04-30 Jang-il Sohn

Stochastic thermodynamics extends classical thermodynamics to small systems in contact with one or more heat baths. It can account for the effects of thermal fluctuations and describe systems far from thermodynamic equilibrium. A basic…

Statistical Mechanics · Physics 2018-01-04 Momčilo Gavrilov , Raphaël Chétrite , John Bechhoefer

A consistent generalization of statistical mechanics is obtained by applying the maximum entropy principle to a trace-form entropy and by requiring that physically motivated mathematical properties are preserved. The emerging…

Statistical Mechanics · Physics 2009-11-10 G. Kaniadakis , M. Lissia , A. M. Scarfone

We show that the distribution function of the first particle in a discrete orthogonal polynomial ensemble can be obtained through a certain recurrence procedure, if the (difference or q-) log-derivative of the weight function is rational.…

Mathematical Physics · Physics 2009-11-07 Alexei Borodin , Dmitriy Boyarchenko

Similarly to the system Hamiltonian, a subsystem's reduced density matrix is composed of blocks characterized by symmetry quantum numbers (charge sectors). We present a geometric approach for extracting the contribution of individual charge…

Statistical Mechanics · Physics 2018-05-17 Moshe Goldstein , Eran Sela

We introduce the notion of numerical functors to generalise Eilenberg & MacLane's polynomial functors to modules over a binomial base ring. After shewing how these functors are encoded by modules over a certain ring, we record a precise…

Representation Theory · Mathematics 2015-09-24 Qimh Richey Xantcha

Following a recent proof of Shannon's entropy power inequality (EPI), a comprehensive framework for deriving various EPIs for the R\'enyi entropy is presented that uses transport arguments from normal densities and a change of variable by…

Information Theory · Computer Science 2018-10-17 Olivier Rioul

In this work, we develop a general method for estimating the Shannon entropy of a bidimensional sequence based on the extrapolation of block entropies. We apply this method to analyse the spatial configurations of cities of different…

Physics and Society · Physics 2024-09-04 E. Brigatti , V. M. Netto , F. N. M. de Sousa Filho , C. Cacholas

We consider the problem of drawing samples from posterior distributions formed under a Dirichlet prior and a truncated multinomial likelihood, by which we mean a Multinomial likelihood function where we condition on one or more counts being…

Methodology · Statistics 2012-09-04 Matthew James Johnson , Alan S. Willsky

Superstatistics describes statistical systems that behave like superpositions of different inverse temperatures $\beta$, so that the probability distribution is $p(\epsilon_i) \propto \int_{0}^{\infty} f(\beta) e^{-\beta \epsilon_i}d\beta$,…

Statistical Mechanics · Physics 2016-10-03 Rudolf Hanel , Stefan Thurner , Murray Gell-Mann

We consider an array of random variables, taking values in a complete and separable metric space, that exhibits a kind of symmetry which we call row exchangeability. Given such an array, a natural model for Bayesian nonparametric inference…

Statistics Theory · Mathematics 2025-10-10 Evan Donald , Jason Swanson