Related papers: Polynomial Functors and Shannon Entropy
The two parameter Poisson-Dirichlet Process (PDP), a generalisation of the Dirichlet Process, is increasingly being used for probabilistic modelling in discrete areas such as language technology, bioinformatics, and image analysis. There is…
We continue a line of work on extracting random bits from weak sources that are generated by simple processes. We focus on the model of locally samplable sources, where each bit in the source depends on a small number of (hidden) uniformly…
Mixture distributions are a workhorse model for multimodal data in information theory, signal processing, and machine learning. Yet even when each component density is simple, the differential entropy of the mixture is notoriously hard to…
By applying the Atiyah-Bott-Berline-Vergne equivariant integration formula upon double dimensional integrals, we find a way to compute the matrix integral representations of $4d$ $\mathcal{N}=1$ superconformal indices. The final formula…
When analyzing data from multiple sources, it is often convenient to strike a careful balance between two goals: capturing the heterogeneity of the samples and sharing information across them. We introduce a novel framework to model a…
The Shannon entropy, one of the cornerstones of information theory, is widely used in physics, particularly in statistical mechanics. Yet its characterization and connection to physics remain vague, leaving ample room for misconceptions and…
We study the homological algebra in the category $\mathcal{P}_p$ of strict polynomial functors of degree $p$ over a field of positive characteristic $p$. We determine the decomposition matrix of our category and we calculate the Ext-groups…
Two closely related topics: higher order Bohr sets and higher order almost automorphy are investigated in this paper. Both of them are related to nilsystems. In the first part, the problem which can be viewed as the higher order version of…
The unfolding of a polymer below the $\theta$ point when pulled by an external force is studied both in d=2 on the lattice and in $d=3$ off lattice. A ground state analysis of finite length chains shows that the globule unfolds via multiple…
In this note, the following basic question is explored: in a cyclic group, how are the Shannon entropies of the sum and difference of i.i.d. random variables related to each other? For the integer group, we show that they can differ by any…
In this paper the chordal graph structures of polynomial sets appearing in triangular decomposition in top-down style are studied when the input polynomial set to decompose has a chordal associated graph. In particular, we prove that the…
By decoupling forward and backward stochastic trajectories, we construct a family of martingales and work theorems for both overdamped and underdamped Langevin dynamics. Our results are made possible by an alternative derivation of work…
We prove that Ringel duality in the category of strict polynomial functors can be interpreted as derived functors of non-additive functors (in the sense of Dold and Puppe). We give applications of this fact for both theories.
The entropic discriminant is a non-negative polynomial associated to a matrix. It arises in contexts ranging from statistics and linear programming to singularity theory and algebraic geometry. It describes the complex branch locus of the…
We introduce a 'quasi-topological` term [1] in D=1+1 dimensions and the entropy for black holes is calculated [2]. The source of entropy in this case is justified by a non-null stress-energy tensor.
We study the problem of generating monomials of a polynomial in the context of enumeration complexity. In this setting, the complexity measure is the delay between two solutions and the total time. We present two new algorithms for…
The entanglement entropy, ${\cal S}$, is an indicator of quantum correlations in the ground state of a many body quantum system. At a second-order quantum phase-transition point in one dimension ${\cal S}$ generally has a logarithmic…
We report on the recent progress in theoretical and numerical studies of entanglement entropy in lattice gauge theories. It is shown that the concept of quantum entanglement between gauge fields in two complementary regions of space can…
The Renyi entropy is a generalisation of the Shannon entropy that is sensitive to the fine details of a probability distribution. We present results for the Renyi entropy of the totally asymmetric exclusion process (TASEP). We calculate…
The stochastic entropy generated during the evolution of a system interacting with an environment may be separated into three components, but only two of these have a non-negative mean. The third component of entropy production is…