Related papers: Scaled entropy of filtrations of $\sigma$-fields
Estimating entropy production, which quantifies irreversibility and energy dissipation, remains a significant challenge despite its central role in nonequilibrium physics. We propose a novel method for estimating the mean entropy production…
We propose an additional category of dimensionless groups based on the principle of {\it entropic similarity}, defined by ratios of (i) entropy production terms; (ii) entropy flow rates or fluxes; or (iii) information flow rates or fluxes.…
In [1] it is shown that recurrent neural networks (RNNs) can learn - in a metric entropy optimal manner - discrete time, linear time-invariant (LTI) systems. This is effected by comparing the number of bits needed to encode the…
Bowen's notion of sofic entropy is a powerful invariant for classifying probability-preserving actions of sofic groups. It can be defined in terms of the covering numbers of certain metric spaces associated to such an action, the `model…
Standard field theoretic renormalization group is applied to the model of landscape erosion introduced by R. Pastor-Satorras and D. H. Rothman [Phys. Rev. Lett. 80: 4349 (1998); J. Stat. Phys. 93: 477 (1998)] yielding unexpected results:…
We consider the statistical inverse problem of estimating a background flow field (e.g., of air or water) from the partial and noisy observation of a passive scalar (e.g., the concentration of a solute), a common experimental approach to…
We analyse the performance of a recursive Monte Carlo method for the Bayesian estimation of the static parameters of a discrete--time state--space Markov model. The algorithm employs two layers of particle filters to approximate the…
We illustrate the importance of mass scales and their relation in the specific case of the linear sigma model within the context of its one loop Ward identities. In the calculation it becomes apparent the delicate and essential connection…
Previous measurements utilizing Maxwell relations to measure change in entropy, $S$, demonstrated remarkable accuracy of measuring the spin-1/2 entropy of electrons in a weakly coupled quantum dot. However, these previous measurements…
Exactly solving a spinless fermionic system in two and three dimensions, we investigate the scaling behavior of the block entropy in critical and non-critical phases. The scaling of the block entropy crucially depends on the nature of the…
The rapid adoption of synthetic data for training Large Language Models (LLMs) has introduced the technical challenge of "model collapse"-a degenerative process where recursive training on model-generated content leads to a contraction of…
Compressed Counting (CC)} was recently proposed for approximating the $\alpha$th frequency moments of data streams, for $0<\alpha \leq 2$. Under the relaxed strict-Turnstile model, CC dramatically improves the standard algorithm based on…
In this paper we show the distributions of sliding block patterns for Bernoulli processes with finite alphabet, which is not based on the induction on sample size. We show a new inclusion-exclusion formula in multivariate generating…
Complex systems are often inherently non-ergodic and non-Markovian for which Shannon entropy loses its applicability. In particular accelerating, path-dependent, and aging random walks offer an intuitive picture for these non-ergodic and…
Predictability of behavior has emerged an an important characteristic in many fields including biology, medicine, and marketing. Behavior can be recorded as a sequence of actions performed by an individual over a given time period. This…
The off-shell entropy for a massless scalar field in a D-dimensional Rindler-like space-time is investigated within the conical Euclidean approach in the manifold $C_\be\times\M^N$, $C_\be$ being the 2-dimensional cone, making use of the…
We describe an approach to improving model fitting and model generalization that considers the entropy of distributions of modelling residuals. We use simple simulations to demonstrate the observational signatures of overfitting on ordered…
The classical Density Functional Theory (DFT) is introduced as an application of entropic inference for inhomogeneous fluids at thermal equilibrium. It is shown that entropic inference reproduces the variational principle of DFT when…
We consider the $N$-particle noncolliding Bernoulli random walk --- a discrete time Markov process in $\mathbb{Z}^{N}$ obtained from a collection of $N$ independent simple random walks with steps $\in\{0,1\}$ by conditioning that they never…
Motivated by the approach of random linear codes, a new distance in the vector space over a finite field is defined as the logarithm of the "surface area" of a Hamming ball with radius being the corresponding Hamming distance. It is named…