Related papers: Statistical Physics of Coding for the Integers
We describe the statistical mechanics of a new method to produce very cold atoms or molecules. The method results from trapping a gas in a potential well, and sweeping through the well a semi-permeable barrier, one that allows particles to…
The fundamentals of Statistical Mechanics require a fresh definition in the context of the developments in Classical Mechanics of integrable and chaotic systems. This is done with the introduction of Micro Partitions ; a union of disjoint…
A range of recent works addresses the problem of compression of sequence of tokens into a shorter sequence of real-valued vectors to be used as inputs instead of token embeddings or key-value cache. These approaches are focused on reduction…
The performance of ``typical set (pairs) decoding'' for ensembles of Gallager's linear code is investigated using statistical physics. In this decoding, error happens when the information transmission is corrupted by an untypical noise or…
We develop a general method for computing logarithmic and log-gamma expectations of distributions. As a result, we derive series expansions and integral representations of the entropy for several fundamental distributions, including the…
Precise estimation of the probabilistic structure of natural images plays an essential role in image compression. Despite the recent remarkable success of end-to-end optimized image compression, the latent codes are usually assumed to be…
We present Pcodec (Pco), a format and algorithm for losslessly compressing numerical (float or integer) sequences. Pco's core and most novel component is a binning algorithm that quickly converges to the true entropy of smoothly,…
The statistical physics properties of low-density parity-check codes for the binary symmetric channel are investigated as a spin glass problem with multi-spin interactions and quenched random fields by the cavity method. By evaluating the…
We use a simple hard-core gas model to study the dynamics of small exploding systems. The system is initially prepared in a thermalized state in a spherical container and then allowed to expand freely into the vacuum. We follow the…
We consider critical models in one dimension. We study the ground state in thermodynamic limit [infinite lattice]. Following Bennett, Bernstein, Popescu, and Schumacher, we use the entropy of a sub-system as a measure of entanglement. We…
A model of a quantum information source is proposed, based on the Gibbs ensemble of ideal (free) particles (bosons or fermions). We identify the (thermodynamic) von Neumann entropy as the information rate and establish the classical…
A novel inline data compression method is presented for single-precision vectors in three dimensions. The primary application of the method is for accelerating computational physics calculations where the throughput is bound by memory…
We question the validity of the grand canonical ensemble for the description of Bose-Einstein condensation of small ideal Bose gas samples in isolated harmonic traps. While the ground state fraction and the specific heat capacity can be…
The purpose of this paper is to present a quantum statistical theory of 2-dimensional vortex gas based on the generalized Hamiltonian dynamics recently developed. The quantized spectrum is evaluated for a pair of vortex on the basis of the…
We present a new exact method to numerically compute the thermodynamical properties of an interacting Bose gas in the canonical ensemble. As in our previous paper (Phys. Rev. A, 63 023606 (2001)), we write the density operator $\rho$ as an…
The weak law of large numbers implies that, under mild assumptions on the source, the Renyi entropy per produced symbol converges (in probability) towards the Shannon entropy rate. This paper quantifies the speed of this convergence for…
Data compression has been widely applied in many data processing areas. Compression methods use variable-size codes with the shorter codes assigned to symbols or groups of symbols that appear in the data frequently. Fibonacci coding, as a…
In this work, we describe the dynamics of a Bose-Einstein condensate interacting with a degenerate Fermi gas, at zero temperature. First, we analyze the mean-field approximation of the many-body Schr\"odinger dynamics and prove emergence of…
We consider the distributed compression of Soft Random Geometric Graphs (SRGGs) above the connectivity threshold. We establish the Slepian-Wolf rate region for the SRGG in the setting where there are a finite number of encoders compressing…
It is well established that the brain spontaneously traverses through a very large number of states. Nevertheless, despite its relevance to understanding brain function, a formal description of this phenomenon is still lacking. To this end,…