Related papers: Joint source-channel coding via statistical mechan…
Shannon's channel coding theorem describes the maximum possible rate of reliable information transfer through a classical noisy communication channel. It, together with the source coding theorem, characterizes lossless channel communication…
Consider the problem of source coding in networks with multiple receiving terminals, each having access to some kind of side information. In this case, standard coding techniques are either prohibitively complex to decode, or require…
In this paper, we derive both the Adam-Gibbs and the Rosenfield relations from the microscopic point of view and compare them with the numerical calculation for one and two dimensional systems. The comparison shows there is an excellent…
For reliable transmission across a noisy communication channel, classical results from information theory show that it is asymptotically optimal to separate out the source and channel coding processes. However, this decomposition can fall…
In multi-terminal networks, feedback increases the capacity region and helps communication devices to coordinate. In this article, we deepen the relationship between coordination and feedback by considering a point-to-point scenario with an…
Traditional distributed source coding rarely considers the possible link between separate encoders. However, the broadcast nature of wireless communication in sensor networks provides a free gossip mechanism which can be used to simplify…
Thermodynamic uncertainty relations reveal a fundamental trade-off between the precision of a trajectory observable and entropy production, where the uncertainty of the observable is quantified by its variance. In information theory,…
We formulate a stochastic description of entropy production in scattering theory for coherent transport. We distinguish between the information entropy change due to partial knowledge of the leads' state and the thermodynamic entropy change…
We study the rectification of a two-dimensional thermal gas in a channel of asymmetric dissipative walls. For an ensemble of smooth Lennard-Jones particles, our numerical simulations reveal a non-monotonic dependence of the flux on the…
A coding theorem is proved for a class of stationary channels with feedback in which the output Y_n = f(X_{n-m}^n, Z_{n-m}^n) is the function of the current and past m symbols from the channel input X_n and the stationary ergodic channel…
Shannon's secrecy system is studied in a setting, where both the legitimate decoder and the wiretapper have access to side information sequences correlated to the source, but the wiretapper receives both the coded information and the side…
We study the transmission of a set of correlated sources $(U_1,\cdots,U_K)$ over a Gaussian multiple access relay channel with time asynchronism between the encoders. We assume that the maximum possible offset ${\mathsf{d_{max}}}(n)$…
The mixing of two different gases is one of the most common natural phenomena, with applications ranging from CO$_2$ capture to water purification. Traditionally, mixing is analyzed in the context of local thermal equilibrium, where systems…
On the basis of information theory, a new formalism of classical non-relativistic mechanics of a mass point is proposed. The particle trajectories of a general dynamical system defined on an (1+n)-dimensional smooth manifold are treated…
Motivated by the notion that the mathematics of gravity can be reproduced from a statistical requirement of maximal entropy, we study the consequence of introducing an entropic source term in the Einstein-Hilbert action. For a spatially…
The behavior of a collection of identical particles is intimately linked to the symmetries of their wavefunction under particle exchange. Topological anyons, arising as quasiparticles in low-dimensional systems, interpolate between bosons…
The thermodynamic limit of the internal energy and the entropy of the system of quantum interacting particles in random medium is shown to exist under the crucial requirements of stability and temperedness of interactions. The energy turns…
Power-law distributions are widely observed in complex systems, yet establishing their thermodynamic consistency remains a theoretical challenge. In this paper, we present a thermodynamic framework for power-law statistics based on the…
Resonant solutions of the quantum Schr\"odinger equation occur at complex energies where the S-matrix becomes singular. Knowledge of such resonances is important in the study of the underlying physical system. Often the Schr\"odinger…
We develop the strong coupling quantum thermodynamics based on the solution of the exact master equation. We find that both the Hamiltonian and the temperature must be renormalized due to the system-reservoir couplings. With the…