Related papers: A statistical mechanical interpretation of instant…

Quantum entanglement and coherence often allow for protocols that outperform classical ones in estimating a system's parameter. When using infinite-dimensional probes (such as a bosonic mode), one could in principle obtain infinite…

I give a highly selective overview of the way statistical mechanics explains the microscopic origins of the time asymmetric evolution of macroscopic systems towards equilibrium and of first order phase transitions in equilibrium. These…

In this paper, we present first-order accurate numerical methods for solution of the heat equation with uncertain temperature-dependent thermal conductivity. Each algorithm yields a shared coefficient matrix for the ensemble set improving…

In this paper, the instantaneous frequency estimation of nonstationary signals is considered. The instantaneous frequency is estimated from the timefrequency representation where certain percent of the coefficients is missing. The…

One-shot achievable rate region for source coding when coded side information is available at the decoder (source coding with a helper) is proposed. The achievable region proposed is in terms of conditional smooth max Renyi entropy and…

A system composed of identical spins and described by a quantum mechanical pure state is analyzed within the statistical framework presented in Part I of this work. We explicitly derive the typical values of the entropy, of the energy, and…

It is known that modeling an information source via a symbolic dynamical system evolving over the unit interval, leads to a natural lossless compression scheme attaining the entropy rate of the source, under general conditions. We extend…

We discuss here the use of generalized forms of entropy, taken as information measures, to characterize phase transitions and critical behavior in thermodynamic systems. Our study is based on geometric considerations pertaining to the space…

Machine learning has had a major impact on data compression over the last decade and inspired many new, exciting theoretical and applied questions. This paper describes one such direction -- relative entropy coding -- which focuses on…

We derive an equality for non-equilibrium statistical mechanics in finite-dimensional quantum systems. The equality concerns the worst-case work output of a time-dependent Hamiltonian protocol in the presence of a Markovian heat bath. It…

Within the framework of the random first-order transition theory of glasses, we discuss the statistics of thermal avalanches, the large scale rearrangements in driven amorphous systems near their instability. Stringy excitations yield…

We address the recently suggested problem of causal lossless coding of a randomly arriving source samples. We construct variable-to-fixed coding schemes and show that they outperform the previously considered fixed-to-variable schemes when…

I argue here that both the first and second laws of thermodynamics, generally understood to be quintessentially physical in nature, can be equally well described as being about certain types of information without the need to invoke…

This tutorial investigates the convergence of statistical mechanics and learning theory, elucidating the potential enhancements in machine learning methodologies through the integration of foundational principles from physics. The tutorial…

Predictive statistical mechanics is a form of inference from available data, without additional assumptions, for predicting reproducible phenomena. By applying it to systems with Hamiltonian dynamics, a problem of predicting the macroscopic…

Stochastic chains represent a wide and key variety of phenomena in many branches of science within the context of Information Theory and Thermodynamics. They are typically approached by a sequence of independent events or by a memoryless…

Thermodynamic length is a metric distance between equilibrium thermodynamic states. Among other interesting properties, this metric asymptotically bounds the dissipation induced by a finite time transformation of a thermodynamic system. It…

We develop a finite temperature field theory formalism in any dimension that has the filling fractions as the basic dynamical variables. The formalism efficiently decouples zero temperature dynamics from the quantum statistical sums. The…

The code base of software projects evolves essentially through inserting and removing information to and from the source code. We can measure this evolution via the elements of information - tokens, words, nodes - of the respective…

Irreversible processes accomplished in a fixed time involve nonlinearly coupled flows of matter, energy, and information. Here, using entropy production as an example, we show how thermodynamic uncertainty relations and speed limits on…