Related papers: Work extraction, information-content and the Landa…
A major role of robots is to assist in assembly by moving building blocks and by exerting forces, e.g. to snap parts together. At the molecular scale, diffusive transport and thermal forces permit self-assembly, and molecular robots can…
Constrained decoding enables Language Models (LMs) to produce samples that provably satisfy hard constraints. However, existing constrained-decoding approaches often distort the underlying model distribution, a limitation that is especially…
The second law of thermodynamics, formulated as an ultimate bound on the maximum extractable work, has been rigorously derived in multiple scenarios. However, the unavoidable limitations that emerge due to the lack of control on small…
In the analysis of any type of system, granting maximum information extraction from its data is non-trivial. Confidence in successful information extraction typically builds on prior knowledge of the studied system or on the user's…
Measurements --- interactions which establish correlations between a system and a recording device --- can be made thermodynamically reversible. One might be concerned that such reversibility will make the second law of thermodynamics…
In the Minimum Description Length (MDL) principle, learning from the data is equivalent to an optimal coding problem. We show that the codes that achieve optimal compression in MDL are critical in a very precise sense. First, when they are…
We uncover the existence of a universal phenomenon concerning the electromagnetic optical force exerted by light or other electromagnetic waves on a distribution of charges and currents in general, and of particles in particular. This…
Biological organisms must perform computation as they grow, reproduce, and evolve. Moreover, ever since Landauer's bound was proposed it has been known that all computation has some thermodynamic cost -- and that the same computation can be…
In this thesis we present several results in coding theory, concerning error-correcting codes and the Shannon capacity. 1. We give a general symmetry reduction of matrices occuring in semidefinite programs in coding theory. 2. We apply the…
Irreversible information processing cannot be carried out without some inevitable thermodynamical work cost. This fundamental restriction, known as Landauer's principle, is increasingly relevant today, as the energy dissipation of computing…
There is a deep connection between thermodynamics, information and work extraction. Ever since the birth of thermodynamics, various types of Maxwell demons have been introduced in order to deepen our understanding of the second law. Thanks…
For a linear block code C, its stopping redundancy is defined as the smallest number of check nodes in a Tanner graph for C, such that there exist no stopping sets of size smaller than the minimum distance of C. Schwartz and Vardy…
As early as 1867, two years after the introduction of the concept of entropy by Clausius, Maxwell showed that the limitations imposed by the second law of thermodynamics depend on the information that one possesses about the state of a…
In the Second Law of Thermodynamics which is a macroscopic physical law that states that in any isolated system, entropy can only increase and order, or organization, can only decrease. This means that in the long run, energy will always…
We consider the Minimum Description Length principle for online sequence prediction. If the underlying model class is discrete, then the total expected square loss is a particularly interesting performance measure: (a) this quantity is…
The common saying, that information is power, takes a rigorous form in stochastic thermodynamics, where a quantitative equivalence between the two helps explain the paradox of Maxwell's demon in its ability to reduce entropy. In the present…
Many physical, biological, and even social systems are faced with the problem of how to efficiently harvest free energy from an environment that can have many possible states, yet only have a limited number of harvesting protocols to choose…
We report two results complementing the second law of thermodynamics for Markovian open quantum systems coupled to multiple reservoirs with different temperatures and chemical potentials. First, we derive a nonequilibrium free energy…
Using the concept of discrete noiseless channels, it was shown by Shannon in A Mathematical Theory of Communication that the ultimate performance of an encoder for a constrained system is limited by the combinatorial capacity of the system…
We have investigated the recently proposed self-consistent theory of fluctuation - induced transport. In this framework the subsystem under study is coupled to two independent baths at different temperatures. In this non-equilibrium system…