Related papers: Information Flow and Computation in the Maxwell De…
We propose an iterative method for approximately computing the capacity of discrete memoryless channels, possibly under additional constraints on the input distribution. Based on duality of convex programming, we derive explicit upper and…
Mechanical Maxwell's demons, such as Smoluchowski's trapdoor and Feynman's ratchet and pawl need external energy source to operate. If you cease to feed a demon the Second Law of thermodynamics will quickly stop its operation. Nevertheless,…
The information capacity of the universe has been a topic of great debate since 1970s, and continues to stimulate multiple branches of physics research. Here we used Shannon's information theory to estimate the amount of encoded information…
Emerging evidence suggests that physical systems operating as Maxwell demons, in which some subsystem of a larger system extracts heat energy from its environment in an apparent local violation of the second law, are commonplace throughout…
The problem of Maxwell's demon in granular gas is revisited in the case of a mixture of two particle species. The phase space is found to be 2d. Existence of cyclic orbits, with periodic segregation, is demonstrated by investigating the…
Information theory, though originally developed for communications engineering, provides mathematical tools with broad applications across science. These tools characterize the fundamental limits of data compression and transmission in the…
We study the problem of storing the minimum number of bits required to answer next/previous larger/smaller value queries on an array $A$ of $n$ numbers, without storing $A$. We show that these queries can be answered by storing at most…
Quantum discord was proposed as an information theoretic measure of the ``quantumness'' of correlations. I show that discord determines the difference between the efficiency of quantum and classical Maxwell's demons in extracting work from…
The asymptotic convergence of probability density function (pdf) and convergence of differential entropy are examined for the non-stationary processes that follow the maximum entropy principle (MaxEnt) and maximum entropy production…
Maxwell's demon is a famous thought experiment and a paradigm of the thermodynamics of information. It is related to Szilard's engine, a two-state information-to-work conversion device in which the demon performs single measurements and…
Quantum discord was proposed as an information theoretic measure of the ``quantumness'' of correlations. I show that discord determines the difference between the efficiency of quantum and classical Maxwell's demons -- that is, entities…
We will discuss the maximum entropy production (MaxEP) principle based on Jaynes' information theoretical arguments, as was done by Dewar (2003, 2005). With the help of a simple mathematical model of a non-equilibrium system, we will show…
Data transformation, e.g. feature transformation and selection, is an integral part of any machine learning procedure. In this paper we introduce an information-theoretic model and tools to assess the quality of data transformations in…
We investigate the role of chirality on the performance of a Maxwell demon implemented in a quantum Hall bar with a localized impurity. Within a stochastic thermodynamics description we investigate the ability of such a demon to drive a…
A demonic being, introduced by Maxwell, to miraculously create thermal non-equilibrium and violate the Second law of thermodynamics, has been among the most intriguing and elusive wishful concepts for over 150 years. Maxwell and his…
Information plays a pivotal role in the thermodynamics of nonequilibrium processes with feedback. However, much remains to be learned about the nature of information fluctuations in small scale devices and their relation with fluctuations…
The second law of thermodynamics is probabilistic in nature. Its formulation requires that the state of a system be described by a probability distribution. A natural question, thereby, arises as to whether a prior knowledge about the state…
The so-called {\em leakage-chain rule} is a very important tool used in many security proofs. It gives an upper bound on the entropy loss of a random variable $X$ in case the adversary who having already learned some random variables…
A communication theory for a transmitter broadcasting to many receivers is presented. In this case energetic considerations cannot be neglected as in Shannon theory. It is shown that, when energy is assigned to the information bit,…
Encoding schemes and error-correcting codes are widely used in information technology to improve the reliability of data transmission over real-world communication channels. Quantum information protocols can further enhance the performance…