Related papers: Thermodynamically rational decision making under u…

Learning and adaptation play great role in emergent socio-economic phenomena. Complex dynamics has been previously found in the systems of multiple learning agents interacting via a simple game. Meanwhile, the single agent adaptation is…

Using information theory we derive a thermodynamics for systems evolving under a collective motion, i.e. under a time-odd constraint. An illustration within the Lattice gas Model is given for two model cases: a collision between two complex…

When robots share the same workspace with other intelligent agents (e.g., other robots or humans), they must be able to reason about the behaviors of their neighboring agents while accomplishing the designated tasks. In practice,…

After presenting possible motives for fighting against the second law of thermodynamics, several attempts to beat this law are analyzed. The second law wins, but an interesting interpretation of it emerges. This interpretation uses the…

There is a deep connection between thermodynamics, information and work extraction. Ever since the birth of thermodynamics, various types of Maxwell demons have been introduced in order to deepen our understanding of the second law. Thanks…

This paper studies a risk-sensitive decision-making problem under uncertainty. It considers a decision-making process that unfolds over a fixed number of stages, in which a decision-maker chooses among multiple alternatives, some of which…

We consider the stationary state of a Markov process on a bipartite system from the perspective of stochastic thermodynamics. One subsystem is used to extract work from a heat bath while being affected by the second subsystem. We show that…

Measurements --- interactions which establish correlations between a system and a recording device --- can be made thermodynamically reversible. One might be concerned that such reversibility will make the second law of thermodynamics…

The ocean thermohaline circulation under uncertainty is investigated by a random dynamical systems approach. It is shown that the asymptotic dynamics of the thermohaline circulation is described by a random attractor and by a system with…

As artificial agents become increasingly capable, what internal structure is *necessary* for an agent to act competently under uncertainty? Classical results show that optimal control can be *implemented* using belief states or world…

As machine learning systems become more powerful they also become increasingly unpredictable and opaque. Yet, finding human-understandable explanations of how they work is essential for their safe deployment. This technical report…

A Maxwell's demon type ``information engine" which extracts work from a bath is constructed from a microscopic Hamiltonian for the whole system including a subsystem, a thermal bath, and a nonequilibrium bath of phonons or photons which…

Assessing the systemic effects of uncertainty that arises from agents' partial observation of the true states of the world is critical for understanding a wide range of scenarios. Yet, previous modeling work on agent learning and…

Thermal activation is mediated by field configurations that correspond to saddle points of the energy functional. The rate of probability flow along the unstable functional directions, i.e the activation rate, is usually obtained from the…

In many robotic applications, an autonomous agent must act within and explore a partially observed environment that is unobserved by its human teammate. We consider such a setting in which the agent can, while acting, transmit declarative…

The second law of thermodynamics is probabilistic in nature. Its formulation requires that the state of a system be described by a probability distribution. A natural question, thereby, arises as to whether a prior knowledge about the state…

We describe a minimal model of a quantum Maxwell demon obeying Hamiltonian dynamics. The model is solved exactly, and we analyze its steady-state behavior. We find that writing information to a quantum memory induces a probability current…

We expand the standard thermodynamic framework of a system coupled to a thermal reservoir by considering a stream of independently prepared units repeatedly put into contact with the system. These units can be in any nonequilibrium state…

The ability to measure the stochastic degrees of freedom of a thermal system enables the extraction of energy from an equilibrium heat bath. This is the underlying principle of Maxwell's demon and subsequent information engines. Here, we…

An analyst observes the frequency with which a decision maker (DM) takes actions, but not the frequency conditional on payoff-relevant states. We ask when the analyst can rationalize the DM's choices as if the DM first learns something…