Related papers: Large deviation theory to model systems under an e…
The thermodynamic definition of entropy can be extended to nonequilibrium systems based on its relation to information. To apply this definition in practice requires access to the physical system's microstates, which may be prohibitively…
We propose a method for determining the most likely cause, in terms of conventional generator outages and renewable fluctuations, of power system frequency reaching a predetermined level that is deemed unacceptable to the system operator.…
The principle of maximum entropy is a broadly applicable technique for computing a distribution with the least amount of information possible constrained to match empirical data, for instance, feature expectations. We seek to generalize…
We establish a large deviation principle for the empirical measure process associated with a general class of finite-state mean field interacting particle systems with Lipschitz continuous transition rates that satisfy a certain ergodicity…
We present a new technique to obtain outer-bounds on the capacity region of networks with ultra low-rate feedback. We establish a connection between the achievable rates in the forward channel and the minimum distortion that can be attained…
Fundamental limits on the controllability of quantum mechanical systems are discussed in the light of quantum information theory. It is shown that the amount of entropy-reduction that can be extracted from a quantum system by feedback…
We consider a collection of weakly interacting diffusion processes moving in a two-scale locally periodic environment. We study the large deviations principle of the empirical distribution of the particles' positions in the combined limit…
We introduce a novel notion of invariance feedback entropy to quantify the state information that is required by any controller that enforces a given subset of the state space to be invariant. We establish a number of elementary properties,…
We study the large deviation function for the empirical measure of diffusing particles at one fixed position. We find that the large deviation function exhibits anomalous system size dependence in systems that satisfy the following…
We analyse large deviations of the dynamical activity in one-dimensional systems of diffusing hard particles. Using an optimal-control representation of the large-deviation problem, we analyse effective interaction forces which can be added…
Feedback control uses the state information of the system to actuate on it. The information used implies an effective entropy reduction of the controlled system, potentially increasing its performance. How to compute this entropy reduction…
Dissipative quantum systems are frequently described within the framework of the so-called "system-plus-reservoir" approach. In this work we assign their description to the Maximum Entropy Formalism and compare the resulting thermodynamic…
Motivated by learning of correlated equilibria in non-cooperative games, we perform a large deviations analysis of a regret minimizing stochastic approximation algorithm. The regret minimization algorithm we consider comprises multiple…
We consider a family of positive operator valued measures associated with representations of compact connected Lie groups. For many independent copies of a single state and a tensor power representation we show that the observed probability…
This technical note considers the problem of resource allocation in linear feedback control system with output disturbance. By decomposing the information rate in the feedback communication channel, the channel resource allocation is…
After the justification of the maximum entropy approach for equilibrium thermodynamic system, and of a maximum path entropy algorithm for nonequilibrium thermodynamic systems by virtue of the principle of virtual work, we present in this…
We consider the quasi-deterministic behavior of systems with a large number, $n$, of deterministically interacting constituents. This work extends the results of a previous paper [J. Stat. Phys. 99:1225-1249 (2000)] to include vector-valued…
We show explicitly the entropy reduction from a detailed fluctuation theorem for the general stochastic system driven by nonequilibrium process under feedback control. The effect of interaction of the feedback controller with the system is…
The meaning of thermodynamic descriptions is found in large-deviations scaling of the fluctuations probabilities. The primary large-deviations rate function is the entropy, which is the basis for both fluctuation theorems and for…
An information-theoretic framework is introduced to analyze last-layer embedding, focusing on learned representations for regression tasks. We define representation-rate and derive limits on the reliability with which input-output…