English
Related papers

Related papers: Entropy-Rate Selection for Partially Observed Proc…

200 papers

Entropy estimation, due in part to its connection with mutual information, has seen considerable use in the study of time series data including causality detection and information flow. In many cases, the entropy is estimated using…

Statistics Theory · Mathematics 2019-08-06 Alexander L Young , David B Dunson

We consider the problem of estimating a probability distribution that maximizes the entropy while satisfying a finite number of moment constraints, possibly corrupted by noise. Based on duality of convex programming, we present a novel…

Optimization and Control · Mathematics 2019-10-22 Tobias Sutter , David Sutter , Peyman Mohajerin Esfahani , John Lygeros

We investigate the maximum caliber variational principle as an inference algorithm used to predict dynamical properties of complex nonequilibrium, stationary, statistical systems in the presence of incomplete information. Specifically, we…

Statistical Mechanics · Physics 2016-12-28 Carlo Cafaro , Sean Alan Ali

When designing optimal controllers for any system, it is often the case that the true state of the system is unknown to the controller, for example due to noisy measurements or partially observable states. Incomplete state information must…

Optimization and Control · Mathematics 2014-01-23 Kendra Lesser , Meeko Oishi

Many networked systems such as electric networks, the brain, and social networks of opinion dynamics are known to obey conservation laws. Examples of this phenomenon include the Kirchoff laws in electric networks and opinion consensus in…

Machine Learning · Statistics 2022-06-16 Anirudh Rayas , Rajasekhar Anguluri , Gautam Dasarathy

Reactive (memoryless) policies are sufficient in completely observable Markov decision processes (MDPs), but some kind of memory is usually necessary for optimal control of a partially observable MDP. Policies with finite memory can be…

Artificial Intelligence · Computer Science 2013-01-30 Nicolas Meuleau , Leonid Peshkin , Kee-Eung Kim , Leslie Pack Kaelbling

We apply the Principle of Maximum Entropy to the study of a general class of deterministic fractal sets. The scaling laws peculiar to these objects are accounted for by means of a constraint concerning the average content of information in…

Statistical Mechanics · Physics 2015-06-25 R. Pastor-Satorras , J. Wagensberg

Maximum entropy principle identifies forces conjugated to observables and the thermodynamic relations between them, independent upon their underlying mechanistic details. For data about state distributions or transition statistics, the…

Statistical Mechanics · Physics 2023-12-08 Ying-Jen Yang , Hong Qian

During a spontaneous change, a macroscopic physical system will evolve towards a macro-state with more realizations. This observation is at the basis of the Statistical Mechanical version of the Second Law of Thermodynamics, and it provides…

Statistical Mechanics · Physics 2020-04-22 Mengjie Zu , Arunkumar Bupathy , Daan Frenkel , Srikanth Sastry

In this paper we revisit the classical method of partitioning classification and study its convergence rate under relaxed conditions, both for observable (non-privatised) and for privatised data. We consider the problem of classification in…

Machine Learning · Statistics 2025-09-09 Balázs Csanád Csáji , László Györfi , Ambrus Tamás , Harro Walk

Motivated by applications of statistical mechanics in which the system of interest is spatially unconfined, we present an exact solution to the maximum entropy problem for assigning a stationary probability distribution on the phase space…

Statistical Mechanics · Physics 2021-12-17 Bruno Arderucio Costa , Pedro Pessoa

The introduced entropy functional's (EF) information measure of random process integrates multiple information contributions along the process trajectories, evaluating both the states' and between states' bound information connections. This…

Adaptation and Self-Organizing Systems · Physics 2014-06-04 Vladimir S. Lerner

This paper deals with a parametrized family of partially observed bivariate Markov chains. We establish that, under very mild assumptions, the limit of the normalized log-likelihood function is maximized when the parameters belong to the…

Statistics Theory · Mathematics 2015-10-01 Randal Douc , Francois Roueff , Tepmony Sim

A well-known result across information theory, machine learning, and statistical physics shows that the maximum entropy distribution under a mean constraint has an exponential form called the Gibbs-Boltzmann distribution. This is used for…

Machine Learning · Computer Science 2020-06-26 Amir R. Asadi , Emmanuel Abbe

The entropy regularization is inspired by information entropy from machine learning and the ideas of exploration and exploitation in reinforcement learning, which appears in the control problem to design an approximating algorithm for the…

Optimization and Control · Mathematics 2024-11-21 Ziyue Chen , Qi Zhang

We derive a novel chain rule for a family of channel conditional entropies, covering von Neumann and sandwiched R\'{e}nyi entropies. In the process, we show that these channel conditional entropies are equal to their regularized version,…

Quantum Physics · Physics 2025-07-29 Amir Arqand , Ernest Y. -Z. Tan

The first aims of this work are to endorse the advent of finitely additive set functions as equilibrium states and the possibility to replace the metric entropy by an upper semi-continuous map associated to a general variational principle.…

Dynamical Systems · Mathematics 2022-04-07 Andrzej Bis , Maria Carvalho , Miguel Mendes , Paulo Varandas

This chapter provides a comprehensive and self-contained discussion of the most recent developments of information theory of networks. Maximum entropy models of networks are the least biased ensembles enforcing a set of constraints and are…

Disordered Systems and Neural Networks · Physics 2022-06-14 Ginestra Bianconi

We provide a new algorithm for solving Risk Sensitive Partially Observable Markov Decisions Processes, when the risk is modeled by a utility function, and both the state space and the space of observations is finite. This algorithm is based…

Optimization and Control · Mathematics 2022-07-19 Arsham Afsardeir , Andreas Kapetanis , Vaios Laschos , Klaus Obermayer

Quantum many-body states that frequently appear in physics often obey an entropy scaling law, meaning that an entanglement entropy of a subsystem can be expressed as a sum of terms that scale linearly with its volume and area, plus a…

Quantum Physics · Physics 2021-05-26 Isaac H. Kim