English
Related papers

Related papers: Markov models of macrosystems

200 papers

The linear response of a dynamical system refers to changes to properties of the system when small external perturbations are applied. We consider the little-studied question of selecting an optimal perturbation so as to (i) maximise the…

Dynamical Systems · Mathematics 2018-04-04 Fadi Antown , Davor Dragičević , Gary Froyland

A general principle is advanced allowing the classification of nonunique solutions to nonlinear evolution equations, corresponding to different spatio-temporal patterns. This is done by defining the probability distribution of patterns,…

Condensed Matter · Physics 2009-11-07 V. I. Yukalov

A general formalism is developed to construct a Markov chain model that converges to a one-dimensional map in the infinite population limit. Stochastic fluctuations are therefore internal to the system and not externally specified. For…

Statistical Mechanics · Physics 2014-09-15 Joseph D. Challenger , Duccio Fanelli , Alan J. McKane

In this paper, we present a novel and general framework called {\it Maximum Entropy Discrimination Markov Networks} (MaxEnDNet), which integrates the max-margin structured learning and Bayesian-style estimation and combines and extends…

Machine Learning · Statistics 2009-12-30 Jun Zhu , Eric P. Xing

Complex network states are characterized by the interplay between system's structure and dynamics. One way to represent such states is by means of network density matrices, whose von Neumann entropy characterizes the number of distinct…

Physics and Society · Physics 2022-12-06 Arsham Ghavasieh , Manlio De Domenico

In an essential and quite general setup, based on networks, we identify Schnakenberg's observables as the constraints that prevent a system from relaxing to equilibrium, showing that, in the linear regime, steady states satisfy a minimum…

Statistical Mechanics · Physics 2015-05-28 Matteo Polettini

In the paper we show that an important class of multistage traffic equillibrium models (including correspondence matrix calculation, traffic assignment problem etc) and their economic generalizations can be considered as proper population…

Optimization and Control · Mathematics 2016-04-19 Alexander Gasnikov

The principle of maximum entropy is a broadly applicable technique for computing a distribution with the least amount of information possible constrained to match empirical data, for instance, feature expectations. We seek to generalize…

Information Theory · Computer Science 2022-05-30 Kenneth Bogert

We describe and develop a close relationship between two problems that have customarily been regarded as distinct: that of maximizing entropy, and that of minimizing worst-case expected loss. Using a formulation grounded in the equilibrium…

Statistics Theory · Mathematics 2007-06-13 Peter D. Grunwald , A. Philip Dawid

Equilibrium is a central concept of statistical mechanics. In previous work we introduced the notions of a Boltzmannian alpha-epsilon-equilibrium and a Boltzmannian gamma-varepsilon-equilibrium (Werndl and Frigg 2015a, 2015b). This was done…

Statistical Mechanics · Physics 2016-07-25 Charlotte Werndl , Roman Frigg

Jaynes' information theory formalism of statistical mechanics is applied to the stationary states of open, non-equilibrium systems. The key result is the construction of the probability distribution for the underlying microscopic phase…

Statistical Mechanics · Physics 2009-10-31 Roderick C. Dewar

The foundations of Statistical Mechanics can be recovered almost in their entirety from the Principle of Maximum Entropy. In this work we show that its non-equilibrium generalization, the Principle of Maximum Caliber (Jaynes, 1980), when…

Data Analysis, Statistics and Probability · Physics 2016-08-01 Diego González , Sergio Davis , Gonzalo Gutiérrez

Recent work emphasizes that the maximum entropy principle provides a bridge between statistical mechanics models for collective behavior in neural networks and experiments on networks of real neurons. Most of this work has focused on…

Neurons and Cognition · Quantitative Biology 2015-06-05 Gasper Tkacik , Olivier Marre , Thierry Mora , Dario Amodei , Michael J. Berry , William Bialek

Economic systems are similar with physic systems for their large number of individuals and the exist of equilibrium. In this paper, we present a model applying the equilibrium statistical model in economic systems. Consistent with…

General Finance · Quantitative Finance 2015-04-17 Zhiwu Zheng

Depending on context, the term entropy is used for a thermodynamic quantity, a~measure of available choice, a quantity to measure information, or, in the context of statistical inference, a maximum configuration predictor. For systems in…

Statistical Mechanics · Physics 2018-11-14 Rudolf Hanel , Stefan Thurner

We consider the boundary driven harmonic model, i.e. the Markov process associated to the open integrable XXX chain with non-compact spins. Using the factorial moments we characterize the stationary measure as a mixture of product measures.…

Probability · Mathematics 2023-10-04 Gioia Carinci , Chiara Franceschini , Rouven Frassek , Cristian Giardinà , Frank Redig

Information theory provides shortcuts which allow one to deal with complex systems. The basic idea one uses for this purpose is the maximum entropy principle developed by Jaynes. However, an extension of this maximum entropy principle to…

General Physics · Physics 2014-07-23 P. Fielitz , G. Borchardt

The paper introduces the first formulation of convex Q-learning for Markov decision processes with function approximation. The algorithms and theory rest on a relaxation of a dual of Manne's celebrated linear programming characterization of…

Optimization and Control · Mathematics 2023-09-12 Fan Lu , Sean Meyn

We derive various exact results for Markovian systems that spontaneously relax to a non-equilibrium steady-state by using joint probability distributions symmetries of different entropy production decompositions. The analytical approach is…

Statistical Mechanics · Physics 2012-02-10 Reinaldo García-García , Vivien Lecomte , A. B. Kolton , D. Domínguez

We give some results relating asymptotic characterisations of maximum entropy probability measures to characterisations of Bayes optimal classifiers. Our main theorems show that maximum entropy is a universally Bayes optimal decision rule…

Statistics Theory · Mathematics 2025-07-08 Dalton A R Sakthivadivel