English
Related papers

Related papers: Exponential state estimation, entropy and Lyapunov…

200 papers

The principle of maximum entropy is a broadly applicable technique for computing a distribution with the least amount of information possible constrained to match empirical data, for instance, feature expectations. We seek to generalize…

Information Theory · Computer Science 2022-05-30 Kenneth Bogert

Shannon entropy is often a quantity of interest to linguists studying the communicative capacity of human language. However, entropy must typically be estimated from observed data because researchers do not have access to the underlying…

Computation and Language · Computer Science 2022-04-06 Aryaman Arora , Clara Meister , Ryan Cotterell

This paper is concerned with relationships of Lyapunov exponents with sensitivity and stability for non-autonomous discrete systems. Some new concepts are introduced for non-autonomous discrete systems, including Lyapunov exponents, strong…

Dynamical Systems · Mathematics 2016-03-18 Hua Shao , Yuming Shi , Hao Zhu

Entropy is a central concept in physics, but can be challenging to calculate even for systems that are easily simulated. This is exacerbated out of equilibrium, where generally little is known about the distribution characterizing simulated…

Statistical Mechanics · Physics 2024-05-09 Samuel D. Gelman , Guy Cohen

It is supposed that the exponential multiplier in the method of the non-equilibrium statistical operator (Zubarev`s approach) can be considered as a distribution density of the past lifetime of the system, and can be replaced by an…

Statistical Mechanics · Physics 2009-10-26 V. V. Ryazanov

We propose a new way to measure the balance between freedom and coherence in a dynamical system and a new measure of its internal variability. Based on the concept of entropy and ideas from neuroscience and information theory, we define…

Dynamical Systems · Mathematics 2016-11-21 Karl Petersen , Benjamin Wilson

The dependence of the Lyapunov exponent on the closeness parameter, $\epsilon$, in tangent bifurcation systems is investigated. We study and illustrate two averaging procedures for defining Lyapunov exponents in such systems. First, we…

chao-dyn · Physics 2015-06-24 James Hanssen , Walter Wilcox

We study the concentration phenomenon for discrete-time random dynamical systems with an unbounded state space. We develop a heuristic approach towards obtaining exponential concentration inequalities for dynamical systems using an entirely…

Machine Learning · Statistics 2022-12-08 Muhammad Abdullah Naeem , Miroslav Pajic

In this paper we study ergodic optimization problems for subadditive sequences of functions on a topological dynamical system. We prove that for $t\rightarrow \infty$ any accumulation point of a family of equilibrium states is a maximizing…

Dynamical Systems · Mathematics 2020-05-15 Reza Mohammadpour

We study the problem of remote state estimation, in the presence of an eavesdropper. An authorized user estimates the state of a linear plant, based on the data received from a sensor, while the data may also be intercepted by the…

Systems and Control · Computer Science 2016-12-16 Anastasios Tsiamis , Konstantinos Gatsis , George J. Pappas

Chater and MacKay [CM] derived an entropy function of state for exchange economies satisfying a list of axioms, and showed that a change of state of a system of such economies is possible if and only if their total entropy does not…

Mathematical Physics · Physics 2025-10-03 Robert S MacKay

We consider dynamical systems evolving near an equilibrium statistical state where the interest is in modelling long term behavior that is consistent with thermodynamic constraints. We adjust the distribution using an entropy-optimizing…

Fluid Dynamics · Physics 2014-11-25 Keith Myerscough , Jason Frank , Benedict Leimkuhler

We present an analytical-numerical method providing robust upper estimates for the topological entropy or, more generally, uniform volume growth exponents of differentiable mappings. By introducing varying metrics, we simplify the analysis…

Dynamical Systems · Mathematics 2025-03-17 Mikhail Anikushin , Andrey Romanov

The rate of change of entropy $\dot S$ is measured for a system of particles floating on the surface of a fluid maintained in a turbulent steady state. The resulting coagulation of the floaters allows one to relate $\dot S$ to the velocity…

Chaotic Dynamics · Physics 2009-11-11 M. M. Bandi , W. I. Goldburg , J. R. Cressman

We compare an entropy estimator $H_z$ recently discussed in [10] with two estimators $H_1$ and $H_2$ introduced in [6][7]. We prove the identity $H_z \equiv H_1$, which has not been taken into account in [10]. Then, we prove that the…

Data Analysis, Statistics and Probability · Physics 2015-10-23 Thomas Schürmann

The new estimates of the conditional Shannon entropy are introduced in the framework of the model describing a discrete response variable depending on a vector of d factors having a density w.r.t. the Lebesgue measure in R^d. Namely, the…

Statistics Theory · Mathematics 2018-04-25 Alexander Bulinski , Alexey Kozhevin

We consider a generic system composed of a fixed number of particles distributed over a finite number of energy levels. We make only general assumptions about system's properties and the entropy. System's constraints other than fixed number…

Probability · Mathematics 2020-03-12 Tomasz M. Łapiński

An essential quantity in quantum information theory is the von Neumann entropy which depends entirely on the quantum density operator. Once known, the density operator reveals the statistics of observables in a quantum process, and the…

Systems and Control · Electrical Eng. & Systems 2023-09-08 Mark Balas , Vinod P. Gehlot , Tristan D. Griffith

We seek an entropy estimator for discrete distributions with fully empirical accuracy bounds. As stated, this goal is infeasible without some prior assumptions on the distribution. We discover that a certain information moment assumption…

Information Theory · Computer Science 2022-12-27 Doron Cohen , Aryeh Kontorovich , Aaron Koolyk , Geoffrey Wolfer

Some microscopic dynamics are also macroscopically irreversible, dissipating energy and producing entropy. For many-particle systems interacting with deterministic thermostats, the rate of thermodynamic entropy dissipated to the environment…

Classical Physics · Physics 2025-01-13 Swetamber Das , Jason R. Green