English
Related papers

Related papers: Macroscopic time evolution and MaxEnt inference fo…

200 papers

We propose a new variational quantum algorithm, which we refer to as TIMES-ADAPT, that prepares time-evolved states in a low-energy or symmetric subspace of a time-independent Hamiltonian on a quantum computer. Using a specially trained…

Prompted by the realisation that the statistical entropy of an ideal gas in the micro-canonical ensemble should not fluctuate or change over time, the meaning of the H-theorem is re-interpreted from the perspective of information theory in…

General Physics · Physics 2013-01-09 David Sands , Jeremy Dunning-Davies

We consider a chain of spin-half particles of a finite length, evolved with the mixed-field Ising Hamiltonian and impose open boundary condition. We simulate the time evolution of entanglement entropy and mutual information following quench…

Statistical Mechanics · Physics 2024-02-22 Surbhi Khetrapal , Emil Tore Mærsk Pedersen

By fixing a reference frame in spacetime, it is possible to split the Euler-Lagrange equations associated with a degenerate Lagrangian into purely evolutionary equations and constraints on the allowed Cauchy data with respect to the notion…

Mathematical Physics · Physics 2019-11-14 Florio M. Ciaglia , Fabio Di Cosmo , Giuseppe Marmo , Luca Schiavone

We propose a unified framework that extends the inference methods for classical hidden Markov models to continuous settings, where both the hidden states and observations occur in continuous time. Two different settings are analyzed: hidden…

Methodology · Statistics 2021-06-18 Qingcan Wang , Weinan E

By applying the holographic principle that comes from black hole physics and information entropy (Sient) introduced by Claude Shannon, we derive the mechanism of similar patterns or tendencies appearing in evolution processes of different…

Statistical Mechanics · Physics 2023-02-07 Lina Wang

We propose a novel approach to intrinsic decoherence without adding new assumptions to standard Quantum Mechanics. We generalize the Liouville equation just by requiring the dynamical semigroup property of time evolution and dropping the…

Quantum Physics · Physics 2015-06-26 Rodolfo Bonifacio

Algorithmic entropy and Shannon entropy are two conceptually different information measures, as the former is based on size of programs and the later in probability distributions. However, it is known that, for any recursive probability…

Information Theory · Computer Science 2010-06-03 Andreia Teixeira , Andre Souto , Armando Matos , Luis Antunes

We consider the computability of entropy and information in classical Hamiltonian systems. We define the information part and total information capacity part of entropy in classical Hamiltonian systems using relative information under a…

Statistical Mechanics · Physics 2009-03-22 Sungyun Kim

We show that maximum entropy (maxent) models can be modeled with certain kinds of HMMs, allowing us to construct maxent models with hidden variables, hidden state sequences, or other characteristics. The models can be trained using the…

Artificial Intelligence · Computer Science 2013-01-07 Joshua Goodman

Maximum entropy method is a constructive criterion for setting up a probability distribution maximally non-committal to missing information on the basis of partial knowledge, usually stated as constrains on expectation values of some…

Statistical Mechanics · Physics 2015-07-20 Jorge Fernandez-de-Cossio , Jorge Fernandez-de-Cossio Diaz

We develop a resonance theory to describe the evolution of open systems with time-dependent dynamics. Our approach is based on piecewise constant Hamiltonians: we represent the evolution on each constant bit using a recently developed…

Mathematical Physics · Physics 2011-08-25 Marco Merkli , Shannon Starr

In this paper we present a data-driven approach for uncertainty propagation. In particular, we consider stochastic differential equations with parametric uncertainty. Solution of the differential equation is approximated using maximum…

Numerical Analysis · Mathematics 2020-04-07 Vedang M. Deshpande , Raktim Bhattacharya

In this paper, we consider contention resolution algorithms that are augmented with predictions about the network. We begin by studying the natural setup in which the algorithm is provided a distribution defined over the possible network…

Distributed, Parallel, and Cluster Computing · Computer Science 2021-05-27 Seth Gilbert , Calvin Newport , Nitin Vaidya , Alex Weaver

Jaynes' maximum entropy (MaxEnt) principle was recently used to give a conditional, local derivation of the ``maximum entropy production'' (MEP) principle, which states that a flow system with fixed flow(s) or gradient(s) will converge to a…

Fluid Dynamics · Physics 2015-05-13 Robert K. Niven

The irreversibility of trajectories in stochastic dynamical systems is linked to the structure of their causal representation in terms of Bayesian networks. We consider stochastic maps resulting from a time discretization with interval \tau…

Data Analysis, Statistics and Probability · Physics 2018-03-15 Andrea Auconi , Andrea Giansanti , Edda Klipp

The asymptotic convergence of probability density function (pdf) and convergence of differential entropy are examined for the non-stationary processes that follow the maximum entropy principle (MaxEnt) and maximum entropy production…

Information Theory · Computer Science 2014-01-14 Alexander L. Fradkov , Dmitry S. Shalymov

This paper modifies Jaynes's axioms of plausible reasoning and derives the minimum relative entropy principle, Bayes's rule, as well as maximum likelihood from first principles. The new axioms, which I call the Optimum Information…

Information Theory · Computer Science 2011-03-30 Alexis Akira Toda

We address the fundamental limits of learning unknown parameters of any stochastic process from time-series data, and discover exact closed-form expressions for how optimal inference scales with observation length. Given a parametrized…

Machine Learning · Computer Science 2023-10-09 Paul M. Riechers

Maximization of the path information entropy is a clear prescription for constructing models in non-equilibrium statistical mechanics. Here it is shown that, following this prescription under the assumption of arbitrary instantaneous…

Data Analysis, Statistics and Probability · Physics 2016-08-01 Sergio Davis , Diego González