English
Related papers

Related papers: Discontinuities in the Maximum-Entropy Inference

200 papers

We consider an extension of the conditional min- and max-entropies to infinite-dimensional separable Hilbert spaces. We show that these satisfy characterizing properties known from the finite-dimensional case, and retain…

Quantum Physics · Physics 2011-09-20 Fabian Furrer , Johan Aberg , Renato Renner

Simplified mechanistic models in ecology have been criticized for the fact that a good fit to data does not imply the mechanism is true: pattern does not equal process. In parallel, the maximum entropy principle (MaxEnt) has been applied in…

Populations and Evolution · Quantitative Biology 2017-05-02 James P. O'Dwyer , Andrew Rominger , Xiao Xiao

The phenomenon of entropy concentration provides strong support for the maximum entropy method, MaxEnt, for inferring a probability vector from information in the form of constraints. Here we extend this phenomenon, in a discrete setting,…

Information Theory · Computer Science 2021-01-11 Kostas N. Oikonomou

A common statistical situation concerns inferring an unknown distribution Q(x) from a known distribution P(y), where X (dimension n), and Y (dimension m) have a known functional relationship. Most commonly, n<m, and the task is relatively…

Quantitative Methods · Quantitative Biology 2016-02-01 Jayajit Das , Sayak Mukherjee , Susan E. Hodge

Maximum entropy principle identifies forces conjugated to observables and the thermodynamic relations between them, independent upon their underlying mechanistic details. For data about state distributions or transition statistics, the…

Statistical Mechanics · Physics 2023-12-08 Ying-Jen Yang , Hong Qian

The ground state energy of a finite-dimensional one-parameter Hamiltonian and the continuity of a maximum-entropy inference map are discussed in the context of quantum critical phenomena. The domain of the inference map is a convex compact…

Mathematical Physics · Physics 2020-01-07 Ilya M. Spitkovsky , Stephan Weis

The maximum entropy principle, as applied to quantum systems, is a fundamental prescript positing that for a quantum system for which we only have partial knowledge, the maximum entropy state consistent with the partial knowledge is a…

Quantum Physics · Physics 2025-07-24 Siddhartha Das , Ujjwal Sen

Quantum systems may contain underlying correlations which are inaccessible to computationally bounded observers. We capture this distinction through a framework that analyses bipartite states only using efficiently implementable quantum…

Quantum Physics · Physics 2026-04-20 Álvaro Yángüez , Noam Avidan , Jan Kochanowski , Thomas A. Hahn

Entropy notions for $\varepsilon$-incremental practical stability and incremental stability of deterministic nonlinear systems under disturbances are introduced. The entropy notions are constructed via a set of points in state space which…

Optimization and Control · Mathematics 2022-09-13 Michelle S. Chong

We study a curve of Gibbsian families of complex 3x3-matrices and point out new features, absent in commutative finite-dimensional algebras: a discontinuous maximum-entropy inference, a discontinuous entropy distance and non-exposed faces…

Mathematical Physics · Physics 2016-05-17 Andreas Knauf , Stephan Weis

Quantum physics, despite its observables being intrinsically of a probabilistic nature, does not have a quantum entropy assigned to them. We propose a quantum entropy that quantify the randomness of a pure quantum state via a conjugate pair…

Quantum Physics · Physics 2022-10-05 Davi Geiger , Zvi M. Kedem

We give an interpretation of the Maximum Entropy (MaxEnt) Principle in game-theoretic terms. Based on this interpretation, we make a formal distinction between different ways of {em applying/} Maximum Entropy distributions. MaxEnt has…

Artificial Intelligence · Computer Science 2013-01-18 Peter D. Grunwald

Indeterminacy associated with probing of a quantum state is commonly expressed through spectral distances (metric) featured in the outcomes of repeated experiments. Here we express it as an effective amount (measure) of distinct outcomes…

Quantum Physics · Physics 2021-09-21 Ivan Horváth

We consider the problem of defining the significance of an itemset. We say that the itemset is significant if we are surprised by its frequency when compared to the frequencies of its sub-itemsets. In other words, we estimate the frequency…

Machine Learning · Computer Science 2019-04-30 Nikolaj Tatti

Inferring models, predicting the future, and estimating the entropy rate of discrete-time, discrete-event processes is well-worn ground. However, a much broader class of discrete-event processes operates in continuous-time. Here, we provide…

Statistical Mechanics · Physics 2020-05-11 S. E. Marzen , J. P. Crutchfield

We derive a measurement-independent asymptotic continuity bound on the observational entropy for general POVM measurements, making essential use of its property of bounded concavity. The same insight is used to obtain continuity bounds for…

Quantum Physics · Physics 2024-09-25 Joseph Schindler , Andreas Winter

The Principle of Maximum Entropy is a rigorous technique for estimating an unknown distribution given partial information while simultaneously minimizing bias. However, an important requirement for applying the principle is that the…

Information Theory · Computer Science 2026-02-03 Kenneth Bogert , Matthew Kothe

We introduce a new information-theoretic formulation of quantum measurement uncertainty relations, based on the notion of relative entropy between measurement probabilities. In the case of a finite-dimensional system and for any approximate…

Mathematical Physics · Physics 2018-03-02 Alberto Barchielli , Matteo Gregoratti , Alessandro Toigo

In this paper, we investigate and compare two well-developed definitions of entropy relevant for describing the dynamics of isolated quantum systems: bipartite entanglement entropy and observational entropy. In a model system of interacting…

Quantum Physics · Physics 2020-06-01 Dana Faiez , Dominik Šafránek , J. M. Deutsch , Anthony Aguirre

Entropies associated with spatial subsystems in conventional local quantum field theories are typically divergent when the spatial regions have boundaries. However, in certain linear combinations of the entropies for various subsystems,…

High Energy Physics - Theory · Physics 2025-09-01 Mark Van Raamsdonk