English
Related papers

Related papers: Maximum information entropy principle and the inte…

200 papers

Superstatistics describes nonequilibrium steady states as superpositions of canonical ensembles with a probability distribution of temperatures. Rather than assume a certain distribution of temperature, recently [J. Phys. A: Math. Theor.…

Statistical Mechanics · Physics 2020-10-28 Sergio Davis

Convex operational models (COMs) are considered as great extrapolations to larger settings of any statistical theory. In this article we generalize the maximum entropy principle (MaxEnt) of Jaynes' to any COM. After expressing Max-Ent in a…

Quantum Physics · Physics 2016-11-25 Federico Holik , Angel Plastino

The maximum entropy technique (MENT) is used to determine the distribution functions of physical values. MENT naturally combines required maximum entropy, the properties of a system and connection conditions in the form of restrictions…

High Energy Physics - Experiment · Physics 2007-05-23 B. Z. Belashev , M. K. Suleymanov

When an informationally complete measurement is not available, the reconstruction of the density operator that describes the state of a quantum system can be accomplish, in a reliable way, by adopting the maximum entropy principle (MaxEnt…

Quantum Physics · Physics 2022-03-16 Diego Tielas , Marcelo Losada , Lorena Rebón , Federico Holik

Although compartmental dynamical systems are used in many different areas of science, model selection based on the maximum entropy principle (MaxEnt) is challenging because of the lack of methods for quantifying the entropy for this type of…

Information Theory · Computer Science 2023-08-23 Holger Metzler , Carlos A. Sierra

MaxEnt inference algorithm and information theory are relevant for the time evolution of macroscopic systems considered as problem of incomplete information. Two different MaxEnt approaches are introduced in this work, both applied to…

Statistical Mechanics · Physics 2012-02-21 Domagoj Kuic , Pasko Zupanovic , Davor Juretic

The principle of maximum entropy provides a useful method for inferring statistical mechanics models from observations in correlated systems, and is widely used in a variety of fields where accurate data are available. While the assumptions…

Neurons and Cognition · Quantitative Biology 2017-06-02 Ulisse Ferrari , Tomoyuki Obuchi , Thierry Mora

Maximum entropy principle identifies forces conjugated to observables and the thermodynamic relations between them, independent upon their underlying mechanistic details. For data about state distributions or transition statistics, the…

Statistical Mechanics · Physics 2023-12-08 Ying-Jen Yang , Hong Qian

The principle of maximum entropy is applied to the spectral analysis of a data signal with general variance matrix and containing gaps in the record. The role of the entropic regularizer is to prevent one from overestimating structure in…

Data Analysis, Statistics and Probability · Physics 2012-02-16 Robert W. Johnson

We investigate the maximum caliber variational principle as an inference algorithm used to predict dynamical properties of complex nonequilibrium, stationary, statistical systems in the presence of incomplete information. Specifically, we…

Statistical Mechanics · Physics 2016-12-28 Carlo Cafaro , Sean Alan Ali

The entropy maximum approach (Maxent) was developed as a minimization of the subjective uncertainty measured by the Boltzmann--Gibbs--Shannon entropy. Many new entropies have been invented in the second half of the 20th century. Now there…

Data Analysis, Statistics and Probability · Physics 2013-11-07 A. N. Gorban

In this work we develop on the recently suggested concept of superstatistics [C. Beck and E.G.D. Cohen, Physica A {\bf 322}, 267 (2003)], face the problem of devising a viable way for estimating the correct statistics for a system in…

Statistical Mechanics · Physics 2007-05-23 F. Sattin

Probabilistic reasoning systems combine different probabilistic rules and probabilistic facts to arrive at the desired probability values of consequences. In this paper we describe the MESA-algorithm (Maximum Entropy by Simulated Annealing)…

Artificial Intelligence · Computer Science 2013-03-25 Gerhard Paaß

The extended gaussian ensemble (EGE) is introduced as a generalization of the canonical ensemble. The new ensemble is a further extension of the Gaussian ensemble introduced by J. H. Hetherington [J. Low Temp. Phys. {\bf 66}, 145 (1987)].…

Statistical Mechanics · Physics 2009-11-10 Ramandeep S. Johal , Antoni Planes , Eduard Vives

The problem of assigning probability distributions which objectively reflect the prior information available about experiments is one of the major stumbling blocks in the use of Bayesian methods of data analysis. In this paper the method of…

Data Analysis, Statistics and Probability · Physics 2009-11-10 Ariel Caticha , Roland Preuss

Depending on context, the term entropy is used for a thermodynamic quantity, a~measure of available choice, a quantity to measure information, or, in the context of statistical inference, a maximum configuration predictor. For systems in…

Statistical Mechanics · Physics 2018-11-14 Rudolf Hanel , Stefan Thurner

We present a novel derivation of the constraints required to obtain the underlying principles of statistical mechanics using a maximum entropy framework. We derive the mean value constraints by use of the central limit theorem and the…

Statistical Mechanics · Physics 2017-03-30 Diego Granziol , Stephen Roberts

It is supposed that the exponential multiplier in the method of the non-equilibrium statistical operator (Zubarev`s approach) can be considered as a distribution density of the past lifetime of the system, and can be replaced by an…

Statistical Mechanics · Physics 2009-10-26 V. V. Ryazanov

Maximum entropy principle (MEP) offers an effective and unbiased approach to inferring unknown probability distributions when faced with incomplete information, while neural networks provide the flexibility to learn complex distributions…

Machine Learning · Statistics 2024-12-04 Wuyue Yang , Liangrong Peng , Guojie Li , Liu Hong

The Boltzmann-Wallis-Jaynes' multiplicity argument is taken up and elaborated. MaxEnt is proved and demonstrated to be just an asymptotic case of looking for such a vector of absolute frequencies in a feasible set, which has maximal…

Mathematical Physics · Physics 2015-06-26 Marian Grendar , Marian Grendar