English
Related papers

Related papers: Maximum Entropy approach to a Mean Field Theory fo…

200 papers

Within the task of collaborative filtering two challenges for computing conditional probabilities exist. First, the amount of training data available is typically sparse with respect to the size of the domain. Thus, support for higher-order…

Information Retrieval · Computer Science 2012-07-19 Lawrence Zitnick , Takeo Kanade

We consider the problem of estimating the population probability distribution given a finite set of multivariate samples, using the maximum entropy approach. In strict keeping with Jaynes' original definition, our precise formulation of the…

Data Analysis, Statistics and Probability · Physics 2007-07-13 Sabbir Rahman , Mahbub Majumdar

The maximum entropy principle (MEP) apparently allows us to derive, or justify, fundamental results of equilibrium statistical mechanics. Because of this, a school of thought considers the MEP as a powerful and elegant way to make…

Statistical Mechanics · Physics 2015-12-09 Gennaro Auletta , Lamberto Rondoni , Angelo Vulpiani

The Maximum Entropy Principle (MEP) is a method that can be used to infer the value of an unknown quantity in a set of probability functions. In this work we review two applications of MEP: one giving a precise inference of the Higgs boson…

High Energy Physics - Phenomenology · Physics 2017-11-02 Alexandre Alves , Alex G. Dias , Roberto da Silva

A brief discussion is given of the traditional version of the Maximum Entropy Method, including a review of some of the criticism that has been made in regard to its use in statistical inference. Motivated by these questions, a modified…

Data Analysis, Statistics and Probability · Physics 2007-09-12 Robert Kariotis

For the purpose of causal inference we employ a stochastic model of the data generating process, utilizing individual propensity probabilities for the treatment, and also individual and counterfactual prognosis probabilities for the…

Methodology · Statistics 2024-07-15 Brian Knaeble , Mehdi Hakim-Hashemi , Mark A. Abramson

The principle of maximum entropy provides a useful method for inferring statistical mechanics models from observations in correlated systems, and is widely used in a variety of fields where accurate data are available. While the assumptions…

Neurons and Cognition · Quantitative Biology 2017-06-02 Ulisse Ferrari , Tomoyuki Obuchi , Thierry Mora

A principle of maximum entropy is proposed in the context of viscous incompressible flow in Eulerian coordinates. The relative entropy functional, defined over the space of $L^2$ divergence-free velocity fields, is maximized relative to…

Fluid Dynamics · Physics 2024-02-23 Gui-Qiang G. Chen , James Glimm , Hamid Said

A formulation of the density functional theory is constructed on the foundations of entropic inference. The theory is introduced as an application of maximum entropy for inhomogeneous fluids in thermal equilibrium. It is shown that entropic…

Statistical Mechanics · Physics 2023-12-29 Ahmad Yousefi , Ariel Caticha

There are two components in this work that allow solutions of the turbulent channel problem: one is the Galilean-transformed Navier-Stokes equation which gives a theoretical expression for the Reynolds stress; and the second the maximum…

Fluid Dynamics · Physics 2019-07-24 T. -W. Lee

It is supposed that the exponential multiplier in the method of the non-equilibrium statistical operator (Zubarev`s approach) can be considered as a distribution density of the past lifetime of the system, and can be replaced by an…

Statistical Mechanics · Physics 2009-10-26 V. V. Ryazanov

The maximum entropy principle (MEP) is one of the most prominent methods to investigate and model complex systems. Despite its popularity, the standard form of the MEP can only generate Boltzmann-Gibbs distributions, which are ill-suited…

Statistical Mechanics · Physics 2022-03-30 Pablo A. Morales , Fernando E. Rosas

By using entropy and entropy production, we calculate the steady flux of some phenomena. The method we use is a competition method, $S_S/\tau+\sigma={\it maximum}$, where $S_S$ is system entropy, $\sigma$ is entropy production and $\tau$ is…

Statistical Mechanics · Physics 2016-07-26 Yong-Jun Zhang

The Maximum Entropy (MaxEnt) technique is applied to the derivation of the Gaussian Dispersion Plume Model as well as to more complex transport phenomena such as the one-dimensional advection equation, the one-dimensional diffusion…

Statistical Mechanics · Physics 2020-10-23 J. A. Secrest , J. M. Conroy , H. G. Miller

Maximum Entropy is a powerful concept that entails a sharp separation between relevant and irrelevant variables. It is typically invoked in inference, once an assumption is made on what the relevant variables are, in order to estimate a…

Statistical Mechanics · Physics 2018-01-09 Luigi Gresele , Matteo Marsili

This chapter concerns "control volume analysis", the standard engineering tool for the analysis of flow systems, and its application to entropy balance calculations. Firstly, the principles of control volume analysis are enunciated and…

Fluid Dynamics · Physics 2014-07-22 Robert K. Niven , Bernd R. Noack

The Principle of Maximum Entropy is a rigorous technique for estimating an unknown distribution given partial information while simultaneously minimizing bias. However, an important requirement for applying the principle is that the…

Information Theory · Computer Science 2026-02-03 Kenneth Bogert , Matthew Kothe

The Maximum Entropy Method (MEM) is a popular data analysis technique based on Bayesian inference, which has found various applications in the research literature. While the MEM itself is well-grounded in statistics, I argue that its…

Data Analysis, Statistics and Probability · Physics 2020-11-03 Alexander Rothkopf

Maximum entropy estimation is of broad interest for inferring properties of systems across many different disciplines. In this work, we significantly extend a technique we previously introduced for estimating the maximum entropy of a set of…

Data Analysis, Statistics and Probability · Physics 2016-01-05 Elliot A. Martin , Jaroslav Hlinka , Alexander Meinke , Filip Děchtěrenko , Jörn Davidsen

Liquid state entropy formulas based on configurational probability distributions are examined for Lennard-Jones fluids across a range temperatures and densities. These formulas are based on expansions of the entropy in series of $n$-body…

Statistical Mechanics · Physics 2023-12-19 Yang Huang , Michael Widom