English
Related papers

Related papers: Using Relative Entropy to Find Optimal Approximati…

200 papers

Microscopy research often requires recovering particle-size distributions in three dimensions from only a few (10 - 200) profile measurements in the section. This problem is especially relevant for petrographic and mineralogical studies,…

Methodology · Statistics 2022-02-16 Ekaterina Poliakova

Perfect fluid spheres, both Newtonian and relativistic, have attracted considerable attention as the first step in developing realistic stellar models (or models for fluid planets). Whereas there have been some early hints on how one might…

General Relativity and Quantum Cosmology · Physics 2009-11-10 Damien Martin , Matt Visser

We consider the problem of estimating the population probability distribution given a finite set of multivariate samples, using the maximum entropy approach. In strict keeping with Jaynes' original definition, our precise formulation of the…

Data Analysis, Statistics and Probability · Physics 2007-07-13 Sabbir Rahman , Mahbub Majumdar

Using the recently developed ``Maximum Entropy'' (or ``least biased'') distribution function to truncate the moment hierarchy arising from kinetic theory, we formulate a far-from-equilibrium macroscopic theory that provides the possibility…

High Energy Physics - Phenomenology · Physics 2023-08-03 Chandrodoy Chattopadhyay , Ulrich Heinz , Thomas Schaefer

The principle of maximum entropy is a broadly applicable technique for computing a distribution with the least amount of information possible constrained to match empirical data, for instance, feature expectations. We seek to generalize…

Information Theory · Computer Science 2022-05-30 Kenneth Bogert

The stability of the equilibrium state is one of the crucial tests a hydrodynamic theory needs to pass. A widespread technique to study this property consists of searching for a Lyapunov function of the linearised theory, in the form of a…

General Relativity and Quantum Cosmology · Physics 2021-09-30 Lorenzo Gavassino

We exploit the idea to use the maximal-entropy method, successfully tested in information theory and statistical thermodynamics, to determine approximating function's coefficients and squared errors' weights simultaneously as output of one…

Numerical Analysis · Mathematics 2021-03-04 Domenico Giordano , Felice Iavernaro

In this paper we study the problem of computing max-entropy distributions over a discrete set of objects subject to observed marginals. Interest in such distributions arises due to their applicability in areas such as statistical physics,…

Data Structures and Algorithms · Computer Science 2013-05-02 Mohit Singh , Nisheeth K. Vishnoi

The optimized random phase approximation (ORPA) for classical liquids is re-examined in the framework of the generating functional approach to the integral equations. We show that the two main variants of the approximation correspond to the…

Chemical Physics · Physics 2009-10-30 G. Pastore , O. Akinlade , F. Matthews , Z. Badirkhan

We consider a self-gravitating system consisting of perfect fluid with spherical symmetry. Using the general expression of entropy density, we extremize the total entropy $S$ under the constraint that the total number of particles is fixed.…

General Relativity and Quantum Cosmology · Physics 2015-05-30 Sijie Gao

We consider the problem of estimating a probability distribution that maximizes the entropy while satisfying a finite number of moment constraints, possibly corrupted by noise. Based on duality of convex programming, we present a novel…

Optimization and Control · Mathematics 2019-10-22 Tobias Sutter , David Sutter , Peyman Mohajerin Esfahani , John Lygeros

The quantization problem aims to find the best possible approximation of probability measures on ${\mathbb{R}}^d$ using finite, discrete measures. The Wasserstein distance is a typical choice to measure the quality of the approximation.…

Probability · Mathematics 2023-09-11 Rajmadan Lakshmanan , Alois Pichler

We present a technique for entropy optimization to calculate a distribution from its moments. The technique is based upon maximizing a discretized form of the Shannon entropy functional by mapping the problem onto a dual space where an…

Disordered Systems and Neural Networks · Physics 2009-11-10 K. Bandyopadhyay , A. K. Bhattacharya , Parthapratim Biswas , D. A. Drabold

We study the existing algorithms that solve the multidimensional martingale optimal transport. Then we provide a new algorithm based on entropic regularization and Newton's method. Then we provide theoretical convergence rate results and we…

Probability · Mathematics 2018-12-31 Hadrien De March

The montecarlo method, which is quite commonly used to solve maximum entropy problems in statistical physics, can actually be used to solve inverse problems in a much wider context. The probability distribution which maximizes entropy can…

Statistical Mechanics · Physics 2007-05-23 Jan Naudts

This paper studies best finitely supported approximations of one-dimensional probability measures with respect to the $L^r$-Kantorovich (or transport) distance, where either the locations or the weights of the approximations' atoms are…

Probability · Mathematics 2019-03-06 Chuang Xu , Arno Berger

Maximum entropy method for analytic continuation is extended by introducing quantum relative entropy. This new method is formulated in terms of matrix-valued functions and therefore invariant under arbitrary unitary transformation of input…

Strongly Correlated Electrons · Physics 2018-11-05 Jae-Hoon Sim , Myung Joon Han

The quantum relative entropy is a fundamental quantity in quantum information science, characterizing the distinguishability between two quantum states. However, this quantity is not additive in general for correlated quantum states,…

Quantum Physics · Physics 2025-06-05 Kun Fang , Hamza Fawzi , Omar Fawzi

Calibration methods have been widely studied in survey sampling over the last decades. Viewing calibration as an inverse problem, we extend the calibration technique by using a maximum entropy method. Finding the optimal weights is achieved…

Methodology · Statistics 2009-09-23 Fabrice Gamboa , Jean-Michel Loubes , Paul Rochet

The structural properties of single component fluids of hard hyperspheres in odd space dimensionalities $d$ are studied with an analytical approximation method that generalizes the Rational Function Approximation earlier introduced in the…

Statistical Mechanics · Physics 2011-11-10 Rene D. Rohrmann , Andres Santos