English
Related papers

Related papers: Generalized Entropy Concentration for Counts

200 papers

We introduce a new generalization of relative entropy to non-negative vectors with sums $\gt 1$. We show in a purely combinatorial setting, with no probabilistic considerations, that in the presence of linear constraints defining a convex…

Information Theory · Computer Science 2024-05-08 Kostas N. Oikonomou

In most data-scientific approaches, the principle of Maximum Entropy (MaxEnt) is used to a posteriori justify some parametric model which has been already chosen based on experience, prior knowledge or computational simplicity. In a…

Methodology · Statistics 2022-06-29 Orestis Loukas , Ho Ryun Chung

Consider the set of all sequences of $n$ outcomes, each taking one of $m$ values, that satisfy a number of linear constraints. If $m$ is fixed while $n$ increases, most sequences that satisfy the constraints result in frequency vectors…

Information Theory · Computer Science 2016-11-18 Kostas N. Oikonomou , Peter D. Grunwald

Ill-posed inverse problems of the form y = X p where y is J-dimensional vector of a data, p is m-dimensional probability vector which cannot be measured directly and matrix X of observable variables is a known J,m matrix, J < m, are…

Mathematical Physics · Physics 2012-08-27 M. Grendar, , M. Grendar

We discuss how the method of maximum entropy, MaxEnt, can be extended beyond its original scope, as a rule to assign a probability distribution, to a full-fledged method for inductive inference. The main concept is the (relative) entropy…

Data Analysis, Statistics and Probability · Physics 2009-11-10 Ariel Caticha

A broad set of sufficient conditions that guarantees the existence of the maximum entropy (maxent) distribution consistent with specified bounds on certain generalized moments is derived. Most results in the literature are either focused on…

Information Theory · Computer Science 2009-09-29 Prakash Ishwar , Pierre Moulin

Maximum entropy (MAXENT) method has a large number of applications in theoretical and applied machine learning, since it provides a convenient non-parametric tool for estimating unknown probabilities. The method is a major contribution of…

Data Analysis, Statistics and Probability · Physics 2020-12-18 A. E. Allahverdyan , N. H. Martirosyan

We construct the generalized entropy optimized by a given arbitrary statistical distribution with a finite linear expectation value of a random quantity of interest. This offers, via the maximum entropy principle, a unified basis for a…

Statistical Mechanics · Physics 2009-11-07 Sumiyoshi Abe

The method of maximum entropy is quite a powerful tool to solve the generalized moment problem, which consists of determining the probability density of a random variable X from the knowledge of the expected values of a few functions of the…

Statistics Theory · Mathematics 2015-10-15 Henryk Gzyl

The principle of maximum entropy is a broadly applicable technique for computing a distribution with the least amount of information possible constrained to match empirical data, for instance, feature expectations. We seek to generalize…

Information Theory · Computer Science 2022-05-30 Kenneth Bogert

Simplified mechanistic models in ecology have been criticized for the fact that a good fit to data does not imply the mechanism is true: pattern does not equal process. In parallel, the maximum entropy principle (MaxEnt) has been applied in…

Populations and Evolution · Quantitative Biology 2017-05-02 James P. O'Dwyer , Andrew Rominger , Xiao Xiao

We study an entropy measure for quantum systems that generalizes the von Neumann entropy as well as its classical counterpart, the Gibbs or Shannon entropy. The entropy measure is based on hypothesis testing and has an elegant formulation…

Quantum Physics · Physics 2014-02-19 F. Dupuis , L. Kraemer , P. Faist , J. M. Renes , R. Renner

A common statistical situation concerns inferring an unknown distribution Q(x) from a known distribution P(y), where X (dimension n), and Y (dimension m) have a known functional relationship. Most commonly, n<m, and the task is relatively…

Quantitative Methods · Quantitative Biology 2016-02-01 Jayajit Das , Sayak Mukherjee , Susan E. Hodge

The principle of maximum entropy is applied to the spectral analysis of a data signal with general variance matrix and containing gaps in the record. The role of the entropic regularizer is to prevent one from overestimating structure in…

Data Analysis, Statistics and Probability · Physics 2012-02-16 Robert W. Johnson

We describe a maximum entropy approach for computing volumes and counting integer points in polyhedra. To estimate the number of points from a particular set X in R^n in a polyhedron P in R^n, by solving a certain entropy maximization…

Combinatorics · Mathematics 2009-07-15 Alexander Barvinok , John Hartigan

The method of maximum entropy (ME) is extended to address the following problem: Once one accepts that the ME distribution is to be preferred over all others, the question is to what extent are distributions with lower entropy supposed to…

Mathematical Physics · Physics 2009-10-31 Ariel Caticha

Entropy serves as a central observable which indicates uncertainty in many chemical, thermodynamical, biological and ecological systems, and the principle of the maximum entropy (MaxEnt) is widely supported in natural science. Recently,…

Physics and Society · Physics 2015-06-03 Bin Xu , Hongen Zhang , Zhijian Wang , Jianbo Zhang

We revisit the classical problem of inverting dimension-reducing linear mappings using the maximum entropy (MaxEnt) criterion. In the literature, solutions are problem-dependent, inconsistent, and use different entropy measures. We propose…

Machine Learning · Computer Science 2024-07-22 Paul M Baggenstoss

Traditionally, the Method of (Shannon-Kullback's) Relative Entropy Maximization (REM) is considered with linear moment constraints. In this work, the method is studied under frequency moment constraints which are non-linear in…

Data Analysis, Statistics and Probability · Physics 2012-08-27 M. Grendar, , M. Grendar

The maximum entropy principle advocates to evaluate events' probabilities using a distribution that maximizes entropy among those that satisfy certain expectations' constraints. Such principle can be generalized for arbitrary decision…

Machine Learning · Statistics 2021-12-16 Santiago Mazuelas , Yuan Shen , Aritz Pérez
‹ Prev 1 2 3 10 Next ›