English
Related papers

Related papers: Nonparametric Maximum Entropy Estimation on Inform…

200 papers

The major problem in information theoretic analysis of neural responses and other biological data is the reliable estimation of entropy--like quantities from small samples. We apply a recently introduced Bayesian entropy estimator to…

Data Analysis, Statistics and Probability · Physics 2009-09-29 Ilya Nemenman , William Bialek , Rob de Ruyter van Steveninck

The principle of maximum entropy is a broadly applicable technique for computing a distribution with the least amount of information possible while constrained to match empirically estimated feature expectations. However, in many real-world…

Machine Learning · Computer Science 2022-08-16 Kenneth Bogert , Yikang Gui , Prashant Doshi

The representations of conditional entropy and conditional mutual information are significant in explaining the unique effects among variables. While previous studies based on conditional contrastive sampling have effectively removed…

Machine Learning · Computer Science 2025-01-07 Keng Hou Leong , Yuxuan Xiu , Wai Kin , Chan

In this paper an alternative approach to statistical mechanics based on the maximum information entropy principle (MaxEnt) is examined, specifically its close relation with the Gibbs method of ensembles. It is shown that the MaxEnt…

Statistical Mechanics · Physics 2016-05-30 Domagoj Kuic

This paper is a review of a particular approach to the method of maximum entropy as a general framework for inference. The discussion emphasizes the pragmatic elements in the derivation. An epistemic notion of information is defined in…

Data Analysis, Statistics and Probability · Physics 2021-08-04 Ariel Caticha

How to find unknown distributions is questioned in many pieces of research. There are several ways to figure them out, but the main question is which acts more reasonably than others. In this paper, we focus on the maximum entropy principle…

Other Statistics · Statistics 2023-07-26 Seyedeh Azadeh Fallah Mortezanejad

Semi-supervised image classification, leveraging pseudo supervision and consistency regularization, has demonstrated remarkable success. However, the ongoing challenge lies in fully exploiting the potential of unlabeled data. To address…

Computer Vision and Pattern Recognition · Computer Science 2024-05-14 Qi Han , Zhibo Tian , Chengwei Xia , Kun Zhan

Recommendations based on behavioral data may be faced with ambiguous statistical evidence. We consider the case of association rules, relevant e.g.~for query and product recommendations. For example: Suppose that a customer belongs to…

Databases · Computer Science 2015-01-12 Rasmus Pagh , Morten Stöckel

Maximum entropy method for analytic continuation is extended by introducing quantum relative entropy. This new method is formulated in terms of matrix-valued functions and therefore invariant under arbitrary unitary transformation of input…

Strongly Correlated Electrons · Physics 2018-11-05 Jae-Hoon Sim , Myung Joon Han

Nature is full of random networks of complex topology describing such apparently disparate systems as biological, economical or informatical ones. Their most characteristic feature is the apparent scale-free character of interconnections…

Condensed Matter · Physics 2007-05-23 G. Wilk , Z. Wlodarczyk

We review with a tutorial scope the information theory foundations of quantum statistical physics. Only a small proportion of the variables that characterize a system at the microscopic scale can be controlled, for both practical and…

Statistical Mechanics · Physics 2007-05-23 R. Balian

The method of optimizing entropy is used to (i) conduct Asymptotic Hypothesis Testing and (ii) determine the particle distribution for which Entropy is maximized. This paper focuses on two related applications of Information Theory:…

Statistics Theory · Mathematics 2016-03-09 Khizar Qureshi

Bayesian optimal experimental design provides a principled framework for selecting experimental settings that maximize obtained information. In this work, we focus on estimating the expected information gain in the setting where the…

Machine Learning · Statistics 2025-10-02 Chuntao Chen , Tapio Helin , Nuutti Hyvönen , Yuya Suzuki

A new nonparametric model of maximum-entropy (MaxEnt) copula density function is proposed, which offers the following advantages: (i) it is valid for mixed random vector. By `mixed' we mean the method works for any combination of discrete…

Statistics Theory · Mathematics 2022-08-23 Subhadeep , Mukhopadhyay

Estimation of mutual information between random variables has become crucial in a range of fields, from physics to neuroscience to finance. Estimating information accurately over a wide range of conditions relies on the development of…

Methodology · Statistics 2018-11-14 Houman Safaai , Arno Onken , Christopher D. Harvey , Stefano Panzeri

Within the task of collaborative filtering two challenges for computing conditional probabilities exist. First, the amount of training data available is typically sparse with respect to the size of the domain. Thus, support for higher-order…

Information Retrieval · Computer Science 2012-07-19 Lawrence Zitnick , Takeo Kanade

Analytic continuation of numerical data obtained in imaginary time or frequency has become an essential part of many branches of quantum computational physics. It is, however, an ill-conditioned procedure and thus a hard numerical problem.…

Strongly Correlated Electrons · Physics 2016-08-18 Dominic Bergeron , A. -M. S. Tremblay

Within network analysis, the analytical maximum entropy framework has been very successful for different tasks as network reconstruction and filtering. In a recent paper, the same framework was used for link-prediction for monopartite…

Maximum entropy principle (MEP) offers an effective and unbiased approach to inferring unknown probability distributions when faced with incomplete information, while neural networks provide the flexibility to learn complex distributions…

Machine Learning · Statistics 2024-12-04 Wuyue Yang , Liangrong Peng , Guojie Li , Liu Hong

We investigate the maximum caliber variational principle as an inference algorithm used to predict dynamical properties of complex nonequilibrium, stationary, statistical systems in the presence of incomplete information. Specifically, we…

Statistical Mechanics · Physics 2016-12-28 Carlo Cafaro , Sean Alan Ali