English
Related papers

Related papers: Entropy, Information, and the Updating of Probabil…

200 papers

We propose a novel estimator of the mutual information between two ordinal vectors $x$ and $y$. Our approach is inductive (as opposed to deductive) in that it depends on the data generating distribution solely through some nonparametric…

Machine Learning · Statistics 2022-04-12 Yves-Laurent Kom Samo

We advocate the use of a notion of entropy that reflects the relative abundances of the symbols in an alphabet, as well as the similarities between them. This concept was originally introduced in theoretical ecology to study the diversity…

Machine Learning · Computer Science 2022-07-12 Jose Gallego-Posada , Ankit Vani , Max Schwarzer , Simon Lacoste-Julien

A central challenge in statistical inference is the presence of confounding variables that may distort observed associations between treatment and outcome. Conventional "causal" methods, grounded in assumptions such as ignorability, exclude…

Methodology · Statistics 2025-09-09 Ellis Scharfenaker , Duncan K. Foley

Herding is a deterministic algorithm used to generate data points that can be regarded as random samples satisfying input moment conditions. The algorithm is based on the complex behavior of a high-dimensional dynamical system and is…

Machine Learning · Statistics 2023-05-10 Hiroshi Yamashita , Hideyuki Suzuki , Kazuyuki Aihara

For the purpose of causal inference we employ a stochastic model of the data generating process, utilizing individual propensity probabilities for the treatment, and also individual and counterfactual prognosis probabilities for the…

Methodology · Statistics 2024-07-15 Brian Knaeble , Mehdi Hakim-Hashemi , Mark A. Abramson

The asymptotic convergence of probability density function (pdf) and convergence of differential entropy are examined for the non-stationary processes that follow the maximum entropy principle (MaxEnt) and maximum entropy production…

Information Theory · Computer Science 2014-01-14 Alexander L. Fradkov , Dmitry S. Shalymov

Maximization of an expensive, unimodal function under random observations has been an important problem in hyperparameter tuning. It features expensive function evaluations (which means small budgets) and a high level of noise. We develop…

Optimization and Control · Mathematics 2023-02-23 Xiaohe Luo , Warren B. Powell

In this review, we examine an extended Bayesian inference method and its relation to biological information processing. We discuss the idea of combining two modes of Bayesian inference. The first is the standard Bayesian inference, which…

Other Statistics · Statistics 2023-07-04 Vasileios Basios , Yukio-Pegio Gunji , Pier-Francesco Moretti

The goal of this paper is to explore the basic Approximate Bayesian Computation (ABC) algorithm via the lens of information theory. ABC is a widely used algorithm in cases where the likelihood of the data is hard to work with or…

Methodology · Statistics 2019-08-14 Konstantinos Spiliopoulos

We present arguments for the formulation of unified approach to different standard continuous inference methods from partial information. It is claimed that an explicit partition of information into a priori (prior knowledge) and a…

Machine Learning · Statistics 2012-12-07 Mark A. Kon , Leszek Plaskota

Traditionally, the MaxEnt workshops start by a tutorial day. This paper summarizes my talk during 2001'th workshop at John Hopkins University. The main idea in this talk is to show how the Bayesian inference can naturally give us all the…

Data Analysis, Statistics and Probability · Physics 2009-11-07 Ali Mohammad-Djafari

Stability selection is a versatile framework for structure estimation and variable selection in high-dimensional setting, primarily grounded in frequentist principles. In this paper, we propose an enhanced methodology that integrates…

Methodology · Statistics 2026-05-05 Mahdi Nouraie , Connor Smith , Samuel Muller

The field of complex networks studies a wide variety of interacting systems by representing them as networks. To understand their properties and mutual relations, the randomisation of network connections is a commonly used tool. However,…

Statistical Mechanics · Physics 2024-10-18 Noam Abadi , Franco Ruzzenenti

Inference and decision making under uncertainty are key processes in every autonomous system and numerous robotic problems. In recent years, the similarities between inference and decision making triggered much work, from developing unified…

Artificial Intelligence · Computer Science 2021-01-06 Elad I. Farhi , Vadim Indelman

Estimation of permutation entropy (PE) using Bayesian statistical methods is presented for systems where the ordinal pattern sampling follows an independent, multinomial distribution. It is demonstrated that the PE posterior distribution is…

Data Analysis, Statistics and Probability · Physics 2022-02-09 Douglas J. Little , Joshua P. Toomey , Deb M. Kane

Various properties of relative entropy have led to its widespread use in information theory. These properties suggest that relative entropy has a role to play in systems that attempt to perform inference in terms of probability…

Artificial Intelligence · Computer Science 2013-04-15 John E. Shore

We prove that information-theoretic maximum entropy (MaxEnt) approach to canonical ensemble is mathematically equivalent to the classic approach of Boltzmann, Gibbs and Darwin-Fowler. The two approaches, however, "interpret" a same…

Statistical Mechanics · Physics 2011-06-01 Hao Ge , Hong Qian

We explore the use of the method of Maximum Entropy (ME) as a technique to generate approximations. In a first use of the ME method the "exact" canonical probability distribution of a fluid is approximated by that of a fluid of hard…

Statistical Mechanics · Physics 2009-11-10 Chih-Yuan Tseng , Ariel Caticha

We can perform inference in Bayesian belief networks by enumerating instantiations with high probability thus approximating the marginals. In this paper, we present a method for determining the fraction of instantiations that has to be…

Artificial Intelligence · Computer Science 2013-02-21 Enrique F. Castillo , Remco R. Bouckaert , Jose M. Sarabia , Cristina Solares

An information-theoretic framework is introduced to analyze last-layer embedding, focusing on learned representations for regression tasks. We define representation-rate and derive limits on the reliability with which input-output…

Information Theory · Computer Science 2026-05-27 Deborah Pereg , Michael Wand