English

Conditional maximum-entropy method for selecting prior distributions in Bayesian statistics

Statistical Mechanics 2015-03-18 v3 Data Analysis, Statistics and Probability

Abstract

The conditional maximum-entropy method (abbreviated here as C-MaxEnt) is formulated for selecting prior probability distributions in Bayesian statistics for parameter estimation. This method is inspired by a statistical-mechanical approach to systems governed by dynamics with largely-separated time scales and is based on three key concepts: conjugate pairs of variables, dimensionless integration measures with coarse-graining factors and partial maximization of the joint entropy. The method enables one to calculate a prior purely from a likelihood in a simple way. It is shown in particular how it not only yields Jeffreys's rules but also reveals new structures hidden behind them.

Keywords

Cite

@article{arxiv.1409.0228,
  title  = {Conditional maximum-entropy method for selecting prior distributions in Bayesian statistics},
  author = {Sumiyoshi Abe},
  journal= {arXiv preprint arXiv:1409.0228},
  year   = {2015}
}

Comments

17 pages, 1 figure. Published version

R2 v1 2026-06-22T05:44:59.626Z