English

Entropic criterion for model selection

Statistical Mechanics 2007-05-23 v1

Abstract

Model or variable selection is usually achieved through ranking models according to the increasing order of preference. One of methods is applying Kullback-Leibler distance or relative entropy as a selection criterion. Yet that will raise two questions, why uses this criterion and are there any other criteria. Besides, conventional approaches require a reference prior, which is usually difficult to get. Following the logic of inductive inference proposed by Caticha, we show relative entropy to be a unique criterion, which requires no prior information and can be applied to different fields. We examine this criterion by considering a physical problem, simple fluids, and results are promising.

Keywords

Cite

@article{arxiv.cond-mat/0604027,
  title  = {Entropic criterion for model selection},
  author = {Chih-Yuan Tseng},
  journal= {arXiv preprint arXiv:cond-mat/0604027},
  year   = {2007}
}

Comments

10 pages. Accepted for publication in Physica A, 2006