English

Understanding and Designing Complex Systems: Response to "A framework for optimal high-level descriptions in science and engineering---preliminary report"

Statistical Mechanics 2014-12-31 v1 Artificial Intelligence Computational Engineering, Finance, and Science Information Theory math.IT Chaotic Dynamics

Abstract

We recount recent history behind building compact models of nonlinear, complex processes and identifying their relevant macroscopic patterns or "macrostates". We give a synopsis of computational mechanics, predictive rate-distortion theory, and the role of information measures in monitoring model complexity and predictive performance. Computational mechanics provides a method to extract the optimal minimal predictive model for a given process. Rate-distortion theory provides methods for systematically approximating such models. We end by commenting on future prospects for developing a general framework that automatically discovers optimal compact models. As a response to the manuscript cited in the title above, this brief commentary corrects potentially misleading claims about its state space compression method and places it in a broader historical setting.

Keywords

Cite

@article{arxiv.1412.8520,
  title  = {Understanding and Designing Complex Systems: Response to "A framework for optimal high-level descriptions in science and engineering---preliminary report"},
  author = {James P. Crutchfield and Ryan G. James and Sarah Marzen and Dowman P. Varn},
  journal= {arXiv preprint arXiv:1412.8520},
  year   = {2014}
}

Comments

6 pages; http://csc.ucdavis.edu/~cmg/compmech/pubs/ssc_comment.htm

R2 v1 2026-06-22T07:46:32.275Z