English
Related papers

Related papers: On the map-territory fallacy fallacy

200 papers

In most data-scientific approaches, the principle of Maximum Entropy (MaxEnt) is used to a posteriori justify some parametric model which has been already chosen based on experience, prior knowledge or computational simplicity. In a…

Methodology · Statistics 2022-06-29 Orestis Loukas , Ho Ryun Chung

The Free Energy Principle (FEP) states that self-organizing systems must minimize variational free energy to persist, but the path from principle to implementable algorithm has remained unclear. We present a constructive proof that the FEP…

Neural and Evolutionary Computing · Computer Science 2025-10-22 Michael James McCulloch

This paper presents a model of consciousness that follows directly from the free-energy principle (FEP). We first rehearse the classical and quantum formulations of the FEP. In particular, we consider the inner screen hypothesis that…

Neurons and Cognition · Quantitative Biology 2024-01-03 Maxwell J. D. Ramstead , Mahault Albarracin , Alex Kiefer , Brennan Klein , Chris Fields , Karl Friston , Adam Safron

We study the sign problem in lattice field theory with a $\theta$ term. We apply the maximum entropy method (MEM) to flattening phenomenon of the free energy density $f(\theta)$, which originates from the sign problem. In our previous…

High Energy Physics - Lattice · Physics 2009-09-29 Masahiro Imachi , Yasuhiko Shinno , Hiroshi Yoneyama

The Targeted Free Energy Perturbation (TFEP) method aims to overcome the time-consuming and computer-intensive stratification process of standard methods for estimating the free energy difference between two states. To achieve this, TFEP…

Chemical Physics · Physics 2023-02-24 Soo Jung Lee , Amr H. Mahmoud , Markus A. Lill

The method of effective field theories (EFTs) is developed for the scattering of two particles at wavelengths which are large compared to the range of their interaction. It is shown that the renormalized EFT is equivalent to the effective…

Nuclear Theory · Physics 2008-11-26 U. van Kolck

In the last decade, the free energy principle (FEP) and active inference (AIF) have achieved many successes connecting conceptual models of learning and cognition to mathematical models of perception and action. This effort is driven by a…

Artificial Intelligence · Computer Science 2024-11-25 Joséphine Pazem , Marius Krumm , Alexander Q. Vining , Lukas J. Fiderer , Hans J. Briegel

Based on a generative model (GM) and beliefs over hidden states, the free energy principle (FEP) enables an agent to sense and act by minimizing a free energy bound on Bayesian surprise. Inclusion of prior beliefs in the GM about desired…

Systems and Control · Electrical Eng. & Systems 2021-07-28 Thijs van de Laar , Ayça Özçelikkale , Henk Wymeersch

In this paper we show how The Free Energy Principle (FEP) can provide an explanation for why real-world networks deviate from scale-free behaviour, and how these characteristic deviations can emerge from constraints on information…

Social and Information Networks · Computer Science 2025-02-19 Peter R Williams , Zhan Chen

In this paper, a simple case of Bayesian mechanics under the free energy principle is formulated in axiomatic terms. We argue that any dynamical system with constraints on its dynamics necessarily looks as though it is performing inference…

Mathematical Physics · Physics 2022-04-27 Dalton A R Sakthivadivel

We introduce the concept of self-energy dispersion as an error bound on local theories and apply it to the two-dimensional Hubbard model on the square lattice at half-filling. Since the self-energy has no single-particle analog and is not…

Strongly Correlated Electrons · Physics 2018-12-12 Thomas Mertz , Karim Zantout , Roser Valenti

Deep learning has revolutionised artificial intelligence (AI) by enabling automatic feature extraction and function approximation from raw data. However, it faces challenges such as a lack of out-of-distribution generalisation, catastrophic…

Neural and Evolutionary Computing · Computer Science 2025-02-14 Mehran H. Bazargani , Szymon Urbas , Karl Friston

Maximum entropy principle (MEP) offers an effective and unbiased approach to inferring unknown probability distributions when faced with incomplete information, while neural networks provide the flexibility to learn complex distributions…

Machine Learning · Statistics 2024-12-04 Wuyue Yang , Liangrong Peng , Guojie Li , Liu Hong

A statistical system is classically defined on a set of microstates $E$ by a global energy function $H : E \to \mathbb{R}$, yielding Gibbs probability measures (softmins) $\rho^\beta(H)$ for every inverse temperature $\beta = T^{-1}$. Gibbs…

Statistical Mechanics · Physics 2022-07-05 Olivier Peltre

The finite basis optimized effective potential (OEP) method within density functional theory is examined as an ill-posed problem. It is shown that the generation of nonphysical potentials is a controllable manifestation of the use of…

Materials Science · Physics 2009-11-11 Tim Heaton-Burgess , Felipe A. Bulat , Weitao Yang

In the context of irreversible dynamics, associating to a physical process its intuitive reverse can result to be a quite ambiguous task. It is a standard choice to define the reverse process using Bayes' theorem, but, in general, this…

Quantum Physics · Physics 2023-05-03 Jacopo Surace , Matteo Scandi

We develop the global constraint picture in the (linear) effective field theory generalisation of the Standard Model, incorporating data from detectors that operated at PEP, PETRA, TRISTAN, SpS, Tevatron, SLAC, LEPI and LEP II, as well as…

High Energy Physics - Phenomenology · Physics 2017-07-18 Laure Berthier , Michael Trott

The maximum entropy principle (MEP) is a method for obtaining the most likely distribution functions of observables from statistical systems, by maximizing entropy under constraints. The MEP has found hundreds of applications in ergodic and…

Classical Physics · Physics 2016-10-03 Rudolf Hanel , Stefan Thurner , Murray Gell-Mann

Experiments in particle physics have hitherto failed to produce any significant evidence for the many explicit models of physics beyond the Standard Model (BSM) that had been proposed over the past decades. As a result, physicists have…

History and Philosophy of Physics · Physics 2022-01-24 Philip Bechtle , Cristin Chall , Martin King , Michael Kraemer , Peter Maettig , Michael Stoeltzner

The aim of this paper is to introduce a field of study that has emerged over the last decade called Bayesian mechanics. Bayesian mechanics is a probabilistic mechanics, comprising tools that enable us to model systems endowed with a…