English
Related papers

Related papers: Active Inference in Discrete State Spaces from Fir…

200 papers

Active Inference is a closed-loop computational theoretical basis for understanding behaviour, based on agents with internal probabilistic generative models that encode their beliefs about how hidden states in their environment cause their…

Human-Computer Interaction · Computer Science 2024-12-20 Roderick Murray-Smith , John H. Williamson , Sebastian Stein

Active Inference (ActInf) is an emerging theory that explains perception and action in biological agents, in terms of minimizing a free energy bound on Bayesian surprise. Goal-directed behavior is elicited by introducing prior beliefs on…

Machine Learning · Statistics 2021-07-28 Thijs van de Laar , Ismail Senoz , Ayça Özçelikkale , Henk Wymeersch

As a unified theory of sentient behaviour, active inference is formally intertwined with multiple normative theories of optimal behaviour. Specifically, we address what we call the subsumption thesis: The claim that expected utility from…

Theoretical Economics · Economics 2025-03-10 Noe Kuhn

The goal of these lecture notes is to review the problem of free energy minimization as a unified framework underlying the definition of maximum entropy modelling, generalized Bayesian inference, learning with latent variables, statistical…

Signal Processing · Electrical Eng. & Systems 2020-12-01 Sharu Theresa Jose , Osvaldo Simeone

We revisit the role of instrumental value as a driver of adaptive behavior. In active inference, instrumental or extrinsic value is quantified by the information-theoretic surprisal of a set of observations measuring the extent to which…

Neurons and Cognition · Quantitative Biology 2020-10-14 Alvaro Ovalle , Simon M. Lucas

Intelligent agents must pursue their goals in complex environments with partial information and often limited computational capacity. Reinforcement learning methods have achieved great success by creating agents that optimize engineered…

Machine Learning · Computer Science 2021-06-07 Alejandro Daniel Noel , Charel van Hoof , Beren Millidge

Maximum likelihood constraint inference is a powerful technique for identifying unmodeled constraints that affect the behavior of a demonstrator acting under a known objective function. However, it was originally formulated only for…

Robotics · Computer Science 2021-09-13 Kaylene C. Stocking , David L. McPherson , Robert P. Matthew , Claire J. Tomlin

We propose a hybrid combination of active inference and behavior trees (BTs) for reactive action planning and execution in dynamic environments, showing how robotic tasks can be formulated as a free-energy minimization problem. The proposed…

Robotics · Computer Science 2022-11-28 Corrado Pezzato , Carlos Hernandez Corbato , Stefan Bonhof , Martijn Wisse

In this PhD thesis, we explore and apply methods inspired by the free energy principle to two important areas in machine learning and neuroscience. The free energy principle is a general mathematical theory of the necessary…

Artificial Intelligence · Computer Science 2021-08-31 Beren Millidge

The Free-Energy Principle (FEP) [1-3] has been adopted in a variety of ambitious proposals that aim to characterize all adaptive, sentient, and cognitive systems within a unifying framework. Judging by the amount of attention it has…

Neurons and Cognition · Quantitative Biology 2024-01-18 Zahra Sheikhbahaee , Adam Safron , Casper Hesp , Guillaume Dumas

Active perception has been employed in many domains, particularly in the field of robotics. The idea of active perception is to utilize the input data to predict the next action that can help robots to improve their performance. The main…

Robotics · Computer Science 2021-09-08 Elijah S. Lee

We analyze free energy functionals for macroscopic models of multi-agent systems interacting via pairwise attractive forces and localized repulsion. The repulsion at the level of the continuous description is modeled by pressure-related…

Analysis of PDEs · Mathematics 2018-12-18 J. A. Carrillo , M. G. Delgadino , F. S. Patacchini

This paper presents a continuous, information-theoretic extension of the Free Energy Principle through the concept of Markov blanket density, i.e., a scalar field that quantifies the degree of conditional independence between internal and…

Neurons and Cognition · Quantitative Biology 2025-08-12 Luca M. Possati

Robotic manipulation stands as a largely unsolved problem despite significant advances in robotics and machine learning in the last decades. One of the central challenges of manipulation is partial observability, as the agent usually does…

Robotics · Computer Science 2022-06-22 Tim Schneider , Boris Belousov , Hany Abdulsamad , Jan Peters

In this paper we introduce a general estimation methodology for learning a model of human perception and control in a sensorimotor control task based upon a finite set of demonstrations. The model's structure consists of i the agent's…

Machine Learning · Computer Science 2025-05-02 Ran Wei , Anthony D. McDonald , Alfredo Garcia , Gustav Markkula , Johan Engstrom , Matthew O'Kelly

In equilibrium, the collective behaviour of particles interacting via steep, short-ranged potentials is well captured by the virial expansion of the free energy at low density. Here, we extend this approach beyond equilibrium to the case of…

Soft Condensed Matter · Physics 2023-06-21 Yuting Irene Li , Rosalba Garcia-Millan , Michael E. Cates , Étienne Fodor

Robots in uncertain real-world environments must perform both goal-directed and exploratory actions. However, most deep learning-based control methods neglect exploration and struggle under uncertainty. To address this, we adopt deep active…

Robotics · Computer Science 2025-12-02 Kentaro Fujii , Shingo Murata

Expected free energy (EFE) is a central quantity in active inference which has recently gained popularity due to its intuitive decomposition of the expected value of control into a pragmatic and an epistemic component. While numerous…

Artificial Intelligence · Computer Science 2024-08-14 Ran Wei

The extension of thermodynamic principles to active matter remains a challenge due to the non-equilibrium nature inherent to active systems. In this study, we introduce a framework to assess entropy in our minimal macroscopic experiment…

Soft Condensed Matter · Physics 2024-09-26 Francesco Romanò , Michael Riedl

The Expected Free Energy (EFE) is a central quantity in the theory of active inference. It is the quantity that all active inference agents are mandated to minimize through action, and its decomposition into extrinsic and intrinsic value…

Artificial Intelligence · Computer Science 2020-09-30 Beren Millidge , Alexander Tschantz , Christopher L Buckley