English
Related papers

Related papers: Reward Maximisation through Discrete Active Infere…

200 papers

While reinforcement learning algorithms provide automated acquisition of optimal policies, practical application of such methods requires a number of design decisions, such as manually designing reward functions that not only define the…

Machine Learning · Computer Science 2022-12-29 Tim G. J. Rudner , Vitchyr H. Pong , Rowan McAllister , Yarin Gal , Sergey Levine

The free energy principle, and its corollary active inference, constitute a bio-inspired theory that assumes biological agents act to remain in a restricted set of preferred states of the world, i.e., they minimize their free energy. Under…

Machine Learning · Computer Science 2022-07-15 Pietro Mazzaglia , Tim Verbelen , Ozan Çatal , Bart Dhoedt

Reinforcement learning algorithms in multi-agent systems deliver highly resilient and adaptable solutions for common problems in telecommunications,aerospace, and industrial robotics. However, achieving an optimal global goal remains a…

Multiagent Systems · Computer Science 2021-05-18 Changgang Zheng , Shufan Yang , Juan Parra-Ullauri , Antonio Garcia-Dominguez , Nelly Bencomo

The interaction between an artificial agent and its environment is bi-directional. The agent extracts relevant information from the environment, and affects the environment by its actions in return to accumulate high expected reward.…

Systems and Control · Computer Science 2018-06-06 Stas Tiomkin , Naftali Tishby

Active inference may be defined as Bayesian modeling of a brain with a biologically plausible model of the agent. Its primary idea relies on the free energy principle and the prior preference of the agent. An agent will choose an action…

Machine Learning · Computer Science 2021-12-14 Jin young Shin , Cheolhyeong Kim , Hyung Ju Hwang

Given the rapid advancement of artificial intelligence, understanding the foundations of intelligent behaviour is increasingly important. Active inference, regarded as a general theory of behaviour, offers a principled approach to probing…

Artificial Intelligence · Computer Science 2024-06-12 Aswin Paul , Takuya Isomura , Adeel Razi

To determine an optimal plan for complex tasks, one often deals with dynamic and hierarchical relationships between several entities. Traditionally, such problems are tackled with optimal control, which relies on the optimization of cost…

Robotics · Computer Science 2025-05-12 Matteo Priorelli , Ivilin Peev Stoianov

In reinforcement learning (RL), aligning agent behavior with specific objectives typically requires careful design of the reward function, which can be challenging when the desired objectives are complex. In this work, we propose an…

Machine Learning · Computer Science 2025-09-05 Yuting Tang , Yivan Zhang , Johannes Ackermann , Yu-Jie Zhang , Soichiro Nishimori , Masashi Sugiyama

This work combines the free energy principle from cognitive neuroscience and the ensuing active inference dynamics with recent advances in variational inference in deep generative models, and evolution strategies to introduce the "deep…

Neurons and Cognition · Quantitative Biology 2018-10-24 Kai Ueltzhöffer

AI systems are increasingly used to assist humans in sequential decision-making tasks, yet determining when and how an AI assistant should intervene remains a fundamental challenge. A potential baseline is to recommend the optimal action…

Artificial Intelligence · Computer Science 2026-04-17 Saumik Narayanan , Raja Panjwani , Siddhartha Sen , Chien-Ju Ho

Active inference is a process theory of the brain that states that all living organisms infer actions in order to minimize their (expected) free energy. However, current experiments are limited to predefined, often discrete, state spaces.…

Machine Learning · Computer Science 2020-02-25 Ozan Çatal , Tim Verbelen , Johannes Nauta , Cedric De Boom , Bart Dhoedt

To learn directed behaviors in complex environments, intelligent agents need to optimize objective functions. Various objectives are known for designing artificial agents, including task rewards and intrinsic motivation. However, it is…

Artificial Intelligence · Computer Science 2022-02-15 Danijar Hafner , Pedro A. Ortega , Jimmy Ba , Thomas Parr , Karl Friston , Nicolas Heess

Active inference is a Bayesian framework for understanding biological intelligence. The underlying theory brings together perception and action under one single imperative: minimizing free energy. However, despite its theoretical utility in…

Neurons and Cognition · Quantitative Biology 2020-10-23 Zafeirios Fountas , Noor Sajid , Pedro A. M. Mediano , Karl Friston

Active inference is a normative framework for explaining behaviour under the free energy principle -- a theory of self-organisation originating in neuroscience. It specifies neuronal dynamics for state-estimation in terms of a descent on…

Neurons and Cognition · Quantitative Biology 2021-10-26 Lancelot Da Costa , Thomas Parr , Biswa Sengupta , Karl Friston

Existing approaches to reward inference from behavior typically assume that humans provide demonstrations according to specific models of behavior. However, humans often indicate their goals through a wide range of behaviors, from actions…

Machine Learning · Computer Science 2025-02-26 Will Schwarzer , Jordan Schneider , Philip S. Thomas , Scott Niekum

Active inference offers a principled account of behavior as minimizing average sensory surprise over time. Applications of active inference to control problems have heretofore tended to focus on finite-horizon or discounted-surprise…

Systems and Control · Electrical Eng. & Systems 2022-08-24 Eli Sennesh , Jordan Theriault , Jan-Willem van de Meent , Lisa Feldman Barrett , Karen Quigley

Active inference is a theory that underpins the way biological agent's perceive and act in the real world. At its core, active inference is based on the principle that the brain is an approximate Bayesian inference engine, building an…

Artificial Intelligence · Computer Science 2020-03-09 Ozan Çatal , Samuel Wauthier , Tim Verbelen , Cedric De Boom , Bart Dhoedt

In reinforcement learning (RL), agents continually interact with the environment and use the feedback to refine their behavior. To guide policy optimization, reward models are introduced as proxies of the desired objectives, such that when…

Machine Learning · Computer Science 2025-06-19 Rui Yu , Shenghua Wan , Yucen Wang , Chen-Xiao Gao , Le Gan , Zongzhang Zhang , De-Chuan Zhan

Active Inference is a theory of action arising from neuroscience which casts action and planning as a bayesian inference problem to be solved by minimizing a single quantity - the variational free energy. Active Inference promises a…

Machine Learning · Computer Science 2019-07-10 Beren Millidge

Flexible, goal-directed behavior is a fundamental aspect of human life. Based on the free energy minimization principle, the theory of active inference formalizes the generation of such behavior from a computational neuroscience…

Artificial Intelligence · Computer Science 2022-08-03 Fedor Scholz , Christian Gumbsch , Sebastian Otte , Martin V. Butz