English
Related papers

Related papers: Hierarchical Active Inference using Successor Repr…

200 papers

Over the last 10 to 15 years, active inference has helped to explain various brain mechanisms from habit formation to dopaminergic discharge and even modelling curiosity. However, the current implementations suffer from an exponential…

Artificial Intelligence · Computer Science 2022-04-13 Théophile Champion , Lancelot Da Costa , Howard Bowman , Marek Grześ

Predictive models are highly advanced in understanding the mechanisms of brain function. Recent advances in machine learning further underscore the power of prediction for optimal representation in learning. However, there remains a gap in…

Machine Learning · Computer Science 2025-05-22 Xingsi Dong , Xiangyuan Peng , Si Wu

Physical AI agents, such as robots and other embodied systems operating under tight and fluctuating resource constraints, remain far less capable than biological agents in open-ended real-world environments. This paper argues that Active…

Machine Learning · Statistics 2026-03-24 Bert de Vries

Image-goal navigation steers an agent to a target location specified by an image in unseen environments. Existing methods primarily handle this task by learning an end-to-end navigation policy, which compares the similarities of target and…

Robotics · Computer Science 2026-04-21 Pengna Li , Kangyi Wu , Shaoqing Xu , Fang Li , Lin Zhao , Long Chen , Zhi-Xin Yang , Nanning Zheng

Neuromorphic Human-Computer Interaction (HCI) is a theoretical approach to designing better user experiences (UX) motivated by advances in the understanding of the neurophysiology of the brain. Inspired by the neuroscientific theory of…

Human-Computer Interaction · Computer Science 2026-05-19 Roel Vertegaal , Timothy Merritt , Saul Greenberg , Aneesh P. Tarun , Zhen Li , Zafeirios Fountas

In this paper we developed a hierarchical network model, called Hierarchical Prediction Network (HPNet), to understand how spatiotemporal memories might be learned and encoded in the recurrent circuits in the visual cortical hierarchy for…

Neural and Evolutionary Computing · Computer Science 2021-10-04 Jielin Qiu , Ge Huang , Tai Sing Lee

Accomplishing household tasks requires to plan step-by-step actions considering the consequences of previous actions. However, the state-of-the-art embodied agents often make mistakes in navigating the environment and interacting with…

Robotics · Computer Science 2024-03-14 Byeonghwi Kim , Jinyeon Kim , Yuyeong Kim , Cheolhong Min , Jonghyun Choi

When analyzing real-world data it is common to work with event ensembles, which comprise sets of observations that collectively constrain the parameters of an underlying model of interest. Such models often have a hierarchical structure,…

Machine Learning · Statistics 2024-02-22 Lukas Heinrich , Siddharth Mishra-Sharma , Chris Pollard , Philipp Windischhofer

Robot navigation in large, complex, and unknown indoor environments is a challenging problem. The existing approaches, such as traditional sampling-based methods, struggle with resolution control and scalability, while imitation…

Robotics · Computer Science 2025-10-03 Wei Han Chen , Yuchen Liu , Alexiy Buynitsky , Ahmed H. Qureshi

Two common approaches to sequential decision-making are AI planning (AIP) and reinforcement learning (RL). Each has strengths and weaknesses. AIP is interpretable, easy to integrate with symbolic knowledge, and often efficient, but requires…

Artificial Intelligence · Computer Science 2022-09-30 Junkyu Lee , Michael Katz , Don Joven Agravante , Miao Liu , Geraud Nangue Tasse , Tim Klinger , Shirin Sohrabi

An effective approach to solving long-horizon tasks in robotics domains with continuous state and action spaces is bilevel planning, wherein a high-level search over an abstraction of an environment is used to guide low-level…

Artificial Intelligence · Computer Science 2023-09-06 Nishanth Kumar , Willie McClinton , Rohan Chitnis , Tom Silver , Tomás Lozano-Pérez , Leslie Pack Kaelbling

This white paper lays out a vision of research and development in the field of artificial intelligence for the next decade (and beyond). Its denouement is a cyber-physical ecosystem of natural and synthetic sense-making, in which humans are…

Active inference is a leading theory of perception, learning and decision making, which can be applied to neuroscience, robotics, psychology, and machine learning. Active inference is based on the expected free energy, which is mostly…

Artificial Intelligence · Computer Science 2024-02-23 Théophile Champion , Howard Bowman , Dimitrije Marković , Marek Grześ

We address the problem of planning under uncertainty, where an agent must choose actions that not only achieve desired outcomes but also reduce uncertainty. Traditional methods often treat exploration and exploitation as separate…

The ability to plan ahead efficiently is key for both living organisms and artificial systems. Model-based planning and prospection are widely studied in cognitive neuroscience and artificial intelligence (AI), but from different…

Artificial Intelligence · Computer Science 2026-01-30 Domenico Maisto , Francesco Gregoretti , Karl Friston , Giovanni Pezzulo

The successor representation (SR) provides a powerful framework for decoupling predictive dynamics from rewards, enabling rapid generalisation across reward configurations. However, the classical SR is limited by its inherent policy…

Machine Learning · Computer Science 2026-02-16 Changmin Yu , Máté Lengyel

Many modern robotics applications require robots to function autonomously in dynamic environments including other decision making agents, such as people or other robots. This calls for fast and scalable interactive motion planning. This…

Robotics · Computer Science 2016-10-27 A. Bordallo , F. Previtali , N. Nardelli , S. Ramamoorthy

Active Inference is an emerging framework providing a quantitative account of behavioral processes in neuroscience and a principled approach to decision-making under uncertainty. Its application to agency problems is natural, offering an…

Computational Engineering, Finance, and Science · Computer Science 2026-04-15 Francesco Maria Mancinelli , Matteo Torzoni , Domenico Maisto , Francesco Donnarumma , Alberto Corigliano , Giovanni Pezzulo , Andrea Manzoni

Solving real-life sequential decision making problems under partial observability involves an exploration-exploitation problem. To be successful, an agent needs to efficiently gather valuable information about the state of the world for…

Machine Learning · Computer Science 2020-11-03 Haiyan Yin , Yingzhen Li , Sinno Jialin Pan , Cheng Zhang , Sebastian Tschiatschek

Human decision-making heavily relies on active sensing, a well-documented cognitive behaviour for evidence gathering to accommodate ever-changing environments. However, its operational mechanism in the real world remains non-trivial.…

Artificial Intelligence · Computer Science 2026-01-09 Hongliang Lu , Yunmeng Liu , Junjie Yang