中文
相关论文

相关论文: Hierarchical Active Inference using Successor Repr…

200 篇论文

One of the key challenges in applying reinforcement learning to real-life problems is that the amount of train-and-error required to learn a good policy increases drastically as the task becomes complex. One potential solution to this…

机器学习 · 计算机科学 2018-06-29 Kazeto Yamamoto , Takashi Onishi , Yoshimasa Tsuruoka

Learning-based approaches have achieved remarkable performance in the domain of autonomous driving. Leveraging the impressive ability of neural networks and large amounts of human driving data, complex patterns and rules of driving behavior…

机器人学 · 计算机科学 2023-08-01 Bikun Wang , Zhipeng Wang , Chenhao Zhu , Zhiqiang Zhang , Zhichen Wang , Penghong Lin , Jingchu Liu , Qian Zhang

Despite being recognized as neurobiologically plausible, active inference faces difficulties when employed to simulate intelligent behaviour in complex environments due to its computational cost and the difficulty of specifying an…

机器学习 · 计算机科学 2024-06-12 Aswin Paul , Noor Sajid , Lancelot Da Costa , Adeel Razi

Active inference is a first principle account of how autonomous agents operate in dynamic, non-stationary environments. This problem is also considered in reinforcement learning (RL), but limited work exists on comparing the two approaches…

人工智能 · 计算机科学 2021-02-15 Noor Sajid , Philip J. Ball , Thomas Parr , Karl J. Friston

State abstraction is an effective technique for planning in robotics environments with continuous states and actions, long task horizons, and sparse feedback. In object-oriented environments, predicates are a particularly useful form of…

机器人学 · 计算机科学 2023-06-21 Amber Li , Tom Silver

Accurate interception of moving objects, such as catching a ball, requires the nervous system to overcome sensory delays, noise, and environmental dynamics. One key challenge is predicting future object motion in the presence of sensory…

神经元与认知 · 定量生物学 2025-12-22 Marta Russo , Antonella Maselli , Federico Maggiore , Giovanni Pezzulo

The ability to plan at many different levels of abstraction enables agents to envision the long-term repercussions of their decisions and thus enables sample-efficient learning. This becomes particularly beneficial in complex environments…

人工智能 · 计算机科学 2023-10-17 Thomas Jiralerspong , Flemming Kondrup , Doina Precup , Khimya Khetarpal

Studies suggest that within the hierarchical architecture, the topological higher level possibly represents a conscious category of the current sensory events with slower changing activities. They attempt to predict the activities on the…

人工智能 · 计算机科学 2018-04-19 Junpei Zhong , Tetsuya Ogata , Angelo Cangelosi

This paper addresses the problem of learning abstractions that boost robot planning performance while providing strong guarantees of reliability. Although state-of-the-art hierarchical robot planning algorithms allow robots to efficiently…

机器人学 · 计算机科学 2022-04-26 Naman Shah , Siddharth Srivastava

The inverse statistical problem of finding direct interactions in complex networks is difficult. In the natural sciences, well-controlled perturbation experiments are widely used to probe the structure of complex networks. However, our…

无序系统与神经网络 · 物理学 2019-10-24 Jialong Jiang , David A. Sivak , Matt Thomson

We study how to effectively leverage expert feedback to learn sequential decision-making policies. We focus on problems with sparse rewards and long time horizons, which typically pose significant challenges in reinforcement learning. We…

机器学习 · 计算机科学 2018-06-12 Hoang M. Le , Nan Jiang , Alekh Agarwal , Miroslav Dudík , Yisong Yue , Hal Daumé

The Free Energy Principle (FEP) is a theoretical framework for describing how (intelligent) systems self-organise into coherent, stable structures by minimising a free energy functional. Active Inference (AIF) is a corollary of the FEP that…

人工智能 · 计算机科学 2023-10-17 Magnus Koudahl , Thijs van de Laar , Bert de Vries

We present a representation learning algorithm that learns a low-dimensional latent dynamical system from high-dimensional \textit{sequential} raw data, e.g., video. The framework builds upon recent advances in amortized inference methods…

机器学习 · 计算机科学 2020-01-29 Jung-Su Ha , Young-Jin Park , Hyeok-Joo Chae , Soon-Seo Park , Han-Lim Choi

Reinforcement Learning (RL)-based motion planning has recently shown the potential to outperform traditional approaches from autonomous navigation to robot manipulation. In this work, we focus on a motion planning task for an evasive target…

机器人学 · 计算机科学 2025-05-12 Zixuan Wu , Sean Ye , Manisha Natarajan , Matthew C. Gombolay

The free energy principle (FEP) is a mathematical framework that describes how biological systems self-organize and survive in their environment. This principle provides insights on multiple scales, from high-level behavioral and cognitive…

神经元与认知 · 定量生物学 2021-03-24 David Kappel , Christian Tetzlaff

Building machines capable of efficiently collaborating with humans has been a longstanding goal in artificial intelligence. Especially in the presence of uncertainties, optimal cooperation often requires that humans and artificial agents…

机器学习 · 计算机科学 2024-01-10 Oskar Keurulainen , Gokhan Alcan , Ville Kyrki

We seek to align agent policy with human expert behavior in a reinforcement learning (RL) setting, without any prior knowledge about dynamics, reward function, and unsafe states. There is a human expert knowing the rewards and unsafe states…

机器学习 · 计算机科学 2020-01-01 Daniel Hsu

Memory is inherently entangled with prediction and planning. Flexible behavior in biological and artificial agents depends on the interplay of learning from the past and predicting the future in ever-changing environments. This chapter…

人工智能 · 计算机科学 2024-02-21 Ida Momennejad

We propose a novel hierarchical reinforcement learning framework for control with continuous state and action spaces. In our framework, the user specifies subgoal regions which are subsets of states; then, we (i) learn options that serve as…

机器学习 · 计算机科学 2021-02-26 Kishor Jothimurugan , Osbert Bastani , Rajeev Alur

As we deploy reinforcement learning agents to solve increasingly challenging problems, methods that allow us to inject prior knowledge about the structure of the world and effective solution strategies becomes increasingly important. In…