English
Related papers

Related papers: Deep Active Inference for Partially Observable MDP…

200 papers

Autonomous robotic navigation in real-world environments requires exploration to acquire environmental information as well as goal-directed navigation in order to reach specified targets. Active inference (AIF) based on the free-energy…

Robotics · Computer Science 2025-10-28 Riko Yokozawa , Kentaro Fujii , Yuta Nomura , Shingo Murata

We propose a planning and perception mechanism for a robot (agent), that can only observe the underlying environment partially, in order to solve an image classification problem. A three-layer architecture is suggested that consists of a…

Machine Learning · Computer Science 2019-09-24 Hossein K. Mousavi , Guangyi Liu , Weihang Yuan , Martin Takáč , Héctor Muñoz-Avila , Nader Motee

The great success that deep models have achieved in the past is mainly owed to large amounts of labeled training data. However, the acquisition of labeled data for new tasks aside from existing benchmarks is both challenging and costly.…

Computer Vision and Pattern Recognition · Computer Science 2018-09-27 Clemens-Alexander Brust , Christoph Käding , Joachim Denzler

We present a representation learning algorithm that learns a low-dimensional latent dynamical system from high-dimensional \textit{sequential} raw data, e.g., video. The framework builds upon recent advances in amortized inference methods…

Machine Learning · Computer Science 2020-01-29 Jung-Su Ha , Young-Jin Park , Hyeok-Joo Chae , Soon-Seo Park , Han-Lim Choi

Unsupervised active learning has attracted increasing attention in recent years, where its goal is to select representative samples in an unsupervised setting for human annotating. Most existing works are based on shallow linear models by…

Machine Learning · Computer Science 2020-07-29 Changsheng Li , Handong Ma , Zhao Kang , Ye Yuan , Xiao-Yu Zhang , Guoren Wang

Deep reinforcement learning (RL) has shown remarkable success in complex domains, however, the inherent black box nature of deep neural network policies raises significant challenges in understanding and trusting the decision-making…

Machine Learning · Computer Science 2025-01-20 Peilang Li , Umer Siddique , Yongcan Cao

Estimation of physical quantities is at the core of most scientific research and the use of quantum devices promises to enhance its performances. In real scenarios, it is fundamental to consider that the resources are limited and Bayesian…

Active learning methods are rapidly becoming the integral component of automated experiment workflows in imaging, materials synthesis, and computation. The distinctive aspect of many experimental scenarios is the presence of multiple…

Machine Learning · Computer Science 2022-03-22 Maxim Ziatdinov , Yongtao Liu , Sergei V. Kalinin

With the availability of large databases and recent improvements in deep learning methodology, the performance of AI systems is reaching or even exceeding the human level on an increasing number of complex tasks. Impressive examples of this…

Artificial Intelligence · Computer Science 2017-08-29 Wojciech Samek , Thomas Wiegand , Klaus-Robert Müller

Reinforcement learning holds the promise of enabling autonomous robots to learn large repertoires of behavioral skills with minimal human intervention. However, robotic applications of reinforcement learning often compromise the autonomy of…

Robotics · Computer Science 2016-11-24 Shixiang Gu , Ethan Holly , Timothy Lillicrap , Sergey Levine

We propose a novel Reinforcement Learning model for discrete environments, which is inherently interpretable and supports the discovery of deep subgoal hierarchies. In the model, an agent learns information about environment in the form of…

Artificial Intelligence · Computer Science 2022-02-16 Alexander Demin , Denis Ponomaryov

Noise poses a challenge for learning dynamical-system models because already small variations can distort the dynamics described by trajectory data. This work builds on operator inference from scientific machine learning to infer…

Machine Learning · Computer Science 2021-07-27 Wayne Isaac Tan Uy , Yuepeng Wang , Yuxiao Wen , Benjamin Peherstorfer

General-purpose, intelligent, learning agents cycle through sequences of observations, actions, and rewards that are complex, uncertain, unknown, and non-Markovian. On the other hand, reinforcement learning is well-developed for small…

Machine Learning · Computer Science 2009-12-30 Marcus Hutter

Many applications, such as in physical simulation and engineering design, demand we estimate functions with high-dimensional outputs. The training examples can be collected with different fidelities to allow a cost/accuracy trade-off. In…

Machine Learning · Computer Science 2021-10-27 Shibo Li , Robert M. Kirby , Shandian Zhe

We consider active learning of deep neural networks. Most active learning works in this context have focused on studying effective querying mechanisms and assumed that an appropriate network architecture is a priori known for the problem at…

Machine Learning · Computer Science 2019-09-06 Yonatan Geifman , Ran El-Yaniv

Automated decision-making under uncertainty requires balancing exploitation and exploration. Classical methods treat these separately using heuristics, while Active Inference unifies them through Expected Free Energy (EFE) minimization.…

Artificial Intelligence · Computer Science 2025-11-25 Wouter W. L. Nuijten , Mykola Lukashchuk

In order perform a large variety of tasks and to achieve human-level performance in complex real-world environments, Artificial Intelligence (AI) Agents must be able to learn from their past experiences and gain both knowledge and an…

Machine Learning · Computer Science 2019-05-13 Andrei Claudiu Roibu

We introduce Imagination-Augmented Agents (I2As), a novel architecture for deep reinforcement learning combining model-free and model-based aspects. In contrast to most existing model-based reinforcement learning and planning methods, which…

Providing artificial agents with the same computational models of biological systems is a way to understand how intelligent behaviours may emerge. We present an active inference body perception and action model working for the first time in…

Robotics · Computer Science 2021-02-08 Guillermo Oliver , Pablo Lanillos , Gordon Cheng

Robust imitation learning using disturbance injections overcomes issues of limited variation in demonstrations. However, these methods assume demonstrations are optimal, and that policy stabilization can be learned via simple augmentations.…

Robotics · Computer Science 2022-05-10 Hirotaka Tahara , Hikaru Sasaki , Hanbit Oh , Brendan Michael , Takamitsu Matsubara