English
Related papers

Related papers: Active Inference for Stochastic Control

200 papers

Active learning aims to select a small subset of data for annotation such that a classifier learned on the data is highly accurate. This is usually done using heuristic selection methods, however the effectiveness of such methods is limited…

Computation and Language · Computer Science 2017-08-09 Meng Fang , Yuan Li , Trevor Cohn

Active inference, a corollary of the free energy principle, is a formal way of describing the behavior of certain kinds of random dynamical systems that have the appearance of sentience. In this chapter, we describe how active inference…

Machine Learning · Statistics 2021-10-11 Noor Sajid , Lancelot Da Costa , Thomas Parr , Karl Friston

Model-based Reinforcement Learning and Control have demonstrated great potential in various sequential decision making problem domains, including in robotics settings. However, real-world robotics systems often present challenges that limit…

Machine Learning · Computer Science 2023-10-24 Achkan Salehi , Steffen Rühl , Stephane Doncieux

This paper proposes an Adaptive Learning Model Predictive Control strategy for uncertain constrained linear systems performing iterative tasks. The additive uncertainty is modeled as the sum of a bounded process noise and an unknown…

Systems and Control · Computer Science 2018-04-27 Monimoy Bujarbaruah , Xiaojing Zhang , Ugo Rosolia , Francesco Borrelli

We describe a framework of hybrid cognition by formulating a hybrid cognitive agent that performs hierarchical active inference across a human and a machine part. We suggest that, in addition to enhancing human cognitive functions with an…

Artificial Intelligence · Computer Science 2018-10-08 André Ofner , Sebastian Stober

In model-based learning, an agent's model is commonly defined over transitions between consecutive states of an environment even though planning often requires reasoning over multi-step timescales, with intermediate states either…

Machine Learning · Computer Science 2020-10-06 Alexey Zakharov , Matthew Crosby , Zafeirios Fountas

Temporal point processes have been widely applied to model event sequence data generated by online users. In this paper, we consider the problem of how to design the optimal control policy for point processes, such that the stochastic…

Machine Learning · Computer Science 2017-11-13 Yichen Wang , Grady Williams , Evangelos Theodorou , Le Song

Model-based control requires an accurate model of the system dynamics for precisely and safely controlling the robot in complex and dynamic environments. Moreover, in the presence of variations in the operating conditions, the model should…

Robotics · Computer Science 2024-09-04 Alessandro Saviolo , Jonathan Frey , Abhishek Rathod , Moritz Diehl , Giuseppe Loianno

Active perception has been employed in many domains, particularly in the field of robotics. The idea of active perception is to utilize the input data to predict the next action that can help robots to improve their performance. The main…

Robotics · Computer Science 2021-09-08 Elijah S. Lee

An increasing number of applications require real-time reasoning under uncertainty with streaming input. The temporal (dynamic) Bayes net formalism provides a powerful representational framework for such applications. However, existing…

Artificial Intelligence · Computer Science 2013-01-07 Masami Takikawa , Bruce D'Ambrosio , Ed Wright

The central tenet of reinforcement learning (RL) is that agents seek to maximize the sum of cumulative rewards. In contrast, active inference, an emerging framework within cognitive and computational neuroscience, proposes that agents act…

Machine Learning · Computer Science 2020-03-02 Alexander Tschantz , Beren Millidge , Anil K. Seth , Christopher L. Buckley

Understanding how humans control unstable systems is central to many research problems, with applications ranging from quiet standing to aircraft landing. Increasingly much evidence appears in favor of event-driven control hypothesis: human…

Biological Physics · Physics 2014-06-17 Arkady Zgonnikov , Ihor Lubashevsky , Shigeru Kanemoto , Toru Miyazawa , Takashi Suzuki

We explore an active learning approach for dynamic fair resource allocation problems. Unlike previous work that assumes full feedback from all agents on their allocations, we consider feedback from a select subset of agents at each epoch of…

Machine Learning · Computer Science 2024-06-24 Riddhiman Bhattacharya , Thanh Nguyen , Will Wei Sun , Mohit Tawarmalani

A fundamental difficulty of causal learning is that causal models can generally not be fully identified based on observational data only. Interventional data, that is, data originating from different experimental environments, improves…

Methodology · Statistics 2021-11-04 Juan L. Gamella , Christina Heinze-Deml

To quickly solve new tasks in complex environments, intelligent agents need to build up reusable knowledge. For example, a learned world model captures knowledge about the environment that applies to new tasks. Similarly, skills capture…

Machine Learning · Computer Science 2021-05-04 Kevin Xie , Homanga Bharadhwaj , Danijar Hafner , Animesh Garg , Florian Shkurti

The analysis of practical probabilistic models on the computer demands a convenient representation for the available knowledge and an efficient algorithm to perform inference. An appealing representation is the influence diagram, a network…

Artificial Intelligence · Computer Science 2013-04-15 Ross D. Shachter

Understanding how road users resolve space-sharing conflicts is important both for traffic safety and the safe deployment of autonomous vehicles. While existing models have captured specific aspects of such interactions (e.g., explicit…

Artificial Intelligence · Computer Science 2026-05-12 Julian F. Schumann , Johan Engström , Ran Wei , Shu-Yuan Liu , Jens Kober , Arkady Zgonnikov

Living organisms need to acquire both cognitive maps for learning the structure of the world and planning mechanisms able to deal with the challenges of navigating ambiguous environments. Although significant progress has been made in each…

Artificial Intelligence · Computer Science 2023-08-17 Toon Van de Maele , Bart Dhoedt , Tim Verbelen , Giovanni Pezzulo

$U$-statistics play a central role in statistical inference. In many modern applications, however, acquiring the labels required for $U$-statistics is costly. Motivated by recent advances in active inference, we develop an active inference…

Machine Learning · Statistics 2026-05-13 Xiaoning Wang , Yuyang Huo , Liuhua Peng , Changliang Zou

Pronounced variability due to the growth of renewable energy sources, flexible loads, and distributed generation is challenging residential distribution systems. This context, motivates well fast, efficient, and robust reactive power…

Systems and Control · Electrical Eng. & Systems 2019-10-31 Qiuling Yang , Alireza Sadeghi , Gang Wang , Georgios B. Giannakis , Jian Sun