English
Related papers

Related papers: Active Inference for Stochastic Control

200 papers

This paper presents an approach that brings together game theory with grammatical inference and discrete abstractions in order to synthesize control strategies for hybrid dynamical systems performing tasks in partially unknown but…

Robotics · Computer Science 2012-10-08 Jie Fu , Herbert G. Tanner , Jeffrey Heinz , Jane Chandlee , Konstantinos Karydis , Cesar Koirala

Data subsampling has become widely recognized as a tool to overcome computational and economic bottlenecks in analyzing massive datasets. We contribute to the development of adaptive design for estimation of finite population…

Methodology · Statistics 2024-07-08 Henrik Imberg , Xiaomi Yang , Carol Flannagan , Jonas Bärgman

The study of active matter has revealed novel non-equilibrium collective behaviors, illustrating their potential as a new materials platform. However, most works treat active matter as unregulated systems with uniform microscopic energy…

Soft Condensed Matter · Physics 2021-10-08 Martin J Falk , Vahid Alizadehyazdi , Heinrich Jaeger , Arvind Murugan

Intensity control is a class of continuous-time dynamic optimization problems with many important applications in Operations Research including queueing and revenue management. In this study, we propose a practical continuous-time…

Machine Learning · Computer Science 2026-04-14 Huiling Meng , Ningyuan Chen , Xuefeng Gao

We present exact algorithms for identifying deterministic-actions effects and preconditions in dynamic partially observable domains. They apply when one does not know the action model(the way actions affect the world) of a domain and must…

Artificial Intelligence · Computer Science 2014-01-16 Eyal Amir , Allen Chang

Optimal control of stochastic nonlinear dynamical systems is a major challenge in the domain of robot learning. Given the intractability of the global control problem, state-of-the-art algorithms focus on approximate sequential optimization…

Machine Learning · Computer Science 2020-04-23 Joe Watson , Hany Abdulsamad , Jan Peters

Active Inference (AIF) is emerging as a powerful framework for decision-making under uncertainty, yet its potential in engineering applications remains largely unexplored. In this work, we propose a novel dual-layer AIF architecture that…

Optimization and Control · Mathematics 2025-03-25 Seyyed Danial Nazemi , Mohsen A. Jafari , Andrea Matta

We pose an active perception problem where an autonomous agent actively interacts with a second agent with potentially adversarial behaviors. Given the uncertainty in the intent of the other agent, the objective is to collect further…

Artificial Intelligence · Computer Science 2019-09-20 Macheng Shen , Jonathan P How

Interactive decision-making is essential in applications such as autonomous driving, where the agent must infer the behavior of nearby human drivers while planning in real-time. Traditional predict-then-act frameworks are often insufficient…

The problem of coverage control, i.e., of coordinating multiple agents to optimally cover an area, arises in various applications. However, coverage applications face two major challenges: (1) dealing with nonlinear dynamics while…

Systems and Control · Electrical Eng. & Systems 2024-04-01 Rahel Rickenbach , Johannes Köhler , Anna Scampicchio , Melanie N. Zeilinger , Andrea Carron

We study a generalization of classical active learning to real-world settings with concrete prediction targets where sampling is restricted to an accessible region of the domain, while prediction targets may lie outside this region. We…

Machine Learning · Computer Science 2025-02-11 Jonas Hübotter , Bhavya Sukhija , Lenart Treven , Yarden As , Andreas Krause

Policy gradient methods hold great potential for solving complex continuous control tasks. Still, their training efficiency can be improved by exploiting structure within the optimization problem. Recent work indicates that supervised…

Machine Learning · Computer Science 2024-03-19 Jan Schneider , Pierre Schumacher , Simon Guist , Le Chen , Daniel Häufle , Bernhard Schölkopf , Dieter Büchler

When a robot autonomously performs a complex task, it frequently must balance competing objectives while maintaining safety. This becomes more difficult in uncertain environments with stochastic outcomes. Enhancing transparency in the…

Robotics · Computer Science 2024-06-19 Peter Amorese , Shohei Wakayama , Nisar Ahmed , Morteza Lahijanian

Efficient exploration remains a challenging problem in reinforcement learning, especially for those tasks where rewards from environments are sparse. A commonly used approach for exploring such environments is to introduce some "intrinsic"…

Machine Learning · Computer Science 2020-07-16 Neale Ratzlaff , Qinxun Bai , Li Fuxin , Wei Xu

We study reinforcement learning for controlled diffusion processes with unbounded continuous state spaces, bounded continuous actions, and polynomially growing rewards: settings that arise naturally in finance, economics, and operations…

Machine Learning · Computer Science 2025-12-18 Hanqing Jin , Renyuan Xu , Yanzhao Yang

Model-based approaches bear great promise for decision making of agents interacting with the physical world. In the context of spatial environments, different types of problems such as localisation, mapping, navigation or autonomous…

Machine Learning · Statistics 2019-06-21 Atanas Mirchev , Baris Kayalibay , Maximilian Soelch , Patrick van der Smagt , Justin Bayer

Underwater vehicles are employed in the exploration of dynamic environments where tuning of a specific controller for each task would be time-consuming and unreliable as the controller depends on calculated mathematical coefficients in…

Systems and Control · Electrical Eng. & Systems 2021-01-14 Wilmer Ariza Ramirez , Zhi Q. Leong , Hung D. Nguyen , S. G. Jayasinghe

When planning with an inaccurate dynamics model, a practical strategy is to restrict planning to regions of state-action space where the model is accurate: also known as a \textit{model precondition}. Empirical real-world trajectory data is…

Robotics · Computer Science 2024-04-24 Alex LaGrassa , Moonyoung Lee , Oliver Kroemer

Active inference is a theory of perception, learning and decision making, which can be applied to neuroscience, robotics, and machine learning. Recently, reasearch has been taking place to scale up this framework using Monte-Carlo tree…

Artificial Intelligence · Computer Science 2023-05-09 Théophile Champion , Marek Grześ , Lisa Bonheme , Howard Bowman

In many, if not every realistic sequential decision-making task, the decision-making agent is not able to model the full complexity of the world. The environment is often much larger and more complex than the agent, a setting also known as…

Machine Learning · Computer Science 2023-05-09 Ruo Yu Tao , Adam White , Marlos C. Machado