English
Related papers

Related papers: A Model-free Biomimetics Algorithm for Determinist…

200 papers

Decentralized Partially Observable Markov Decision Processes (Dec-POMDPs) are known to be NEXP-Complete and intractable to solve. However, for problems such as cooperative navigation, obstacle avoidance, and formation control, basic…

Multiagent Systems · Computer Science 2025-06-05 Alex DeWeese , Guannan Qu

Memoryless and finite-memory policies offer a practical alternative for solving partially observable Markov decision processes (POMDPs), as they operate directly in the output space rather than in the high-dimensional belief space. However,…

Machine Learning · Computer Science 2025-12-15 Roy van Zuijlen , Duarte Antunes

In this study I proposed a filtering beliefs method for improving performance of Partially Observable Markov Decision Processes(POMDPs), which is a method wildly used in autonomous robot and many other domains concerning control policy. My…

Artificial Intelligence · Computer Science 2021-01-07 Oscar LiJen Hsu

This work develops novel strategies for optimal planning with semantic observations using continuous state partially observable markov decision processes (CPOMDPs). Two major innovations are presented in relation to Gaussian mixture (GM)…

Artificial Intelligence · Computer Science 2019-08-09 Luke Burks , Ian Loefgren , Nisar Ahmed

Using a novel toy nautical navigation environment, we show that dynamic programming can be used when only incomplete information about a partially observed Markov decision process (POMDP) is known. By incorporating uncertainty into our…

Optimization and Control · Mathematics 2022-07-20 Chris Beeler , Xinkai Li , Colin Bellinger , Mark Crowley , Maia Fraser , Isaac Tamblyn

Learning a Markov Decision Process (MDP) from a fixed batch of trajectories is a non-trivial task whose outcome's quality depends on both the amount and the diversity of the sampled regions of the state-action space. Yet, many MDPs are…

Machine Learning · Computer Science 2022-03-08 Giorgio Angelotti , Nicolas Drougard , Caroline P. C. Chanel

The sense of touch, being the earliest sensory system to develop in a human body [1], plays a critical part of our daily interaction with the environment. In order to successfully complete a task, many manipulation interactions require…

Robotics · Computer Science 2017-05-18 Jaeyong Sung , J. Kenneth Salisbury , Ashutosh Saxena

Although research has produced promising results demonstrating the utility of active inference (AIF) in Markov decision processes (MDPs), there is relatively less work that builds AIF models in the context of environments and problems that…

Robotics · Computer Science 2024-09-24 Viet Dung Nguyen , Zhizhuo Yang , Christopher L. Buckley , Alexander Ororbia

Partially Observable Markov Decision Processes (POMDPs) are fundamental to many real-world applications. Although reinforcement learning (RL) has shown success in fully observable domains, learning policies from traces in partially…

Machine Learning · Computer Science 2025-08-05 Yuly Wu , Jiamou Liu , Libo Zhang

We present an alternative view for the study of optimal control of partially observed Markov Decision Processes (POMDPs). We first revisit the traditional (and by now standard) separated-design method of reducing the problem to fully…

Optimization and Control · Mathematics 2024-12-20 Serdar Yüksel

We consider the problem of approximate belief-state monitoring using particle filtering for the purposes of implementing a policy for a partially-observable Markov decision process (POMDP). While particle filtering has become a widely-used…

Artificial Intelligence · Computer Science 2013-01-14 Pascal Poupart , Luis E. Ortiz , Craig Boutilier

Partially Observable Markov Decision Processes (POMDPs) are used to model environments where the full state cannot be perceived by an agent. As such the agent needs to reason taking into account the past observations and actions. However,…

Machine Learning · Computer Science 2023-10-27 Raphael Avalos , Florent Delgrange , Ann Nowé , Guillermo A. Pérez , Diederik M. Roijers

Partially Observable Markov Decision Processes (POMDPs) are rich environments often used in machine learning. But the issue of information and causal structures in POMDPs has been relatively little studied. This paper presents the concepts…

Artificial Intelligence · Computer Science 2018-01-16 Stuart Armstrong

Motion planning of autonomous agents in partially known environments with incomplete information is a challenging problem, particularly for complex tasks. This paper proposes a model-free reinforcement learning approach to address this…

Artificial Intelligence · Computer Science 2023-05-02 Junchao Li , Mingyu Cai , Zhen Kan , Shaoping Xiao

Partially Observable Markov Decision Processes (POMDPs) are a fundamental framework for decision-making under uncertainty and partial observability. Since in general optimal policies may require infinite memory, they are hard to implement…

Artificial Intelligence · Computer Science 2026-04-30 Muqsit Azeem , Debraj Chakraborty , Sudeep Kanav , Jan Kretinsky

Strategies for partially observable Markov decision processes (POMDP) typically require memory. One way to represent this memory is via automata. We present a method to learn an automaton representation of a strategy using a modification of…

Artificial Intelligence · Computer Science 2024-10-03 Alexander Bork , Debraj Chakraborty , Kush Grover , Jan Kretinsky , Stefanie Mohr

Solving partially observable Markov decision processes (POMDPs) with high dimensional and continuous observations, such as camera images, is required for many real life robotics and planning problems. Recent researches suggested machine…

Artificial Intelligence · Computer Science 2025-05-27 Idan Lev-Yehudi , Moran Barenboim , Vadim Indelman

Decision-making under uncertainty is a crucial ability for autonomous systems. In its most general form, this problem can be formulated as a Partially Observable Markov Decision Process (POMDP). The solution policy of a POMDP can be…

Robotics · Computer Science 2019-04-09 Sung-Kyun Kim , Rohan Thakker , Ali-akbar Agha-mohammadi

The global capacity for mineral processing must expand rapidly to meet the demand for critical minerals, which are essential for building the clean energy technologies necessary to mitigate climate change. However, the efficiency of mineral…

Systems and Control · Electrical Eng. & Systems 2026-05-15 William Xu , Amir Eskanlou , Mansur Arief , David Zhen Yin , Jef K. Caers

Partially observable Markov decision processes have been widely used to provide models for real-world decision making problems. In this paper, we will provide a method in which a slightly different version of them called Mixed observability…

Artificial Intelligence · Computer Science 2012-06-06 Pouyan Rafiei Fard , Keyvan Yahya