中文
相关论文

相关论文: Robust Reinforcement Learning in POMDPs with Incom…

200 篇论文

Partially observable Markov decision processes (POMDPs) rely on the key assumption that probability distributions are precisely known. Robust POMDPs (RPOMDPs) alleviate this concern by defining imprecise probabilities, referred to as…

人工智能 · 计算机科学 2024-07-30 Eline M. Bovy , Marnix Suilen , Sebastian Junges , Nils Jansen

Planning under uncertainty is critical to robotics. The Partially Observable Markov Decision Process (POMDP) is a mathematical framework for such planning problems. It is powerful due to its careful quantification of the non-deterministic…

机器人学 · 计算机科学 2021-07-19 Hanna Kurniawati

The Robust Markov Decision Process (RMDP) framework focuses on designing control policies that are robust against the parameter uncertainties due to the mismatches between the simulator model and real-world settings. An RMDP problem is…

机器学习 · 计算机科学 2022-05-17 Kishan Panaganti , Dileep Kalathil

Reinforcement learning algorithms typically rely on the assumption that the environment dynamics and value function can be expressed in terms of a Markovian state representation. However, when state information is only partially observable,…

We study the problem of inverse reinforcement learning (IRL), where the learning agent recovers a reward function using expert demonstrations. Most of the existing IRL techniques make the often unrealistic assumption that the agent has…

机器学习 · 计算机科学 2021-12-20 Franck Djeumou , Murat Cubuktepe , Craig Lennon , Ufuk Topcu

A critical challenge for reinforcement learning (RL) is making decisions based on incomplete and noisy observations, especially in perturbed and partially observable Markov decision processes (P$^2$OMDPs). Existing methods fail to mitigate…

机器学习 · 计算机科学 2025-12-02 Na Li , Hangguan Shan , Wei Ni , Wenjie Zhang , Xinyu Li , Yamin Wang

Partially Observable Markov Decision Processes (POMDPs) are a natural and general model in reinforcement learning that take into account the agent's uncertainty about its current state. In the literature on POMDPs, it is customary to assume…

机器学习 · 计算机科学 2022-03-24 Noah Golowich , Ankur Moitra , Dhruv Rohatgi

The integration of physiological computing into mixed-initiative human-robot interaction systems offers valuable advantages in autonomous task allocation by incorporating real-time features as human state observations into the…

This paper presents a feature-based Partially Observable Markov Decision Process (POMDP) framework for quantum network routing, combining belief-state planning with Graph Neural Networks (GNNs) to address partial observability, decoherence,…

量子物理 · 物理学 2025-09-11 Amirhossein Taherpour , Abbas Taherpour , Tamer Khattab

In this paper, we expand the Bayesian persuasion framework to account for unobserved confounding variables in sender-receiver interactions. While traditional models assume that belief updates follow Bayesian principles, real-world scenarios…

人工智能 · 计算机科学 2025-08-11 Nishanth Venkatesh S. , Heeseung Bang , Andreas A. Malikopoulos

In this study I proposed a filtering beliefs method for improving performance of Partially Observable Markov Decision Processes(POMDPs), which is a method wildly used in autonomous robot and many other domains concerning control policy. My…

人工智能 · 计算机科学 2021-01-07 Oscar LiJen Hsu

We present a probabilistic logic programming framework to reinforcement learning, by integrating reinforce-ment learning, in POMDP environments, with normal hybrid probabilistic logic programs with probabilistic answer set seman-tics, that…

人工智能 · 计算机科学 2010-11-30 Emad Saad

In this review/tutorial article, we present recent progress on optimal control of partially observed Markov Decision Processes (POMDPs). We first present regularity and continuity conditions for POMDPs and their belief-MDP reductions, where…

最优化与控制 · 数学 2025-01-03 Ali Devran Kara , Serdar Yuksel

Reinforcement learning would enjoy better success on real-world problems if domain knowledge could be imparted to the algorithm by the modelers. Most problems have both hidden state and unknown dynamics. Partially observable Markov decision…

机器学习 · 计算机科学 2013-01-07 Christian R. Shelton

State of the art methods for target tracking with sensor management (or controlled sensing) are model-based and are obtained through solutions to Partially Observable Markov Decision Process (POMDP) formulations. In this paper a…

信号处理 · 电气工程与系统科学 2024-07-22 Adarsh M. Subramaniam , Argyrios Gerogiannis , James Z. Hare , Venugopal V. Veeravalli

We investigate partially observed Markov decision processes (POMDPs) with cost functions regularized by entropy terms describing state, observation, and control uncertainty. Standard POMDP techniques are shown to offer bounded-error…

系统与控制 · 电气工程与系统科学 2023-05-10 Timothy L. Molloy , Girish N. Nair

We are interested in enabling autonomous agents to learn and reason about systems with hidden states, such as locking mechanisms. We cast this problem as learning the parameters of a discrete Partially Observable Markov Decision Process…

机器学习 · 计算机科学 2026-02-04 Seiji Shaw , Travis Manderson , Chad Kessens , Nicholas Roy

Deep reinforcement learning has demonstrated remarkable achievements across diverse domains such as video games, robotic control, autonomous driving, and drug discovery. Common methodologies in partially-observable domains largely lean on…

机器学习 · 计算机科学 2024-02-15 Michael Lanier , Ying Xu , Nathan Jacobs , Chongjie Zhang , Yevgeniy Vorobeychik

We study strategy synthesis for partially observable Markov decision processes (POMDPs). The particular problem is to determine strategies that provably adhere to (probabilistic) temporal logic constraints. This problem is computationally…

人工智能 · 计算机科学 2019-03-22 Steven Carr , Nils Jansen , Ralf Wimmer , Alexandru C. Serban , Bernd Becker , Ufuk Topcu

We study model-based learning of finite-window policies in tabular partially observable Markov decision processes (POMDPs). A common approach to learning under partial observability is to approximate unbounded history dependencies using…

机器学习 · 计算机科学 2026-04-02 Philip Jordan , Maryam Kamgarpour