English
Related papers

Related papers: From Coalgebraic Determinization to Belief Constru…

200 papers

The Partially Observable Markov Decision Process has long been recognized as a rich framework for real-world planning and control problems, especially in robotics. However exact solutions in this framework are typically computationally…

Artificial Intelligence · Computer Science 2011-10-05 J. Pineau , G. Gordon , S. Thrun

Partially Observable Markov Decision Process (POMDP) is widely used to model probabilistic behavior for complex systems. Compared with MDPs, POMDP models a system more accurate but solving a POMDP generally takes exponential time in the…

Logic in Computer Science · Computer Science 2017-03-13 Xiaobin Zhang , Bo Wu , Hai Lin

Belief compression improves the tractability of large-scale partially observable Markov decision processes (POMDPs) by finding projections from high-dimensional belief space onto low-dimensional approximations, where solving to obtain…

Artificial Intelligence · Computer Science 2015-08-06 Zhuoran Wang , Paul A. Crook , Wenshuo Tang , Oliver Lemon

Risk averse decision making under uncertainty in partially observable domains is a fundamental problem in AI and essential for reliable autonomous agents. In our case, the problem is modeled using partially observable Markov decision…

Artificial Intelligence · Computer Science 2024-06-11 Yaacov Pariente , Vadim Indelman

This article provides an introductory tutorial on structural results in partially observed Markov decision processes (POMDPs). Typically, computing the optimal policy of a POMDP is computationally intractable. We use lattice program- ming…

Optimization and Control · Mathematics 2015-12-15 Vikram Krishnamurthy

Partially observable Markov decision processes (POMDPs) form a prominent model for uncertainty in sequential decision making. We are interested in constructing algorithms with theoretical guarantees to determine whether the agent has a…

Artificial Intelligence · Computer Science 2024-12-17 Marius Belly , Nathanaël Fijalkow , Hugo Gimbert , Florian Horn , Guillermo A. Pérez , Pierre Vandenhove

Partially Observable Markov Decision Processes (POMDPs) remain a core challenge in reinforcement learning due to incomplete state information. We address this by reformulating POMDPs as fully observable processes with fixed-length…

Machine Learning · Computer Science 2025-09-16 Wuhao Wang , Zhiyong Chen

The focus of this paper is on solving multi-robot planning problems in continuous spaces with partial observability. Decentralized partially observable Markov decision processes (Dec-POMDPs) are general models for multi-robot coordination…

Multiagent Systems · Computer Science 2015-02-24 Shayegan Omidshafiei , Ali-akbar Agha-mohammadi , Christopher Amato , Jonathan P. How

In this paper we define a class of polynomial functors suited for constructing coalgebras representing processes in which uncertainty plays an important role. In these polynomial functors we include upper and lower probability measures,…

Logic in Computer Science · Computer Science 2024-04-02 Andrés Gallardo , Ignacio Viglizzo

Autonomous agents are limited in their ability to observe the world state. Partially observable Markov decision processes (POMDPs) formally model the problem of planning under world state uncertainty, but POMDPs with continuous actions and…

Robotics · Computer Science 2020-07-08 Dicong Qiu , Yibiao Zhao , Chris L. Baker

The principle behind algebraic language theory for various kinds of structures, such as words or trees, is to use a compositional function from the structures into a finite set. To talk about compositionality, one needs some way of…

Logic in Computer Science · Computer Science 2015-02-18 Mikołaj Bojańczyk

There are countless sources of data available to governments, companies, and citizens, which can be combined for good or evil. We analyse the concepts of combining data from common sources and linking data from different sources. We model…

Logic in Computer Science · Computer Science 2021-01-26 Liang-Ting Chen , Markus Roggenbach , John V. Tucker

Traditional logic-based belief revision research focuses on designing rules to constrain the behavior of revision operators. Frameworks have been proposed to characterize iterated revision rules, but they are often too loose, leading to…

Artificial Intelligence · Computer Science 2025-05-13 Hua Meng , Zhiguo Long , Michael Sioutis , Zhengchun Zhou

Partially observable Markov decision processes (POMDPs) rely on the key assumption that probability distributions are precisely known. Robust POMDPs (RPOMDPs) alleviate this concern by defining imprecise probabilities, referred to as…

Artificial Intelligence · Computer Science 2024-07-30 Eline M. Bovy , Marnix Suilen , Sebastian Junges , Nils Jansen

For widespread deployment in domains characterized by partial observability, non-deterministic actions and unforeseen changes, robots need to adapt sensing, processing and interaction with humans to the tasks at hand. While robots typically…

Artificial Intelligence · Computer Science 2013-08-05 Shiqi Zhang , Mohan Sridharan

Partially Observable Markov Decision Processes (POMDPs) are a fundamental framework for decision-making under uncertainty and partial observability. Since in general optimal policies may require infinite memory, they are hard to implement…

Artificial Intelligence · Computer Science 2026-04-30 Muqsit Azeem , Debraj Chakraborty , Sudeep Kanav , Jan Kretinsky

Partially Observable Markov Decision Processes (POMDPs) provide a robust framework for decision-making under uncertainty in applications such as autonomous driving and robotic exploration. Their extension, $\rho$POMDPs, introduces…

Artificial Intelligence · Computer Science 2025-02-05 Ron Benchetrit , Idan Lev-Yehudi , Andrey Zhitnikov , Vadim Indelman

Establishing common ground, a shared set of beliefs and mutually recognized facts, is fundamental to collaboration, yet remains a challenge for current AI systems, especially in multimodal, multiparty settings, where the collaborators bring…

Artificial Intelligence · Computer Science 2026-05-26 Yifan Zhu , Mariah Bradford , Kenneth Lai , Timothy Obiso , Videep Venkatesha , James Pustejovsky , Nikhil Krishnaswamy

Generalizable robotic mobile manipulation in open-world environments poses significant challenges due to long horizons, complex goals, and partial observability. A promising approach to address these challenges involves planning with a…

Artificial Intelligence · Computer Science 2025-04-07 Linfeng Zhao , Willie McClinton , Aidan Curtis , Nishanth Kumar , Tom Silver , Leslie Pack Kaelbling , Lawson L. S. Wong

Robots often face challenges in domestic environments where visual feedback is ineffective, such as retrieving objects obstructed by occlusions or finding a light switch in the dark. In these cases, utilizing contacts to localize the target…

Robotics · Computer Science 2024-09-30 Muhammad Suhail Saleem , Rishi Veerapaneni , Maxim Likhachev