中文
相关论文

相关论文: Factored Online Planning in Many-Agent POMDPs

200 篇论文

Most works on multi-agent reinforcement learning focus on scenarios where the state of the environment is fully observable. In this work, we consider a cooperative policy evaluation task in which agents are not assumed to observe the…

机器学习 · 计算机科学 2023-05-17 Mert Kayaalp , Fatima Ghadieh , Ali H. Sayed

Partially Observable Markov Decision Processes (POMDP) is a widely used model to represent the interaction of an environment and an agent, under state uncertainty. Since the agent does not observe the environment state, its uncertainty is…

人工智能 · 计算机科学 2021-04-16 Divya Grover , Christos Dimitrakakis

We study planning problems where autonomous agents operate inside environments that are subject to uncertainties and not fully observable. Partially observable Markov decision processes (POMDPs) are a natural formal model to capture such…

人工智能 · 计算机科学 2018-02-28 Steven Carr , Nils Jansen , Ralf Wimmer , Jie Fu , Ufuk Topcu

This article presents an agent architecture for controlling an autonomous agent in stochastic environments. The architecture combines the partially observable Markov decision process (POMDP) model with the belief-desire-intention (BDI)…

人工智能 · 计算机科学 2016-07-05 Gavin Rens , Deshendran Moodley

Partially observable Markov decision processes (POMDPs) form an attractive and principled framework for agent planning under uncertainty. Point-based approximate techniques for POMDPs compute a policy based on a finite set of points…

人工智能 · 计算机科学 2011-09-13 M. T. J. Spaan , N. Vlassis

Decentralized partially observable Markov decision processes with communication (Dec-POMDP-Com) provide a framework for multiagent decision making under uncertainty, but the NEXP-complete complexity for finite-horizon problems renders…

多智能体系统 · 计算机科学 2025-11-18 Dylan M. Asmar , Mykel J. Kochenderfer

Partially observable Markov decision processes (POMDPs) provide a flexible representation for real-world decision and control problems. However, POMDPs are notoriously difficult to solve, especially when the state and observation spaces are…

人工智能 · 计算机科学 2023-10-20 Michael H. Lim , Tyler J. Becker , Mykel J. Kochenderfer , Claire J. Tomlin , Zachary N. Sunberg

In this work, we consider a cooperative multi-agent Markov decision process (MDP) involving m agents. At each decision epoch, all the m agents independently select actions in order to maximize a common long-term objective. In the policy…

机器学习 · 计算机科学 2024-05-01 Lakshmi Mandal , Chandrashekar Lakshminarayanan , Shalabh Bhatnagar

This paper investigates manipulation of multiple unknown objects in a crowded environment. Because of incomplete knowledge due to unknown objects and occlusions in visual observations, object observations are imperfect and action success is…

机器人学 · 计算机科学 2014-07-09 Joni Pajarinen , Ville Kyrki

Many exact and approximate solution methods for Markov Decision Processes (MDPs) attempt to exploit structure in the problem and are based on factorization of the value function. Especially multiagent settings, however, are known to suffer…

人工智能 · 计算机科学 2016-02-23 Philipp Robbel , Frans A. Oliehoek , Mykel J. Kochenderfer

Many multi-agent systems (MASs) are situated in stochastic environments. Some such systems that are based on the partially observable Markov decision process (POMDP) do not take the benevolence of other agents for granted. We propose a new…

人工智能 · 计算机科学 2018-05-15 Gavin Rens , Abhaya Nayak , Thomas Meyer

In this study I proposed a filtering beliefs method for improving performance of Partially Observable Markov Decision Processes(POMDPs), which is a method wildly used in autonomous robot and many other domains concerning control policy. My…

人工智能 · 计算机科学 2021-01-07 Oscar LiJen Hsu

Risk-averse decision-making under uncertainty in partially observable domains is a central challenge in artificial intelligence and is essential for developing reliable autonomous agents. The formal framework for such problems is the…

统计理论 · 数学 2026-02-27 Yaacov Pariente , Vadim Indelman

Partially observable Markov decision processes (POMDPs) have recently become popular among many AI researchers because they serve as a natural model for planning under uncertainty. Value iteration is a well-known algorithm for finding…

人工智能 · 计算机科学 2011-06-02 N. L. Zhang , W. Zhang

Partially observable Markov decision processes (POMDPs) are a general mathematical model for sequential decision-making in stochastic environments under state uncertainty. POMDPs are often solved \textit{online}, which enables the algorithm…

人工智能 · 计算机科学 2025-03-26 Yunuo Zhang , Baiting Luo , Ayan Mukhopadhyay , Abhishek Dubey

Online planning for partially observable Markov decision processes (POMDPs) provides efficient techniques for robot decision-making under uncertainty. However, existing methods fall short of preventing safety violations in dynamic…

机器人学 · 计算机科学 2024-09-10 Shili Sheng , Pian Yu , David Parker , Marta Kwiatkowska , Lu Feng

A crucial challenge to efficient and robust motion planning for autonomous vehicles is understanding the intentions of the surrounding agents. Ignoring the intentions of the other agents in dynamic environments can lead to risky or…

机器人学 · 计算机科学 2019-04-05 Xin Huang , Sungkweon Hong , Andreas Hofmann , Brian C. Williams

The design of autonomous agents that can interact effectively with other agents without prior coordination is a core problem in multi-agent systems. Type-based reasoning methods achieve this by maintaining a belief over a set of potential…

人工智能 · 计算机科学 2023-06-12 Jonathon Schwartz , Hanna Kurniawati , Marcus Hutter

Online solvers for partially observable Markov decision processes have difficulty scaling to problems with large action spaces. This paper proposes a method called PA-POMCPOW to sample a subset of the action space that provides varying…

机器学习 · 计算机科学 2021-11-04 John Mern , Anil Yildiz , Larry Bush , Tapan Mukerji , Mykel J. Kochenderfer

Multi-agent planning under stochastic dynamics is usually formalised using decentralized (partially observable) Markov decision processes ( MDPs) and reachability or expected reward specifications. In this paper, we propose a different…

计算机科学中的逻辑 · 计算机科学 2025-02-20 Francesco Pontiggia , Filip Macák , Roman Andriushchenko , Michele Chiari , Milan Češka