中文
相关论文

相关论文: Comparison of Model-Free and Model-Based Learning-…

200 篇论文

Partially Observable Markov Decision Process (POMDP) is a mathematical framework for modeling decision-making under uncertainty, where the agent's observations are incomplete and the underlying system dynamics are probabilistic. Solving the…

系统与控制 · 电气工程与系统科学 2024-12-20 Yide Yu , Yue Liu , Xiaochen Yuan , Dennis Wong , Huijie Li , Yan Ma

In this paper we address the solution of the popular Wordle puzzle, using new reinforcement learning methods, which apply more generally to adaptive control of dynamic systems and to classes of Partially Observable Markov Decision Process…

人工智能 · 计算机科学 2022-12-01 Siddhant Bhambri , Amrita Bhattacharjee , Dimitri Bertsekas

Partially Observable Markov Decision Processes (POMDP) is a widely used model to represent the interaction of an environment and an agent, under state uncertainty. Since the agent does not observe the environment state, its uncertainty is…

人工智能 · 计算机科学 2021-04-16 Divya Grover , Christos Dimitrakakis

This paper investigates the problem of trajectory planning for autonomous vehicles at unsignalized intersections, specifically focusing on scenarios where the vehicle lacks the right of way and yet must cross safely. To address this issue,…

机器人学 · 计算机科学 2025-03-24 Adam Kollarčík adn Zdeněk Hanzálek

In this paper, we consider reinforcement learning of Markov Decision Processes (MDP) with peak constraints, where an agent chooses a policy to optimize an objective and at the same time satisfy additional constraints. The agent has to take…

最优化与控制 · 数学 2019-12-09 Ather Gattami

This work pioneers regret analysis of risk-sensitive reinforcement learning in partially observable environments with hindsight observation, addressing a gap in theoretical exploration. We introduce a novel formulation that integrates…

机器学习 · 计算机科学 2024-02-29 Tonghe Zhang , Yu Chen , Longbo Huang

To assist humans in open-world environments, robots must interpret ambiguous instructions to locate desired objects. Foundation model-based approaches excel at multimodal grounding, but they lack a principled mechanism for modeling…

机器人学 · 计算机科学 2026-03-06 Ivy Xiao He , Stefanie Tellex , Jason Xinyu Liu

Partially Observable Markov Decision Processes (POMDPs) are a powerful framework for planning under uncertainty. They allow to model state uncertainty as a belief probability distribution. Approximate solvers based on Monte Carlo sampling…

人工智能 · 计算机科学 2024-03-01 Daniele Meli , Alberto Castellini , Alessandro Farinelli

Noisy sensing, imperfect control, and environment changes are defining characteristics of many real-world robot tasks. The partially observable Markov decision process (POMDP) provides a principled mathematical framework for modeling and…

机器人学 · 计算机科学 2022-09-22 Mikko Lauri , David Hsu , Joni Pajarinen

Multiagent systems grapple with partial observability (PO), and the decentralized POMDP (Dec-POMDP) model highlights the fundamental nature of this challenge. Whereas recent approaches to addressing PO have appealed to deep learning models,…

机器学习 · 计算机科学 2025-02-21 Tonghan Wang , Heng Dong , Yanchen Jiang , David C. Parkes , Milind Tambe

Deep Reinforcement learning (DRL) is used to enable autonomous navigation in unknown environments. Most research assume perfect sensor data, but real-world environments may contain natural and artificial sensor noise and denial. Here, we…

机器人学 · 计算机科学 2024-10-21 Mariusz Wisniewski , Paraskevas Chatzithanos , Weisi Guo , Antonios Tsourdos

Recent benchmarks for memory-augmented reinforcement learning (RL) have introduced partially observable Markov decision process (POMDP) environments in which agents must use historical observations to make decisions. However, these…

人工智能 · 计算机科学 2026-04-15 Yongyi Wang , Lingfeng Li , Bozhou Chen , Ang Li , Hanyu Liu , Qirui Zheng , Xionghui Yang , Wenxin Li

Partially Observable Markov Decision Processes (POMDPs) model decision making under uncertainty. While there are many approaches to approximately solving POMDPs, we aim to address the problem of learning such models. In particular, we are…

There is much interest in using partially observable Markov decision processes (POMDPs) as a formal model for planning in stochastic domains. This paper is concerned with finding optimal policies for POMDPs. We propose several improvements…

人工智能 · 计算机科学 2013-02-01 Nevin Lianwen Zhang , Stephen S. Lee

Partial observability is a common challenge in many reinforcement learning applications, which requires an agent to maintain memory, infer latent states, and integrate this past information into exploration. This challenge leads to a number…

机器学习 · 计算机科学 2020-10-27 Chi Jin , Sham M. Kakade , Akshay Krishnamurthy , Qinghua Liu

In this work, we present a memory-augmented approach for image-goal navigation. Earlier attempts, including RL-based and SLAM-based approaches have either shown poor generalization performance, or are heavily-reliant on pose/depth sensors.…

计算机视觉与模式识别 · 计算机科学 2023-01-06 Lina Mezghani , Sainbayar Sukhbaatar , Thibaut Lavril , Oleksandr Maksymets , Dhruv Batra , Piotr Bojanowski , Karteek Alahari

Partially observable Markov decision processes (POMDPs) are standard models for dynamic systems with probabilistic and nondeterministic behaviour in uncertain environments. We prove that in POMDPs with long-run average objective, the…

计算机科学与博弈论 · 计算机科学 2022-09-29 Krishnendu Chatterjee , Raimundo Saona , Bruno Ziliotto

Attention mechanisms excel at learning sequential patterns by discriminating data based on relevance and importance. This provides state-of-the-art performance in advanced generative artificial intelligence models. This paper applies this…

系统与控制 · 电气工程与系统科学 2026-03-24 Turki Bin Mohaya , Peter Seiler

Robots often face challenges in domestic environments where visual feedback is ineffective, such as retrieving objects obstructed by occlusions or finding a light switch in the dark. In these cases, utilizing contacts to localize the target…

机器人学 · 计算机科学 2024-09-30 Muhammad Suhail Saleem , Rishi Veerapaneni , Maxim Likhachev

Partially Observable Markov Decision Processes (POMDPs) offer a promising world representation for autonomous agents, as they can model both transitional and perceptual uncertainties. Calculating the optimal solution to POMDP problems can…

人工智能 · 计算机科学 2022-10-25 Sigurdur Orn Adalgeirsson , Cynthia Breazeal