中文
相关论文

相关论文: Deep reinforcement learning for the olfactory sear…

200 篇论文

Online solvers for partially observable Markov decision processes have difficulty scaling to problems with large action spaces. This paper proposes a method called PA-POMCPOW to sample a subset of the action space that provides varying…

机器学习 · 计算机科学 2021-11-04 John Mern , Anil Yildiz , Larry Bush , Tapan Mukerji , Mykel J. Kochenderfer

Online planning under uncertainty in partially observable domains is an essential capability in robotics and AI. The partially observable Markov decision process (POMDP) is a mathematically principled framework for addressing…

机器人学 · 计算机科学 2024-10-14 Da Kong , Vadim Indelman

As a general and thus popular model for autonomous systems, partially observable Markov decision process (POMDP) can capture uncertainties from different sources like sensing noises, actuation errors, and uncertain environments. However,…

系统与控制 · 计算机科学 2017-03-27 Xiaobin Zhang , Bo Wu , Hai Lin

Partially Observable Markov Decision Processes (POMDPs) model decision making under uncertainty. While there are many approaches to approximately solving POMDPs, we aim to address the problem of learning such models. In particular, we are…

We investigate partially observed Markov decision processes (POMDPs) with cost functions regularized by entropy terms describing state, observation, and control uncertainty. Standard POMDP techniques are shown to offer bounded-error…

系统与控制 · 电气工程与系统科学 2023-05-10 Timothy L. Molloy , Girish N. Nair

Gradient-based approaches to direct policy search in reinforcement learning have received much recent attention as a means to solve problems of partial observability and to avoid some of the problems associated with policy degradation in…

人工智能 · 计算机科学 2019-11-18 Jonathan Baxter , Peter L. Bartlett

Standard Markov decision process (MDP) and reinforcement learning algorithms optimize the policy with respect to the expected gain. We propose an algorithm which enables to optimize an alternative objective: the probability that the gain is…

机器学习 · 计算机科学 2023-03-06 Vincent Corlay , Jean-Christophe Sibel

In this paper, we study representation learning in partially observable Markov Decision Processes (POMDPs), where the agent learns a decoder function that maps a series of high-dimensional raw observations to a compact representation and…

机器学习 · 计算机科学 2023-06-22 Jiacheng Guo , Zihao Li , Huazheng Wang , Mengdi Wang , Zhuoran Yang , Xuezhou Zhang

In this paper we focus on the problem of learning an optimal policy for Active Visual Search (AVS) of objects in known indoor environments with an online setup. Our POMP method uses as input the current pose of an agent (e.g. a robot) and a…

Partially Observable Markov Decision Processes (POMDP) is a widely used model to represent the interaction of an environment and an agent, under state uncertainty. Since the agent does not observe the environment state, its uncertainty is…

人工智能 · 计算机科学 2021-04-16 Divya Grover , Christos Dimitrakakis

We study the problem of inverse reinforcement learning (IRL), where the learning agent recovers a reward function using expert demonstrations. Most of the existing IRL techniques make the often unrealistic assumption that the agent has…

机器学习 · 计算机科学 2021-12-20 Franck Djeumou , Murat Cubuktepe , Craig Lennon , Ufuk Topcu

This work studies the problem of batch off-policy evaluation for Reinforcement Learning in partially observable environments. Off-policy evaluation under partial observability is inherently prone to bias, with risk of arbitrarily large…

机器学习 · 计算机科学 2019-11-26 Guy Tennenholtz , Shie Mannor , Uri Shalit

The key assumption underlying linear Markov Decision Processes (MDPs) is that the learner has access to a known feature map $\phi(x, a)$ that maps state-action pairs to $d$-dimensional vectors, and that the rewards and transitions are…

机器学习 · 计算机科学 2023-09-20 Noah Golowich , Ankur Moitra , Dhruv Rohatgi

Autonomous agents are limited in their ability to observe the world state. Partially observable Markov decision processes (POMDPs) formally model the problem of planning under world state uncertainty, but POMDPs with continuous actions and…

机器人学 · 计算机科学 2020-07-08 Dicong Qiu , Yibiao Zhao , Chris L. Baker

Novel advanced policy gradient (APG) methods, such as Trust Region policy optimization and Proximal policy optimization (PPO), have become the dominant reinforcement learning algorithms because of their ease of implementation and good…

最优化与控制 · 数学 2022-03-22 J. G. Dai , Mark Gluzman

The focus of this paper is on solving multi-robot planning problems in continuous spaces with partial observability. Decentralized partially observable Markov decision processes (Dec-POMDPs) are general models for multi-robot coordination…

多智能体系统 · 计算机科学 2015-02-24 Shayegan Omidshafiei , Ali-akbar Agha-mohammadi , Christopher Amato , Jonathan P. How

This paper presents the first ever approach for solving \emph{continuous-observation} Decentralized Partially Observable Markov Decision Processes (Dec-POMDPs) and their semi-Markovian counterparts, Dec-POSMDPs. This contribution is…

多智能体系统 · 计算机科学 2017-03-17 Shayegan Omidshafiei , Christopher Amato , Miao Liu , Michael Everett , Jonathan P. How , John Vian

Leveraging more test-time computation has proven to be an effective way to boost the reasoning capabilities of large language models (LLMs). Among various methods, the verify-and-improve paradigm stands out for enabling dynamic solution…

机器学习 · 计算机科学 2025-06-11 Yurun Yuan , Tengyang Xie

It is well known that for any finite state Markov decision process (MDP) there is a memoryless deterministic policy that maximizes the expected reward. For partially observable Markov decision processes (POMDPs), optimal memoryless policies…

最优化与控制 · 数学 2016-02-16 Guido Montufar , Keyan Ghazi-Zahedi , Nihat Ay

Policies for partially observed Markov decision processes can be efficiently learned by imitating policies for the corresponding fully observed Markov decision processes. Unfortunately, existing approaches for this kind of imitation…

机器学习 · 计算机科学 2021-07-02 Andrew Warrington , J. Wilder Lavington , Adam Ścibior , Mark Schmidt , Frank Wood