中文
相关论文

相关论文: Reinforcement Learning in POMDPs with Memoryless O…

200 篇论文

Real-world sequential decision making problems commonly involve partial observability, which requires the agent to maintain a memory of history in order to infer the latent states, plan and make good decisions. Coping with partial…

机器学习 · 计算机科学 2022-02-09 Yonathan Efroni , Chi Jin , Akshay Krishnamurthy , Sobhan Miryoosefi

Partially observable Markov decision processes (POMDPs) are a general framework for sequential decision-making under latent state uncertainty, yet learning in POMDPs is intractable in the worst case. Motivated by sensing and probing…

机器学习 · 计算机科学 2026-01-27 Ming Shi , Yingbin Liang , Ness B. Shroff

We propose a new reinforcement learning algorithm for partially observable Markov decision processes (POMDP) based on spectral decomposition methods. While spectral methods have been previously employed for consistent learning of (passive)…

人工智能 · 计算机科学 2017-06-20 Kamyar Azizzadenesheli , Alessandro Lazaric , Animashree Anandkumar

Partial observability is a common challenge in many reinforcement learning applications, which requires an agent to maintain memory, infer latent states, and integrate this past information into exploration. This challenge leads to a number…

机器学习 · 计算机科学 2020-10-27 Chi Jin , Sham M. Kakade , Akshay Krishnamurthy , Qinghua Liu

We propose a new reinforcement learning algorithm for partially observable Markov decision processes (POMDP) based on spectral decomposition methods. While spectral methods have been previously employed for consistent learning of (passive)…

人工智能 · 计算机科学 2017-06-20 Kamyar Azizzadenesheli , Alessandro Lazaric , Animashree Anandkumar

Much of reinforcement learning theory is built on top of oracles that are computationally hard to implement. Specifically for learning near-optimal policies in Partially Observable Markov Decision Processes (POMDPs), existing algorithms…

机器学习 · 计算机科学 2022-06-08 Noah Golowich , Ankur Moitra , Dhruv Rohatgi

The options framework in Hierarchical Reinforcement Learning breaks down overall goals into a combination of options or simpler tasks and associated policies, allowing for abstraction in the action space. Ideally, these options can be…

机器学习 · 计算机科学 2022-06-14 Kushal Chauhan , Soumya Chatterjee , Akash Reddy , Balaraman Ravindran , Pradeep Shenoy

Neural ordinary differential equations (ODEs) are widely recognized as the standard for modeling physical mechanisms, which help to perform approximate inference in unknown physical or biological environments. In partially observable (PO)…

机器学习 · 计算机科学 2023-10-31 Xuanle Zhao , Duzhen Zhang , Liyuan Han , Tielin Zhang , Bo Xu

Applications of Reinforcement Learning (RL), in which agents learn to make a sequence of decisions despite lacking complete information about the latent states of the controlled system, that is, they act under partial observability of the…

机器学习 · 计算机科学 2022-05-26 Qinghua Liu , Alan Chung , Csaba Szepesvári , Chi Jin

We study reinforcement learning for partially observed Markov decision processes (POMDPs) with infinite observation and state spaces, which remains less investigated theoretically. To this end, we make the first attempt at bridging partial…

机器学习 · 计算机科学 2024-04-02 Qi Cai , Zhuoran Yang , Zhaoran Wang

This work studies the problem of batch off-policy evaluation for Reinforcement Learning in partially observable environments. Off-policy evaluation under partial observability is inherently prone to bias, with risk of arbitrarily large…

机器学习 · 计算机科学 2019-11-26 Guy Tennenholtz , Shie Mannor , Uri Shalit

Policy-gradient methods have received increased attention recently as a mechanism for learning to act in partially observable environments. They have shown promise for problems admitting memoryless policies but have been less successful…

机器学习 · 计算机科学 2025-12-08 Douglas Aberdeen , Jonathan Baxter

In most real-world reinforcement learning applications, state information is only partially observable, which breaks the Markov decision process assumption and leads to inferior performance for algorithms that conflate observations with…

机器学习 · 计算机科学 2024-06-12 Hongming Zhang , Tongzheng Ren , Chenjun Xiao , Dale Schuurmans , Bo Dai

We present a data-efficient reinforcement learning algorithm resistant to observation noise. Our method extends the highly data-efficient PILCO algorithm (Deisenroth & Rasmussen, 2011) into partially observed Markov decision processes…

机器学习 · 统计学 2016-02-09 Rowan McAllister , Carl Edward Rasmussen

Planning plays an important role in the broad class of decision theory. Planning has drawn much attention in recent work in the robotics and sequential decision making areas. Recently, Reinforcement Learning (RL), as an agent-environment…

人工智能 · 计算机科学 2016-08-18 Kamyar Azizzadenesheli , Alessandro Lazaric , Animashree Anandkumar

Memoryless and finite-memory policies offer a practical alternative for solving partially observable Markov decision processes (POMDPs), as they operate directly in the output space rather than in the high-dimensional belief space. However,…

机器学习 · 计算机科学 2025-12-15 Roy van Zuijlen , Duarte Antunes

Partially observable environments present a considerable computational challenge in reinforcement learning due to the need to consider long histories. Learning with a finite window of observations quickly becomes intractable as the window…

机器学习 · 计算机科学 2025-06-04 Onno Eberhard , Michael Muehlebach , Claire Vernade

Reinforcement learning is generally difficult for partially observable Markov decision processes (POMDPs), which occurs when the agent's observation is partial or noisy. To seek good performance in POMDPs, one strategy is to endow the agent…

机器学习 · 计算机科学 2021-11-19 Mario Geiger , Christophe Eloy , Matthieu Wyart

In standard reinforcement learning settings, agents typically assume immediate feedback about the effects of their actions after taking them. However, in practice, this assumption may not hold true due to physical constraints and can…

机器学习 · 计算机科学 2024-06-27 Armin Karamzade , Kyungmin Kim , Montek Kalsi , Roy Fox

In recent years, reinforcement learning has achieved many remarkable successes due to the growing adoption of deep learning techniques and the rapid growth in computing power. Nevertheless, it is well-known that flat reinforcement learning…

人工智能 · 计算机科学 2024-10-30 Le Pham Tuyen , Ngo Anh Vien , Abu Layek , TaeChoong Chung
‹ 上一页 1 2 3 10 下一页 ›