中文
相关论文

相关论文: Hierarchical Reinforcement Learning under Mixed Ob…

200 篇论文

This paper is concerned with multi-view reinforcement learning (MVRL), which allows for decision making when agents share common dynamics but adhere to different observation models. We define the MVRL framework by extending partially…

机器学习 · 计算机科学 2019-10-21 Minne Li , Lisheng Wu , Haitham Bou Ammar , Jun Wang

We study Reinforcement Learning for partially observable dynamical systems using function approximation. We propose a new \textit{Partially Observable Bilinear Actor-Critic framework}, that is general enough to include models such as…

机器学习 · 计算机科学 2022-06-27 Masatoshi Uehara , Ayush Sekhari , Jason D. Lee , Nathan Kallus , Wen Sun

Hierarchical clustering has been shown to be valuable in many scenarios. Despite its usefulness to many situations, there is no agreed methodology on how to properly evaluate the hierarchies produced from different techniques, particularly…

机器学习 · 统计学 2020-12-09 Weipeng Huang , Guangyuan Piao , Raul Moreno , Neil J. Hurley

We are interested in enabling autonomous agents to learn and reason about systems with hidden states, such as locking mechanisms. We cast this problem as learning the parameters of a discrete Partially Observable Markov Decision Process…

机器学习 · 计算机科学 2026-02-04 Seiji Shaw , Travis Manderson , Chad Kessens , Nicholas Roy

We present an online planning framework and a new benchmark dataset for solving multi-object rearrangement problems in partially observable, multi-room environments. Current object rearrangement solutions, primarily based on Reinforcement…

机器学习 · 计算机科学 2025-08-27 Rajesh Mangannavar , Alan Fern , Prasad Tadepalli

Many processes, such as discrete event systems in engineering or population dynamics in biology, evolve in discrete space and continuous time. We consider the problem of optimal decision making in such discrete state and action space…

机器学习 · 计算机科学 2020-10-27 Bastian Alt , Matthias Schultheis , Heinz Koeppl

Many control tasks exhibit similar dynamics that can be modeled as having common latent structure. Hidden-Parameter Markov Decision Processes (HiP-MDPs) explicitly model this structure to improve sample efficiency in multi-task settings.…

机器学习 · 计算机科学 2021-02-15 Amy Zhang , Shagun Sodhani , Khimya Khetarpal , Joelle Pineau

In many practical applications, decision-making processes must balance the costs of acquiring information with the benefits it provides. Traditional control systems often assume full observability, an unrealistic assumption when…

人工智能 · 计算机科学 2025-01-24 Taiyi Wang , Jianheng Liu , Bryan Lee , Zhihao Wu , Yu Wu

Hidden Markov models (HMMs) and partially observable Markov decision processes (POMDPs) form a useful tool for modeling dynamical systems. They are particularly useful for representing environments such as road networks and office…

人工智能 · 计算机科学 2013-01-30 Hagit Shatkay

The integration of physiological computing into mixed-initiative human-robot interaction systems offers valuable advantages in autonomous task allocation by incorporating real-time features as human state observations into the…

Multi-objective Markov decision processes are sequential decision-making problems that involve multiple conflicting reward functions that cannot be optimized simultaneously without a compromise. This type of problems cannot be solved by a…

机器学习 · 计算机科学 2023-08-22 Sherif Abdelfattah , Kathryn Merrick , Jiankun Hu

General-purpose, intelligent, learning agents cycle through sequences of observations, actions, and rewards that are complex, uncertain, unknown, and non-Markovian. On the other hand, reinforcement learning is well-developed for small…

机器学习 · 计算机科学 2009-12-30 Marcus Hutter

This paper studies the sample-efficiency of learning in Partially Observable Markov Decision Processes (POMDPs), a challenging problem in reinforcement learning that is known to be exponentially hard in the worst-case. Motivated by…

机器学习 · 计算机科学 2023-07-07 Jiacheng Guo , Minshuo Chen , Huan Wang , Caiming Xiong , Mengdi Wang , Yu Bai

We consider a class of sequential decision-making problems under uncertainty that can encompass various types of supervised learning concepts. These problems have a completely observed state process and a partially observed modulation…

最优化与控制 · 数学 2021-08-24 R. Reid Bishop , Chelsea C. White

Reinforcement learning usually assumes a given or sometimes even fixed environment in which an agent seeks an optimal policy to maximize its long-term discounted reward. In contrast, we consider agents that are not limited to passive…

机器学习 · 计算机科学 2025-10-20 Ziqing Lu , Babak Hassibi , Lifeng Lai , Weiyu Xu

Partially observable Markov decision processes (POMDPs) are a general framework for sequential decision-making under latent state uncertainty, yet learning in POMDPs is intractable in the worst case. Motivated by sensing and probing…

机器学习 · 计算机科学 2026-01-27 Ming Shi , Yingbin Liang , Ness B. Shroff

In reinforcement learning (RL), an agent learns to perform a task by interacting with an environment and receiving feedback (a numerical reward) for its actions. However, the assumption that rewards are always observable is often not…

A tenet of reinforcement learning is that the agent always observes rewards. However, this is not true in many realistic settings, e.g., a human observer may not always be available to provide rewards, sensors may be limited or…

机器学习 · 计算机科学 2026-03-24 Alireza Kazemipour , Simone Parisi , Matthew E. Taylor , Michael Bowling

Regulating the importance ratio is critical for the training stability of Group Relative Policy Optimization (GRPO) based frameworks. However, prevailing ratio control methods, such as hard clipping, suffer from non-differentiable…

机器学习 · 计算机科学 2026-03-24 Hongjun Wang , Wei Liu , Weibo Gu , Xing Sun , Kai Han

This paper addresses the challenge of enabling a single robot to effectively assist multiple humans in decision-making for task planning domains. We introduce a comprehensive framework designed to enhance overall team performance by…

机器人学 · 计算机科学 2023-10-17 Abhinav Dahiya , Stephen L. Smith