中文
相关论文

相关论文: Provable Partially Observable Reinforcement Learni…

200 篇论文

This work leverages adaptive social learning to estimate partially observable global states in multi-agent reinforcement learning (MARL) problems. Unlike existing methods, the proposed approach enables the concurrent operation of social…

多智能体系统 · 计算机科学 2025-08-11 Ainur Zhaikhan , Malek Khammassi , Ali H. Sayed

Reinforcement learning in partially observable domains is challenging due to the lack of observable state information. Thankfully, learning offline in a simulator with such state information is often possible. In particular, we propose a…

机器人学 · 计算机科学 2022-11-11 Hai Nguyen , Andrea Baisero , Dian Wang , Christopher Amato , Robert Platt

In practical applications, we can rarely assume full observability of a system's environment, despite such knowledge being important for determining a reactive control system's precise interaction with its environment. Therefore, we propose…

机器学习 · 计算机科学 2022-06-24 Edi Muskardin , Martin Tappler , Bernhard K. Aichernig , Ingo Pill

Partial observability is a common challenge in many reinforcement learning applications, which requires an agent to maintain memory, infer latent states, and integrate this past information into exploration. This challenge leads to a number…

机器学习 · 计算机科学 2020-10-27 Chi Jin , Sham M. Kakade , Akshay Krishnamurthy , Qinghua Liu

In this paper we study online Reinforcement Learning (RL) in partially observable dynamical systems. We focus on the Predictive State Representations (PSRs) model, which is an expressive model that captures other well-known models such as…

机器学习 · 计算机科学 2022-08-16 Wenhao Zhan , Masatoshi Uehara , Wen Sun , Jason D. Lee

We study the problem of inverse reinforcement learning (IRL), where the learning agent recovers a reward function using expert demonstrations. Most of the existing IRL techniques make the often unrealistic assumption that the agent has…

机器学习 · 计算机科学 2021-12-20 Franck Djeumou , Murat Cubuktepe , Craig Lennon , Ufuk Topcu

Asymmetric actor-critic methods are widely used in partially observable reinforcement learning, but typically assume full state observability to condition the critic during training, which is often unrealistic in practice. We introduce the…

机器学习 · 计算机科学 2026-02-06 Daniel Ebi , Gaspard Lambrechts , Damien Ernst , Klemens Böhm

We introduce the partially observable history process (POHP) formalism for reinforcement learning. POHP centers around the actions and observations of a single agent and abstracts away the presence of other players without reducing them to…

人工智能 · 计算机科学 2022-02-25 Dustin Morrill , Amy R. Greenwald , Michael Bowling

Reinforcement learning (RL) is a fundamental framework for sequential decision-making, in which an agent learns an optimal policy through interactions with an unknown environment. In settings with function approximation, many existing RL…

机器学习 · 计算机科学 2026-05-05 Ruiquan Huang , Donghao Li , Yingbin Liang , Jing Yang

Partially observable Markov decision processes (POMDPs) are a general framework for sequential decision-making under latent state uncertainty, yet learning in POMDPs is intractable in the worst case. Motivated by sensing and probing…

机器学习 · 计算机科学 2026-01-27 Ming Shi , Yingbin Liang , Ness B. Shroff

Reinforcement learning (RL) has garnered significant attention for developing decision-making agents that aim to maximize rewards, specified by an external supervisor, within fully observable environments. However, many real-world problems…

机器学习 · 计算机科学 2024-06-03 Parvin Malekzadeh , Konstantinos N. Plataniotis

This paper studies the fundamental limits of reinforcement learning (RL) in the challenging \emph{partially observable} setting. While it is well-established that learning in Partially Observable Markov Decision Processes (POMDPs) requires…

机器学习 · 计算机科学 2023-02-03 Fan Chen , Huan Wang , Caiming Xiong , Song Mei , Yu Bai

Much of reinforcement learning theory is built on top of oracles that are computationally hard to implement. Specifically for learning near-optimal policies in Partially Observable Markov Decision Processes (POMDPs), existing algorithms…

机器学习 · 计算机科学 2022-06-08 Noah Golowich , Ankur Moitra , Dhruv Rohatgi

We study reinforcement learning for partially observed Markov decision processes (POMDPs) with infinite observation and state spaces, which remains less investigated theoretically. To this end, we make the first attempt at bridging partial…

机器学习 · 计算机科学 2024-04-02 Qi Cai , Zhuoran Yang , Zhaoran Wang

We study policy distillation under privileged information, where a student policy with only partial observations must learn from a teacher with full-state access. A key challenge is information asymmetry: the student cannot directly access…

机器人学 · 计算机科学 2025-05-15 Yujin Kim , Nathaniel Chin , Arnav Vasudev , Sanjiban Choudhury

The integration of physiological computing into mixed-initiative human-robot interaction systems offers valuable advantages in autonomous task allocation by incorporating real-time features as human state observations into the…

Generalization is a central challenge for the deployment of reinforcement learning (RL) systems in the real world. In this paper, we show that the sequential structure of the RL problem necessitates new approaches to generalization beyond…

机器学习 · 计算机科学 2021-07-14 Dibya Ghosh , Jad Rahme , Aviral Kumar , Amy Zhang , Ryan P. Adams , Sergey Levine

Learning to cooperate in distributed partially observable environments with no communication abilities poses significant challenges for multi-agent deep reinforcement learning (MARL). This paper addresses key concerns in this domain,…

Model-based Reinforcement Learning (RL) is a popular learning paradigm due to its potential sample efficiency compared to model-free RL. However, existing empirical model-based RL approaches lack the ability to explore. This work studies a…

机器学习 · 计算机科学 2021-07-16 Yuda Song , Wen Sun

This paper delves into the problem of safe reinforcement learning (RL) in a partially observable environment with the aim of achieving safe-reachability objectives. In traditional partially observable Markov decision processes (POMDP),…

机器学习 · 计算机科学 2023-12-04 Xiaoyuan Cheng , Boli Chen , Liz Varga , Yukun Hu